SlideShare ist ein Scribd-Unternehmen logo
1 von 31
Improving your vision with Azure Cognitive Services - MixUG 1
Improving your vision with Azure Cognitive Services
13 December – /dev/070
About me:
Marc Duiker
mduiker@xpirit.comwww.xpirit.com
blog.marcduiker.nl
@marcduiker
‘13-’16
www.youtube.com/user/marcduiker
Agenda
• What is Azure Cognitive Services
• Computer Vision API
• Azure Portal, VS Code & Visual Studio
• Custom Vision API
• Custom Vision portal
Improving your vision with Azure Cognitive Services - /dev/070 3
ML & AI is hot!
Improving your vision with Azure Cognitive Services - /dev/070 4
Improving your vision with Azure Cognitive Services - /dev/070 5
Improving your vision with Azure Cognitive Services - /dev/070 6
Cortana Intelligence Suite
Improving your vision with Azure Cognitive Services - /dev/070 7
Microsoft
Cognitive
Services
Give your apps
a human side
From faces to feelings, allow your
apps to understand images and video
Hear and speak to your users by filtering noise,
identifying speakers, and understanding intent
Process text and learn how to
recognize what users want
Tap into rich knowledge amassed from
the web, academia, or your own data
Access billions of web pages, images, videos,
and news with the power of Bing APIs
Improving your vision with Azure Cognitive Services - /dev/070 9
Improving your vision with Azure Cognitive Services - /dev/070 10
Improving your vision with Azure Cognitive Services - /dev/070 11
Improving your vision with Azure Cognitive Services - /dev/070 12
Improving your vision with Azure Cognitive Services - /dev/070 13
Improving your vision with Azure Cognitive Services - /dev/070 14
Cognitive Services Labs
https://labs.cognitive.microsoft.com/
Microsoft Cognitive Services Docs
Improving your vision with Azure Cognitive Services - /dev/070 15
How did we end up here?
Improving your vision with Azure Cognitive Services - /dev/070 16
Microsoft Cognitive
Services
Bing Search
Project Oxford
Microsoft CognitiveToolkit
(CNTK)
MicrosoftTechnology & Research
2015
2009 2016
Improving your vision with Azure Cognitive Services - MixUG 17
Computer Vision API
Computer Vision API
• Recognize and understand information from images
Improving your vision with Azure Cognitive Services - /dev/070 18
Tags
Descriptions
Faces
Colors
Domain models
ImageType
Cognitive Services
Computer Vision API
Computer Vision API examples
• API Reference
• https://westeurope.dev.cognitive.microsoft.com/docs/services/56f91f2d778daf23d8e
c6739/operations/56f91f2e778daf14a499e1fa
• Perform API calls from VS Code
Improving your vision with Azure Cognitive Services - /dev/070 19
What do we need to get started?
• Create Computer Vision API endpoint in Azure
• Subscription key
• Create an application to
• Select an image
• Do a post to the Computer Vision API endpoint
Improving your vision with Azure Cognitive Services - /dev/070 20
Improving your vision with Azure Cognitive Services - MixUG 21
Demo: HelloCV
• Provide a local image
• Do a request to Analyze endpoint
• Get analysis results back as json
Improving your vision with Azure Cognitive Services - /dev/070 22
Tags
Descriptions
Faces
Colors
ImageTypeCognitive Services
Computer Vision API
Demo: Analyze images on website
Improving your vision with Azure Cognitive Services - /dev/070 23
http://...
<img>
<img>
<img>
File
Scrape images Analyze Save results
Cognitive Services
uri
uri
uri
Get sources
Goal: Analyze images on a website
Cognitive Services Demo App
• Computer Vision API
• Analyze image
• Describe image
• OCR (optical character recognition)
• Domain model detection: Landmarks
• Emotion API
• Emotion analysis
Improving your vision with Azure Cognitive Services - /dev/070 24
https://github.com/marcduiker/demos-azure-cognitive-services
Improving your vision with Azure Cognitive Services - MixUG 25
Custom Vision API (preview)
Custom Vision API
• Image classification
Improving your vision with Azure Cognitive Services - /dev/070 26
Cognitive Services
Custom Vision API
Train
#A #B
? #A
Custom Vision Demo
Improving your vision with Azure Cognitive Services - /dev/070 27
Ferrari 250 GT SWB Aston Martin DB4
To sum it up
• Ever growing collection of ‘intelligent’ APIs
• Easy to get started
• Choose carefully which API best suits your need
• Think about confidence levels
• When dealing with faces or handwriting:
Personally identifiable information (PII) -> Privacy
Improving your vision with Azure Cognitive Services - /dev/070 28
Improving your vision with Azure Cognitive Services - MixUG 29
Thanks! See you next time!
Marc Duiker
mduiker@xpirit.com
@marcduiker
Xpirit
Laapersveld 27
Hilversum
www.xpirit.com
Cognitive Services Related Resources
• https://azure.microsoft.com/en-us/services/cognitive-services/
• https://docs.microsoft.com/en-us/azure/cognitive-services/
• https://channel9.msdn.com/Search?term=Cognitive%20Services
• https://www.microsoft.com/en-us/seeing-ai/
• https://www.microsoft.com/en-us/research/research-area/computer-vision/
• https://www.customvision.ai/
• https://github.com/marcduiker/demos-azure-cognitive-services
Improving your vision with Azure Cognitive Services - /dev/070 31

Weitere ähnliche Inhalte

Was ist angesagt?

Build 2017 - B8090 - How Microsoft Cognitive Services can help your apps comm...
Build 2017 - B8090 - How Microsoft Cognitive Services can help your apps comm...Build 2017 - B8090 - How Microsoft Cognitive Services can help your apps comm...
Build 2017 - B8090 - How Microsoft Cognitive Services can help your apps comm...Windows Developer
 
Building real time image classifiers for mobile apps with azure custom vision
Building real time image classifiers for mobile apps with azure custom visionBuilding real time image classifiers for mobile apps with azure custom vision
Building real time image classifiers for mobile apps with azure custom visionLuis Beltran
 
Create real value in your business process by automated data and form extraction
Create real value in your business process by automated data and form extractionCreate real value in your business process by automated data and form extraction
Create real value in your business process by automated data and form extractionMarvin Heng
 
SQLDay 2021 PL AI Enrichment Azure Search.pptx
SQLDay 2021 PL AI Enrichment Azure Search.pptxSQLDay 2021 PL AI Enrichment Azure Search.pptx
SQLDay 2021 PL AI Enrichment Azure Search.pptxLuis Beltran
 
Global Azure2021 Verona.pptx
Global Azure2021 Verona.pptxGlobal Azure2021 Verona.pptx
Global Azure2021 Verona.pptxLuis Beltran
 
Build 2017 - B8041 - Microsoft Edge: What’s new and what’s next for the web a...
Build 2017 - B8041 - Microsoft Edge: What’s new and what’s next for the web a...Build 2017 - B8041 - Microsoft Edge: What’s new and what’s next for the web a...
Build 2017 - B8041 - Microsoft Edge: What’s new and what’s next for the web a...Windows Developer
 

Was ist angesagt? (6)

Build 2017 - B8090 - How Microsoft Cognitive Services can help your apps comm...
Build 2017 - B8090 - How Microsoft Cognitive Services can help your apps comm...Build 2017 - B8090 - How Microsoft Cognitive Services can help your apps comm...
Build 2017 - B8090 - How Microsoft Cognitive Services can help your apps comm...
 
Building real time image classifiers for mobile apps with azure custom vision
Building real time image classifiers for mobile apps with azure custom visionBuilding real time image classifiers for mobile apps with azure custom vision
Building real time image classifiers for mobile apps with azure custom vision
 
Create real value in your business process by automated data and form extraction
Create real value in your business process by automated data and form extractionCreate real value in your business process by automated data and form extraction
Create real value in your business process by automated data and form extraction
 
SQLDay 2021 PL AI Enrichment Azure Search.pptx
SQLDay 2021 PL AI Enrichment Azure Search.pptxSQLDay 2021 PL AI Enrichment Azure Search.pptx
SQLDay 2021 PL AI Enrichment Azure Search.pptx
 
Global Azure2021 Verona.pptx
Global Azure2021 Verona.pptxGlobal Azure2021 Verona.pptx
Global Azure2021 Verona.pptx
 
Build 2017 - B8041 - Microsoft Edge: What’s new and what’s next for the web a...
Build 2017 - B8041 - Microsoft Edge: What’s new and what’s next for the web a...Build 2017 - B8041 - Microsoft Edge: What’s new and what’s next for the web a...
Build 2017 - B8041 - Microsoft Edge: What’s new and what’s next for the web a...
 

Ähnlich wie Improving your vision with Azure Cognitive Services - /dev/070

Improving your vision with Azure Cognitive Services - MixUG
Improving your vision with Azure Cognitive Services - MixUGImproving your vision with Azure Cognitive Services - MixUG
Improving your vision with Azure Cognitive Services - MixUGMarc Duiker
 
Biometric Systems - Automate Video Streaming Analysis with Azure and AWS
Biometric Systems - Automate Video Streaming Analysis with Azure and AWSBiometric Systems - Automate Video Streaming Analysis with Azure and AWS
Biometric Systems - Automate Video Streaming Analysis with Azure and AWSRoberto Falconi
 
Computer Vision and Text Analytics Using Azure Cognitive Services
Computer Vision and Text Analytics Using Azure Cognitive ServicesComputer Vision and Text Analytics Using Azure Cognitive Services
Computer Vision and Text Analytics Using Azure Cognitive ServicesUmme Rubaiyat Chowdhury
 
Azure Cognitive Services로 똑똑한 서비스 만들
Azure Cognitive Services로 똑똑한 서비스 만들Azure Cognitive Services로 똑똑한 서비스 만들
Azure Cognitive Services로 똑똑한 서비스 만들Hong Min Kim
 
Unity and Microsoft Azure Cognitive Services - DIGITREK21 Workshop
Unity and Microsoft Azure Cognitive Services - DIGITREK21 WorkshopUnity and Microsoft Azure Cognitive Services - DIGITREK21 Workshop
Unity and Microsoft Azure Cognitive Services - DIGITREK21 WorkshopPablo Farías Navarro
 
Getting started with microsoft cognitive services api
Getting started with microsoft cognitive services apiGetting started with microsoft cognitive services api
Getting started with microsoft cognitive services apiJasjit Chopra
 
Creating applications that can see, hear, speak or understand using microso...
Creating applications that can see, hear, speak or understand   using microso...Creating applications that can see, hear, speak or understand   using microso...
Creating applications that can see, hear, speak or understand using microso...Radu Vunvulea
 
Making Data Scientists Productive in Azure
Making Data Scientists Productive in AzureMaking Data Scientists Productive in Azure
Making Data Scientists Productive in AzureValdas Maksimavičius
 
Waking App Ltd: Next Gen AR Toolset
Waking App Ltd: Next Gen AR ToolsetWaking App Ltd: Next Gen AR Toolset
Waking App Ltd: Next Gen AR ToolsetAugmentedWorldExpo
 
The Wikitude SDK and the Wikitude Studio
The Wikitude SDK and the Wikitude StudioThe Wikitude SDK and the Wikitude Studio
The Wikitude SDK and the Wikitude StudioMartin Lechner
 
Hyf project ideas_02
Hyf project ideas_02Hyf project ideas_02
Hyf project ideas_02KatoK1
 
Microsoft Azure - The Best Platform for AI
Microsoft Azure - The Best Platform for AIMicrosoft Azure - The Best Platform for AI
Microsoft Azure - The Best Platform for AIMayur Tendulkar
 
Hyf azure ml_1
Hyf azure ml_1Hyf azure ml_1
Hyf azure ml_1KatoK1
 
"Creating Smarter, More Interactive Apps and Systems with Computer Vision," a...
"Creating Smarter, More Interactive Apps and Systems with Computer Vision," a..."Creating Smarter, More Interactive Apps and Systems with Computer Vision," a...
"Creating Smarter, More Interactive Apps and Systems with Computer Vision," a...Edge AI and Vision Alliance
 
Cognitive services in Business applications
Cognitive services in Business applicationsCognitive services in Business applications
Cognitive services in Business applicationsMichele Aponte
 
How to build a serverless helmet detection system
How to build a serverless helmet detection systemHow to build a serverless helmet detection system
How to build a serverless helmet detection systemMandar Dharmadhikari
 
Microsoft Azure Power BI
Microsoft Azure Power BIMicrosoft Azure Power BI
Microsoft Azure Power BIExperfy
 
Azure Meetup: Novità CosmosDB modalità Serverless e Cognitive Services
Azure Meetup: Novità CosmosDB modalità Serverless e Cognitive ServicesAzure Meetup: Novità CosmosDB modalità Serverless e Cognitive Services
Azure Meetup: Novità CosmosDB modalità Serverless e Cognitive Servicesdotnetcode
 

Ähnlich wie Improving your vision with Azure Cognitive Services - /dev/070 (20)

Improving your vision with Azure Cognitive Services - MixUG
Improving your vision with Azure Cognitive Services - MixUGImproving your vision with Azure Cognitive Services - MixUG
Improving your vision with Azure Cognitive Services - MixUG
 
Biometric Systems - Automate Video Streaming Analysis with Azure and AWS
Biometric Systems - Automate Video Streaming Analysis with Azure and AWSBiometric Systems - Automate Video Streaming Analysis with Azure and AWS
Biometric Systems - Automate Video Streaming Analysis with Azure and AWS
 
Computer Vision and Text Analytics Using Azure Cognitive Services
Computer Vision and Text Analytics Using Azure Cognitive ServicesComputer Vision and Text Analytics Using Azure Cognitive Services
Computer Vision and Text Analytics Using Azure Cognitive Services
 
Azure Cognitive Services로 똑똑한 서비스 만들
Azure Cognitive Services로 똑똑한 서비스 만들Azure Cognitive Services로 똑똑한 서비스 만들
Azure Cognitive Services로 똑똑한 서비스 만들
 
Unity and Microsoft Azure Cognitive Services - DIGITREK21 Workshop
Unity and Microsoft Azure Cognitive Services - DIGITREK21 WorkshopUnity and Microsoft Azure Cognitive Services - DIGITREK21 Workshop
Unity and Microsoft Azure Cognitive Services - DIGITREK21 Workshop
 
Getting started with microsoft cognitive services api
Getting started with microsoft cognitive services apiGetting started with microsoft cognitive services api
Getting started with microsoft cognitive services api
 
Creating applications that can see, hear, speak or understand using microso...
Creating applications that can see, hear, speak or understand   using microso...Creating applications that can see, hear, speak or understand   using microso...
Creating applications that can see, hear, speak or understand using microso...
 
Making Data Scientists Productive in Azure
Making Data Scientists Productive in AzureMaking Data Scientists Productive in Azure
Making Data Scientists Productive in Azure
 
Waking App Ltd: Next Gen AR Toolset
Waking App Ltd: Next Gen AR ToolsetWaking App Ltd: Next Gen AR Toolset
Waking App Ltd: Next Gen AR Toolset
 
The Wikitude SDK and the Wikitude Studio
The Wikitude SDK and the Wikitude StudioThe Wikitude SDK and the Wikitude Studio
The Wikitude SDK and the Wikitude Studio
 
Hyf project ideas_02
Hyf project ideas_02Hyf project ideas_02
Hyf project ideas_02
 
Microsoft Azure - The Best Platform for AI
Microsoft Azure - The Best Platform for AIMicrosoft Azure - The Best Platform for AI
Microsoft Azure - The Best Platform for AI
 
Hyf azure ml_1
Hyf azure ml_1Hyf azure ml_1
Hyf azure ml_1
 
"Creating Smarter, More Interactive Apps and Systems with Computer Vision," a...
"Creating Smarter, More Interactive Apps and Systems with Computer Vision," a..."Creating Smarter, More Interactive Apps and Systems with Computer Vision," a...
"Creating Smarter, More Interactive Apps and Systems with Computer Vision," a...
 
Custom vision
Custom visionCustom vision
Custom vision
 
Cognitive services in Business applications
Cognitive services in Business applicationsCognitive services in Business applications
Cognitive services in Business applications
 
How to build a serverless helmet detection system
How to build a serverless helmet detection systemHow to build a serverless helmet detection system
How to build a serverless helmet detection system
 
Microsoft Azure Power BI
Microsoft Azure Power BIMicrosoft Azure Power BI
Microsoft Azure Power BI
 
Microsoft azure
Microsoft azureMicrosoft azure
Microsoft azure
 
Azure Meetup: Novità CosmosDB modalità Serverless e Cognitive Services
Azure Meetup: Novità CosmosDB modalità Serverless e Cognitive ServicesAzure Meetup: Novità CosmosDB modalità Serverless e Cognitive Services
Azure Meetup: Novità CosmosDB modalità Serverless e Cognitive Services
 

Mehr von Marc Duiker

Take your Azure Functions to the next level with Durable Functions - Serverle...
Take your Azure Functions to the next level with Durable Functions - Serverle...Take your Azure Functions to the next level with Durable Functions - Serverle...
Take your Azure Functions to the next level with Durable Functions - Serverle...Marc Duiker
 
Take your Azure Functions to the next level with Durable Functions - WAZUG
Take your Azure Functions to the next level with Durable Functions - WAZUGTake your Azure Functions to the next level with Durable Functions - WAZUG
Take your Azure Functions to the next level with Durable Functions - WAZUGMarc Duiker
 
Put Your Web App on a Diet with Azure Functions
Put Your Web App on a Diet with Azure FunctionsPut Your Web App on a Diet with Azure Functions
Put Your Web App on a Diet with Azure FunctionsMarc Duiker
 
Take your azure functions to the next level with durable functions @ Experts ...
Take your azure functions to the next level with durable functions @ Experts ...Take your azure functions to the next level with durable functions @ Experts ...
Take your azure functions to the next level with durable functions @ Experts ...Marc Duiker
 
Managing and querying large data sets using Data Factory, Cosmos DB and Azure...
Managing and querying large data sets using Data Factory, Cosmos DB and Azure...Managing and querying large data sets using Data Factory, Cosmos DB and Azure...
Managing and querying large data sets using Data Factory, Cosmos DB and Azure...Marc Duiker
 
Orchestrate your Azure Functions with Durable Functions - AzureThursday Meetup
Orchestrate your Azure Functions with Durable Functions - AzureThursday MeetupOrchestrate your Azure Functions with Durable Functions - AzureThursday Meetup
Orchestrate your Azure Functions with Durable Functions - AzureThursday MeetupMarc Duiker
 
Getting Started with Serverless Architectures using Azure Functions
Getting Started with Serverless Architectures using Azure FunctionsGetting Started with Serverless Architectures using Azure Functions
Getting Started with Serverless Architectures using Azure FunctionsMarc Duiker
 

Mehr von Marc Duiker (7)

Take your Azure Functions to the next level with Durable Functions - Serverle...
Take your Azure Functions to the next level with Durable Functions - Serverle...Take your Azure Functions to the next level with Durable Functions - Serverle...
Take your Azure Functions to the next level with Durable Functions - Serverle...
 
Take your Azure Functions to the next level with Durable Functions - WAZUG
Take your Azure Functions to the next level with Durable Functions - WAZUGTake your Azure Functions to the next level with Durable Functions - WAZUG
Take your Azure Functions to the next level with Durable Functions - WAZUG
 
Put Your Web App on a Diet with Azure Functions
Put Your Web App on a Diet with Azure FunctionsPut Your Web App on a Diet with Azure Functions
Put Your Web App on a Diet with Azure Functions
 
Take your azure functions to the next level with durable functions @ Experts ...
Take your azure functions to the next level with durable functions @ Experts ...Take your azure functions to the next level with durable functions @ Experts ...
Take your azure functions to the next level with durable functions @ Experts ...
 
Managing and querying large data sets using Data Factory, Cosmos DB and Azure...
Managing and querying large data sets using Data Factory, Cosmos DB and Azure...Managing and querying large data sets using Data Factory, Cosmos DB and Azure...
Managing and querying large data sets using Data Factory, Cosmos DB and Azure...
 
Orchestrate your Azure Functions with Durable Functions - AzureThursday Meetup
Orchestrate your Azure Functions with Durable Functions - AzureThursday MeetupOrchestrate your Azure Functions with Durable Functions - AzureThursday Meetup
Orchestrate your Azure Functions with Durable Functions - AzureThursday Meetup
 
Getting Started with Serverless Architectures using Azure Functions
Getting Started with Serverless Architectures using Azure FunctionsGetting Started with Serverless Architectures using Azure Functions
Getting Started with Serverless Architectures using Azure Functions
 

Kürzlich hochgeladen

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CVKhem
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxKatpro Technologies
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?Antenna Manufacturer Coco
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 

Kürzlich hochgeladen (20)

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 

Improving your vision with Azure Cognitive Services - /dev/070

  • 1. Improving your vision with Azure Cognitive Services - MixUG 1 Improving your vision with Azure Cognitive Services 13 December – /dev/070
  • 3. Agenda • What is Azure Cognitive Services • Computer Vision API • Azure Portal, VS Code & Visual Studio • Custom Vision API • Custom Vision portal Improving your vision with Azure Cognitive Services - /dev/070 3
  • 4. ML & AI is hot! Improving your vision with Azure Cognitive Services - /dev/070 4
  • 5. Improving your vision with Azure Cognitive Services - /dev/070 5
  • 6. Improving your vision with Azure Cognitive Services - /dev/070 6
  • 7. Cortana Intelligence Suite Improving your vision with Azure Cognitive Services - /dev/070 7
  • 8. Microsoft Cognitive Services Give your apps a human side From faces to feelings, allow your apps to understand images and video Hear and speak to your users by filtering noise, identifying speakers, and understanding intent Process text and learn how to recognize what users want Tap into rich knowledge amassed from the web, academia, or your own data Access billions of web pages, images, videos, and news with the power of Bing APIs
  • 9. Improving your vision with Azure Cognitive Services - /dev/070 9
  • 10. Improving your vision with Azure Cognitive Services - /dev/070 10
  • 11. Improving your vision with Azure Cognitive Services - /dev/070 11
  • 12. Improving your vision with Azure Cognitive Services - /dev/070 12
  • 13. Improving your vision with Azure Cognitive Services - /dev/070 13
  • 14. Improving your vision with Azure Cognitive Services - /dev/070 14 Cognitive Services Labs https://labs.cognitive.microsoft.com/
  • 15. Microsoft Cognitive Services Docs Improving your vision with Azure Cognitive Services - /dev/070 15
  • 16. How did we end up here? Improving your vision with Azure Cognitive Services - /dev/070 16 Microsoft Cognitive Services Bing Search Project Oxford Microsoft CognitiveToolkit (CNTK) MicrosoftTechnology & Research 2015 2009 2016
  • 17. Improving your vision with Azure Cognitive Services - MixUG 17 Computer Vision API
  • 18. Computer Vision API • Recognize and understand information from images Improving your vision with Azure Cognitive Services - /dev/070 18 Tags Descriptions Faces Colors Domain models ImageType Cognitive Services Computer Vision API
  • 19. Computer Vision API examples • API Reference • https://westeurope.dev.cognitive.microsoft.com/docs/services/56f91f2d778daf23d8e c6739/operations/56f91f2e778daf14a499e1fa • Perform API calls from VS Code Improving your vision with Azure Cognitive Services - /dev/070 19
  • 20. What do we need to get started? • Create Computer Vision API endpoint in Azure • Subscription key • Create an application to • Select an image • Do a post to the Computer Vision API endpoint Improving your vision with Azure Cognitive Services - /dev/070 20
  • 21. Improving your vision with Azure Cognitive Services - MixUG 21
  • 22. Demo: HelloCV • Provide a local image • Do a request to Analyze endpoint • Get analysis results back as json Improving your vision with Azure Cognitive Services - /dev/070 22 Tags Descriptions Faces Colors ImageTypeCognitive Services Computer Vision API
  • 23. Demo: Analyze images on website Improving your vision with Azure Cognitive Services - /dev/070 23 http://... <img> <img> <img> File Scrape images Analyze Save results Cognitive Services uri uri uri Get sources Goal: Analyze images on a website
  • 24. Cognitive Services Demo App • Computer Vision API • Analyze image • Describe image • OCR (optical character recognition) • Domain model detection: Landmarks • Emotion API • Emotion analysis Improving your vision with Azure Cognitive Services - /dev/070 24 https://github.com/marcduiker/demos-azure-cognitive-services
  • 25. Improving your vision with Azure Cognitive Services - MixUG 25 Custom Vision API (preview)
  • 26. Custom Vision API • Image classification Improving your vision with Azure Cognitive Services - /dev/070 26 Cognitive Services Custom Vision API Train #A #B ? #A
  • 27. Custom Vision Demo Improving your vision with Azure Cognitive Services - /dev/070 27 Ferrari 250 GT SWB Aston Martin DB4
  • 28. To sum it up • Ever growing collection of ‘intelligent’ APIs • Easy to get started • Choose carefully which API best suits your need • Think about confidence levels • When dealing with faces or handwriting: Personally identifiable information (PII) -> Privacy Improving your vision with Azure Cognitive Services - /dev/070 28
  • 29. Improving your vision with Azure Cognitive Services - MixUG 29 Thanks! See you next time!
  • 31. Cognitive Services Related Resources • https://azure.microsoft.com/en-us/services/cognitive-services/ • https://docs.microsoft.com/en-us/azure/cognitive-services/ • https://channel9.msdn.com/Search?term=Cognitive%20Services • https://www.microsoft.com/en-us/seeing-ai/ • https://www.microsoft.com/en-us/research/research-area/computer-vision/ • https://www.customvision.ai/ • https://github.com/marcduiker/demos-azure-cognitive-services Improving your vision with Azure Cognitive Services - /dev/070 31

Hinweis der Redaktion

  1. Logical progression after ‘big data’. https://www.forbes.com/sites/moorinsights/2017/01/06/five-things-to-watch-in-ai-and-machine-learning-in-2017/ https://blogs.sap.com/2017/01/30/machine-learning-will-be-2017s-top-trend-and-will-help-solve-iots-big-data-challenge/ https://www.ibm.com/blogs/think/2017/02/machine-learning/
  2. Azure Machine Learning: Create model Train model Score & test model Publish as a webservice
  3. Set of APIs which allows developers to do analysis on various types of content: images, text, audio and video.
  4. Set of APIs which allows developers to do analysis on various types of content: images, text, audio and video.
  5. Set of APIs which allows developers to do analysis on various types of content: images, text, audio and video.
  6. Set of APIs which allows developers to do analysis on various types of content: images, text, audio and video.
  7. Set of APIs which allows developers to do analysis on various types of content: images, text, audio and video.
  8. Set of APIs which allows developers to do analysis on various types of content: images, text, audio and video.
  9. No control over training the model. Black box.
  10. No control over training the model. Black box.
  11. Create Computer Vision Endpoint through: - Cognitive Services and select an API - Computer Vision API
  12. Perform demo with sites: www.nos.nl www.bbc.com/news http://designlike.com/100-most-famous-landmarks-around-the-world/
  13. You need to train the model yourself. There are categories: food,