5. Microsoft
Cognitive
Services
Give your apps
a human side
From faces to feelings, allow your
apps to understand images and video
Hear and speak to your users by filtering noise,
identifying speakers, and understanding intent
Process text and learn how to
recognize what users want
Tap into rich knowledge amassed from
the web, academia, or your own data
Access billions of web pages, images, videos,
and news with the power of Bing APIs
6. How did we end up here?
Improving your vision with Azure Cognitive Services - MixUG 7
Microsoft Cognitive
Services
Bing Search
Project Oxford
Microsoft CognitiveToolkit
(CNTK)
MicrosoftTechnology & Research
2015
2009 2016
17. Computer Vision API
• Recognize and understand information from images
Improving your vision with Azure Cognitive Services - MixUG 19
Tags
Descriptions
Faces
Colors
Domain modelsCognitive Services
Computer Vision API
18. Computer Vision API
• Examples
• https://azure.microsoft.com/en-us/services/cognitive-services/computer-vision/
• API Reference
• https://westus.dev.cognitive.microsoft.com/docs/services/56f91f2d778daf23d8ec673
9/operations/56f91f2e778daf14a499e1fa
Improving your vision with Azure Cognitive Services - MixUG 20
20. Cognitive Services Demo App
Improving your vision with Azure Cognitive Services - MixUG 22
http://...
<img>
<img>
<img>
File
Scrape images Analyze Save results
Cognitive Services
uri
uri
uri
Get sources
Goal: Analyze images on a website
21. Cognitive Services Demo App
• Computer Vision API
• Analyze image
• Describe image
• OCR (optical character recognition)
• Domain model detection: Landmarks
• Emotion API
• Emotion analysis
Improving your vision with Azure Cognitive Services - MixUG 23
https://github.com/marcduiker/demos-azure-cognitive-services
22. Improving your vision with Azure Cognitive Services - MixUG 24
Custom Vision API (preview)
23. Custom Vision API
• Image classification
Improving your vision with Azure Cognitive Services - MixUG 25
Cognitive Services
Custom Vision API
Train
#A #B
? #A
24. Custom Vision Demo
Improving your vision with Azure Cognitive Services - MixUG 26
Ferrari 250 GT SWB Aston Martin DB4
25. To sum it up
• Ever growing collection of ‘intelligent’ APIs
• Easy to get started
• Choose carefully which API best suits your need
• Think about confidence levels
• When dealing with faces or handwriting:
Personally identifiable information (PII) -> Privacy
Improving your vision with Azure Cognitive Services - MixUG 27
26. Improving your vision with Azure Cognitive Services - MixUG 28
Thanks! See you next time!