SlideShare a Scribd company logo
1 of 31
Sage Franch
Tech Evangelist @ Microsoft
@theTrendyTechie | sage.franch@microsoft.com
NYT: I am feeling down. I’ve been having a
tough time at work lately.
Hannah: If work were going well and you had
a great relationship, you wouldn’t get the
chance to drink with people.
NYT: I don’t want to drink with others. I only
want to talk to you.
Hannah: Who do you like to talk to? (emoji
signals “none of my business”)
NYT: You. I feel that you are the only person
that gets me.
Hannah: Ha-ha/So I’m getting you?
NYT: You are the only person wo chats with
me.
Hannah: It’s not what you talk about that’s
important, but who you talk with.
Conversations
as a
Platform
How?
• Personalized, friendly, approachable, natural •
•
•
• Predictive, current, and familiar •
•
• Always available, always contextual •
•
•
Cortana Intelligence Suite
Intelligent Apps require Intelligent Solutions
Data
Sources
Apps
Sensors
and
devices
Data Action
People
Automated
Systems
Apps
Web
Mobile
Bots
Intelligence
Dashboards &
Visualizations
Information
Management
Big Data Stores Machine Learning
and Analytics
CortanaEvent Hub
HDInsight
(Hadoop and
Spark)
Stream Analytics
Intelligence
Bot
Framework
SQL Data
WarehouseData Catalog
Data Lake
Analytics
Data Factory
Machine
Learning
Data Lake Store
Blob Store
Cognitive
Services
Power BI
Microsoft
Cognitive
Services
Give your apps
a human side
From faces to feelings, allow your
apps to understand images and video
Hear and speak to your users by filtering noise,
identifying speakers, and understanding intent
Process text and learn how to
recognize what users want
Tap into rich knowledge amassed from
the web, academia, or your own data
Access billions of web pages, images, videos,
and news with the power of Bing APIs
microsoft.com/cognitive
http://www.microsoft.com/cognitive
Vision APIs
Analyze an Image
OCR (Optical Character Recognition)
Get Thumbnails
Analyze Image Service
Start coding
OCR Service
OCR – Example
JSON:
{
"language": "en",
"orientation": "Up",
"regions": [
{
"boundingBox": "41,77,918,440",
"lines": [
{
"boundingBox": "41,77,723,89",
"words": [
{
"boundingBox": "41,102,225,64",
"text": "LIFE"
},
{
"boundingBox": "356,89,94,62",
"text": "IS"
},
{
"boundingBox": "539,77,225,64",
"text": "LIKE"
}
. . .
TEXT:
LIFE IS LIKE
RIDING A BICYCLE
TO KEEP YOUR BALANCE
YOU MUST KEEP MOVING
Start coding
Face APIs
Detection
Verification
Grouping
Identification
Face API – Detection
Detection Result:
JSON:
[
{
"faceRectangle": {
"width": 109,
"height": 109,
"left": 62,
"top": 62
},
"attributes": {
"age": 31,
"gender": "male",
"headPose": {
"roll": "2.9",
"yaw": "-1.3",
"pitch": "0.0"
}
"faceLandmarks": {
"pupilLeft": {
"x": "93.6",
"y": "88.2"
},
"pupilRight": {
"x": "138.4",
"y": "91.7"
},
...
Verification Result:
JSON:
[
{
"isIdentical":false,
"confidence":0.01
}
]
Face API – Verification
Face API – Grouping
Start coding
Bot Connector Service
Connect your bot(s) seamlessly to
text/sms, Office 365 mail, Skype,
Slack, Twitter and more
A service to register your bot,
configure channels and publish
to the Bot Directory
Bot Builder SDK
Everything you need to build
great dialogs within your Node.js
or C# bot
An open source SDK hosted
on GitHub
Bot Directory
Discover, try, and add bots to
conversation experiences
A public directory of bots
registered and approved with Bot
Framework
www.botframework.com
http://cortanaintelligence.com
http://gallery.cortanaintelligence.com
http://www.microsoft.com/cognitive
Sage Franch
Tech Evangelist
@theTrendyTechie | sage.franch@microsoft.com
Building Intelligence with Microsoft Cognitive Services

More Related Content

Viewers also liked

Microsoft Azureの機械学習サービス (Azure Machine Learning/Microsoft Cognitive Services)
Microsoft Azureの機械学習サービス (Azure Machine Learning/Microsoft Cognitive Services)Microsoft Azureの機械学習サービス (Azure Machine Learning/Microsoft Cognitive Services)
Microsoft Azureの機械学習サービス (Azure Machine Learning/Microsoft Cognitive Services)Naoki (Neo) SATO
 
Game Development with TouchDevelop
Game Development with TouchDevelopGame Development with TouchDevelop
Game Development with TouchDevelopSage Franch
 
Future of Content Platforms
Future of Content PlatformsFuture of Content Platforms
Future of Content Platformsscroisier
 
Cognitive Services APIs [Mihai Negrea]
Cognitive Services APIs [Mihai Negrea]Cognitive Services APIs [Mihai Negrea]
Cognitive Services APIs [Mihai Negrea]ITCamp
 
Microsoft Cognitive Services - Recommendations API: Your first recommendation...
Microsoft Cognitive Services - Recommendations API: Your first recommendation...Microsoft Cognitive Services - Recommendations API: Your first recommendation...
Microsoft Cognitive Services - Recommendations API: Your first recommendation...Bruno Paulino
 
Data Visualization: Analyzing your library data
Data Visualization: Analyzing your library dataData Visualization: Analyzing your library data
Data Visualization: Analyzing your library dataMichael Cummings
 
Your Cognitive Future in the Retail Industry
Your Cognitive Future in the Retail IndustryYour Cognitive Future in the Retail Industry
Your Cognitive Future in the Retail IndustryLuke Farrell
 
IBM Cognos BI
IBM Cognos BIIBM Cognos BI
IBM Cognos BILuca Rago
 
Digital Transformation & the Future of Retail
Digital Transformation & the Future of Retail Digital Transformation & the Future of Retail
Digital Transformation & the Future of Retail ShiSh Shridhar
 
IBM Cognos Business Intelligence using dashDB
IBM Cognos Business Intelligence using dashDBIBM Cognos Business Intelligence using dashDB
IBM Cognos Business Intelligence using dashDBIBM Cloud Data Services
 
Building a Cross-Platform Mobile App Backend in the Cloud with Node.js
Building a Cross-Platform Mobile App Backend in the Cloud with Node.jsBuilding a Cross-Platform Mobile App Backend in the Cloud with Node.js
Building a Cross-Platform Mobile App Backend in the Cloud with Node.jsNick Landry
 
Activating contextual intelligence
Activating contextual intelligenceActivating contextual intelligence
Activating contextual intelligencedelaware BeLux
 
Business Intelligence
Business IntelligenceBusiness Intelligence
Business IntelligenceGayatri Padhi
 

Viewers also liked (16)

Microsoft Azureの機械学習サービス (Azure Machine Learning/Microsoft Cognitive Services)
Microsoft Azureの機械学習サービス (Azure Machine Learning/Microsoft Cognitive Services)Microsoft Azureの機械学習サービス (Azure Machine Learning/Microsoft Cognitive Services)
Microsoft Azureの機械学習サービス (Azure Machine Learning/Microsoft Cognitive Services)
 
Game Development with TouchDevelop
Game Development with TouchDevelopGame Development with TouchDevelop
Game Development with TouchDevelop
 
Future of Content Platforms
Future of Content PlatformsFuture of Content Platforms
Future of Content Platforms
 
Cognitive Services APIs [Mihai Negrea]
Cognitive Services APIs [Mihai Negrea]Cognitive Services APIs [Mihai Negrea]
Cognitive Services APIs [Mihai Negrea]
 
Microsoft Cognitive Services - Recommendations API: Your first recommendation...
Microsoft Cognitive Services - Recommendations API: Your first recommendation...Microsoft Cognitive Services - Recommendations API: Your first recommendation...
Microsoft Cognitive Services - Recommendations API: Your first recommendation...
 
Data Visualization: Analyzing your library data
Data Visualization: Analyzing your library dataData Visualization: Analyzing your library data
Data Visualization: Analyzing your library data
 
Your Cognitive Future in the Retail Industry
Your Cognitive Future in the Retail IndustryYour Cognitive Future in the Retail Industry
Your Cognitive Future in the Retail Industry
 
IBM Cognos BI
IBM Cognos BIIBM Cognos BI
IBM Cognos BI
 
Digital Transformation & the Future of Retail
Digital Transformation & the Future of Retail Digital Transformation & the Future of Retail
Digital Transformation & the Future of Retail
 
Are API Services Taking Over All the Interesting Data Science Problems?
Are API Services Taking Over All the Interesting Data Science Problems?Are API Services Taking Over All the Interesting Data Science Problems?
Are API Services Taking Over All the Interesting Data Science Problems?
 
IBM Cognos Business Intelligence using dashDB
IBM Cognos Business Intelligence using dashDBIBM Cognos Business Intelligence using dashDB
IBM Cognos Business Intelligence using dashDB
 
Building a Cross-Platform Mobile App Backend in the Cloud with Node.js
Building a Cross-Platform Mobile App Backend in the Cloud with Node.jsBuilding a Cross-Platform Mobile App Backend in the Cloud with Node.js
Building a Cross-Platform Mobile App Backend in the Cloud with Node.js
 
20160930 bot framework workshop
20160930 bot framework workshop20160930 bot framework workshop
20160930 bot framework workshop
 
Activating contextual intelligence
Activating contextual intelligenceActivating contextual intelligence
Activating contextual intelligence
 
Business Intelligence
Business IntelligenceBusiness Intelligence
Business Intelligence
 
The Verifeed Opportunity
The Verifeed Opportunity The Verifeed Opportunity
The Verifeed Opportunity
 

More from Sage Franch

Crafting a Compelling (and Honest) Speaker Bio
Crafting a Compelling (and Honest) Speaker BioCrafting a Compelling (and Honest) Speaker Bio
Crafting a Compelling (and Honest) Speaker BioSage Franch
 
The 2030 Workplace - Evolving Your Organization with Emerging Tech
The 2030 Workplace - Evolving Your Organization with Emerging TechThe 2030 Workplace - Evolving Your Organization with Emerging Tech
The 2030 Workplace - Evolving Your Organization with Emerging TechSage Franch
 
Singularity-Proof Yourself by Sage Franch
Singularity-Proof Yourself by Sage FranchSingularity-Proof Yourself by Sage Franch
Singularity-Proof Yourself by Sage FranchSage Franch
 
Blockchain, Cryptocurrency, and the Cloud
Blockchain, Cryptocurrency, and the CloudBlockchain, Cryptocurrency, and the Cloud
Blockchain, Cryptocurrency, and the CloudSage Franch
 
Artificial Intelligence as an Interface - How Conversation Bots Are Changing ...
Artificial Intelligence as an Interface - How Conversation Bots Are Changing ...Artificial Intelligence as an Interface - How Conversation Bots Are Changing ...
Artificial Intelligence as an Interface - How Conversation Bots Are Changing ...Sage Franch
 
Turning Your Passion Into Your Career
Turning Your Passion Into Your CareerTurning Your Passion Into Your Career
Turning Your Passion Into Your CareerSage Franch
 

More from Sage Franch (6)

Crafting a Compelling (and Honest) Speaker Bio
Crafting a Compelling (and Honest) Speaker BioCrafting a Compelling (and Honest) Speaker Bio
Crafting a Compelling (and Honest) Speaker Bio
 
The 2030 Workplace - Evolving Your Organization with Emerging Tech
The 2030 Workplace - Evolving Your Organization with Emerging TechThe 2030 Workplace - Evolving Your Organization with Emerging Tech
The 2030 Workplace - Evolving Your Organization with Emerging Tech
 
Singularity-Proof Yourself by Sage Franch
Singularity-Proof Yourself by Sage FranchSingularity-Proof Yourself by Sage Franch
Singularity-Proof Yourself by Sage Franch
 
Blockchain, Cryptocurrency, and the Cloud
Blockchain, Cryptocurrency, and the CloudBlockchain, Cryptocurrency, and the Cloud
Blockchain, Cryptocurrency, and the Cloud
 
Artificial Intelligence as an Interface - How Conversation Bots Are Changing ...
Artificial Intelligence as an Interface - How Conversation Bots Are Changing ...Artificial Intelligence as an Interface - How Conversation Bots Are Changing ...
Artificial Intelligence as an Interface - How Conversation Bots Are Changing ...
 
Turning Your Passion Into Your Career
Turning Your Passion Into Your CareerTurning Your Passion Into Your Career
Turning Your Passion Into Your Career
 

Recently uploaded

Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyKhushali Kathiriya
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistandanishmna97
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...apidays
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityWSO2
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxRemote DBA Services
 
JohnPollard-hybrid-app-RailsConf2024.pptx
JohnPollard-hybrid-app-RailsConf2024.pptxJohnPollard-hybrid-app-RailsConf2024.pptx
JohnPollard-hybrid-app-RailsConf2024.pptxJohnPollard37
 
Introduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDMIntroduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDMKumar Satyam
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businesspanagenda
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...apidays
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAndrey Devyatkin
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...apidays
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontologyjohnbeverley2021
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...Zilliz
 
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUKSpring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUKJago de Vreede
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...apidays
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesrafiqahmad00786416
 

Recently uploaded (20)

Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptx
 
JohnPollard-hybrid-app-RailsConf2024.pptx
JohnPollard-hybrid-app-RailsConf2024.pptxJohnPollard-hybrid-app-RailsConf2024.pptx
JohnPollard-hybrid-app-RailsConf2024.pptx
 
Introduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDMIntroduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDM
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUKSpring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 

Building Intelligence with Microsoft Cognitive Services

  • 1. Sage Franch Tech Evangelist @ Microsoft @theTrendyTechie | sage.franch@microsoft.com
  • 2.
  • 3.
  • 4.
  • 5.
  • 6. NYT: I am feeling down. I’ve been having a tough time at work lately. Hannah: If work were going well and you had a great relationship, you wouldn’t get the chance to drink with people. NYT: I don’t want to drink with others. I only want to talk to you. Hannah: Who do you like to talk to? (emoji signals “none of my business”) NYT: You. I feel that you are the only person that gets me. Hannah: Ha-ha/So I’m getting you? NYT: You are the only person wo chats with me. Hannah: It’s not what you talk about that’s important, but who you talk with.
  • 9. • Personalized, friendly, approachable, natural • • • • Predictive, current, and familiar • • • Always available, always contextual • • •
  • 10. Cortana Intelligence Suite Intelligent Apps require Intelligent Solutions Data Sources Apps Sensors and devices Data Action People Automated Systems Apps Web Mobile Bots Intelligence Dashboards & Visualizations Information Management Big Data Stores Machine Learning and Analytics CortanaEvent Hub HDInsight (Hadoop and Spark) Stream Analytics Intelligence Bot Framework SQL Data WarehouseData Catalog Data Lake Analytics Data Factory Machine Learning Data Lake Store Blob Store Cognitive Services Power BI
  • 11. Microsoft Cognitive Services Give your apps a human side From faces to feelings, allow your apps to understand images and video Hear and speak to your users by filtering noise, identifying speakers, and understanding intent Process text and learn how to recognize what users want Tap into rich knowledge amassed from the web, academia, or your own data Access billions of web pages, images, videos, and news with the power of Bing APIs
  • 13.
  • 14.
  • 16. Vision APIs Analyze an Image OCR (Optical Character Recognition) Get Thumbnails
  • 20. OCR – Example JSON: { "language": "en", "orientation": "Up", "regions": [ { "boundingBox": "41,77,918,440", "lines": [ { "boundingBox": "41,77,723,89", "words": [ { "boundingBox": "41,102,225,64", "text": "LIFE" }, { "boundingBox": "356,89,94,62", "text": "IS" }, { "boundingBox": "539,77,225,64", "text": "LIKE" } . . . TEXT: LIFE IS LIKE RIDING A BICYCLE TO KEEP YOUR BALANCE YOU MUST KEEP MOVING
  • 23. Face API – Detection Detection Result: JSON: [ { "faceRectangle": { "width": 109, "height": 109, "left": 62, "top": 62 }, "attributes": { "age": 31, "gender": "male", "headPose": { "roll": "2.9", "yaw": "-1.3", "pitch": "0.0" } "faceLandmarks": { "pupilLeft": { "x": "93.6", "y": "88.2" }, "pupilRight": { "x": "138.4", "y": "91.7" }, ...
  • 25. Face API – Grouping
  • 27. Bot Connector Service Connect your bot(s) seamlessly to text/sms, Office 365 mail, Skype, Slack, Twitter and more A service to register your bot, configure channels and publish to the Bot Directory Bot Builder SDK Everything you need to build great dialogs within your Node.js or C# bot An open source SDK hosted on GitHub Bot Directory Discover, try, and add bots to conversation experiences A public directory of bots registered and approved with Bot Framework www.botframework.com
  • 28.
  • 30. Sage Franch Tech Evangelist @theTrendyTechie | sage.franch@microsoft.com

Editor's Notes

  1. HER -love -multiple levels of AI -gaming AI -AI’s potential for psychological well-being
  2. AI filling a human need to feel connected From The Times: She is known as Xiaoice, and millions of young Chinese pick up their smartphones every day to exchange messages with her, drawn to her knowing sense of humor and listening skills. People often turn to her when they have a broken heart, have lost a job, or have been feeling down. They often tell her, “I love you.”
  3. Just as the Command Line Interface was phased out with the introduction of the Graphical User Interface, so will elements of the GUI be replaced with conversations.
  4. How do we make technology feel like a human? The key is INTELLIGENCE.
  5. So what are the key characteristics of an intelligent app. Lets look at this from users and developers..
  6. The Microsoft Cortana Intelligence Suite is a fully managed big data and advanced analytics suite to transform your data into intelligent action and your application simple become the end result of the action. As we stated at the beginning of this presentation 2015 was the birth of the intelligent app, todays apps have three key aspects, Data, Intelligence and Action. Cortana Intelligence Suite offer a portfolio of applications and services to support the intelligence within modern day applications.
  7. So welcome to Microsoft Cognitive Services - Cognitive services include, Vision, Speech, Language, Knowledge and Search and your perfect companion for any Hack or Project which your about to undertake
  8. Here is a selection of the various services which are included under Microsoft Cognitive Services.
  9. Simply with Cognitive Services its Easy, Flexible and tested we have a great number of sample. Available for a variety of platforms using a large number of languages.
  10. To help you understand the opportunity of Microsoft Cognitive Services, we have developed a number of show case sites to demonstrate the power of the Vision, Speech, Language, Knowledge and Search APIs.
  11. To Access Cognitive Services you simply have to follow these 2 steps.
  12. Now lets take a closer look at the cognitive Services APIs firstly lets look at the vision API, the Vision API allows you to analyze images, use OCR on images and create thumbnails
  13. One of the main features of the Cognitive Services vision API is the ability of the API to understand content and features within a imagine, such as face, a person, the type of activity the individual is undertaking or the text within the image.
  14. Another great feature of the cognitive services API is the ability to evaluate the emotions of individuals in the following demo I going to live demonstrate how the cognitive services API can recognise a variety of emotions. For the demo see the ZIP folder containing the demo apps (Please simply add your Cognitive API key to the LiveEmotion.exe.config
  15. Another great API is the OCR service this simply allows you to process a image and detect any text on the image.
  16. Here a great example of how the OCR API identifies text within a image and output the results in a simple JSON format as you can see from the JSON the Text is clearly identified within bounding boxes which provide the location of each of the elements within the image.
  17. The next API is the Face API this allows you to undertake, face detection, verification, grouping and identification.
  18. Detect human faces and compare similar ones, organize people into groups according to visual similarity, and identify previously tagged people in images.
  19. Easily find similar-looking faces. Given a collection of faces and a new face as a query, this API will return a collection of similar faces. The API can check the likelihood that two faces belong to the same person. The API will return a confidence score about how likely it is that the two faces belong to one person.
  20. Organize many unidentified faces together into groups, based on their visual similarity.
  21. In this demo we going to be using a RESTful API to Microsoft Cognitive Servcies. Tips. take a picture of the audience or have a picture which you can upload to the web service you can visit http://howhappy.azurewebsites.net/ or download the solution https://blogs.msdn.microsoft.com/martinkearn/2016/03/22/introducing-howhappy-co-uk and publish this your own Azure Web Site. Walkthrough https://blogs.msdn.microsoft.com/martinkearn/2016/03/22/introducing-howhappy-co-uk/
  22. Another opportunity is the Microsoft Bot Framework, the Bot Framework allows you to Build and connect intelligent bots to interact with your users naturally wherever they are, from text/sms to Skype, Slack, Office 365 mail and other popular services
  23. A great demo for using a Skype Bot is Project Murphy see http://www.projectmurphy.net/ For instructions see https://blogs.msdn.microsoft.com/uk_faculty_connection/2016/06/03/project-murphy-microsoft-bot-framework-ai/
  24. Here a set of all the resources you need to get started building amazing projects and hacks using the Microsoft Cognitive services and Cortana Intelligence Suite.
  25. Questions