Microsoft Speech Technologies for Developers
•
2 gefällt mir•504 views
This is a compilation deck for a presentation I did at BetaWorks in NYC, covering Microsoft Speech Technologies for Developers. This includes Speech APIs in Microsoft Cognitive Services, the Microsoft Speech SDK in UWP and .NET, Cortana Skills and Voice Commands in Windows Mixed Reality & HoloLens.
Empfohlen
Empfohlen
Weitere ähnliche Inhalte
Was ist angesagt?
Was ist angesagt? (20)
Ähnlich wie Microsoft Speech Technologies for Developers
Ähnlich wie Microsoft Speech Technologies for Developers (20)
Mehr von Nick Landry
Mehr von Nick Landry (20)
Kürzlich hochgeladen
Kürzlich hochgeladen (20)
Microsoft Speech Technologies for Developers
- 1. Nick Landry Senior Technical Evangelist – Microsoft nick.landry@microsoft.com Blog: AgeofMobility.com @ActiveNick | github.com/ActiveNick Microsoft Speech Technologies for Developers
- 5. Microsoft Cognitive Services Give your apps a human side
- 6. Microsoft Cognitive Services Give your apps a human side Cognitive Services API Collection
- 7. Bringing it all together The Seeing AI App Computer Vision, Image, Speech Recognition, NLP, and ML from Microsoft Cognitive Services Watch Video HereRead Blog Here
- 8. Emotion Speaker Recognition Speech Custom Recognition Computer Vision Face Video microsoft.com/cognitive Linguistic Analysis Language Understanding Bing Spell Check Entity Linking Knowledge Exploration Academic Knowledge Bing Image Search Bing Video Search Bing Web Search WebLM Text Analytics Recommendations Bing Autosuggest Bing News Search Translator
- 9. Emotion Speaker Recognition Speech Custom Recognition Computer Vision Face Video microsoft.com/cognitive Linguistic Analysis Language Understanding Bing Spell Check Entity Linking Knowledge Exploration Academic Knowledge Bing Image Search Bing Video Search Bing Web Search WebLM Text Analytics Recommendations Bing Autosuggest Bing News Search Translator
- 11. Speech Bing Spell Check API Detect and correct spelling mistakes within your app Language Understanding Intelligent Service Teach your apps to understand commands from your users Web Language Model API Leverage the power of language models trained on web-scale data Linguistic Analysis API Easily parse complex text with language analysis Text Analytics API Detect sentiment, key phrases, topics, and language from your text Language
- 12. Reduce labeling effort with interactive featuring Seamless integration to Speech API Deploy using just a few examples with active learning Supports 5 languages (English, Chinese, Italian, French, Spanish) Language Understanding Models
- 13. { “entities”: [ { “entity”: “flight_delays”, “type”: “Topic” } ], “intents”: [ { “intent”: “FindNews”, “score”: 0.99853384 }, { “intent”: “None”, “score”: 0.07289317 }, { “intent”: “ReadNews”, “score”: 0.0167122427 }, { “intent”: “ShareNews”, “score”: 1.0919299E-06 } ] } “News about flight delays” Language Understanding Models
- 14. Your conversation logic Logic Web Service Your Bot LUIS
- 24. Cortana Cortana is available on 400M+ Windows 10 desktops, laptops, tablets, phones, Xbox, etc. – as well as iOS, Android and Cyanogen phones.
- 25. • Differentiate your app with voice commands • Delight your users with natural interactions • Increase user engagement • Increase productivity • Increase discovery Opportunity
- 26. Phone Small Tablet 2-in-1s (Tablet or Laptop) Desktops & All-in-OnesPhablet Large Tablet Classic Laptop Xbox IoTSurface Hub Holographic Windows 10
- 27. One Store + One Dev Center Reuse Existing CodeOne SDK + Tooling Adaptive User Interface Natural User Inputs One Universal Windows Platform
- 29. • Universal Windows App Development with Cortana and the Speech SDK • Available for on-demand viewing now: http://aka.ms/CortanaMVA
- 30. • Channel 9 Show • Visual Studio Toolbox with Robert Green • New Voice Commands • Integration with Cortana’s canvas • Background Voice Commands • Continuous dictation • Poutine in Montreal! https://channel9.msdn.com/Shows/Visual-Studio-Toolbox/App-Development-with-Cortana More Cortana Dev on Windows 10
- 39. What is HoloLens? Holograms enhance the real world Microsoft HoloLens is the first, fully untethered holographic computer that redefines personal computing and empowers you in new ways. New ways to connect, create, and explore A more natural way to interact Advanced technology from Microsoft
- 45. Voice commandsGaze Gesture Spatial sound World coordinatesSpatial mapping
- 48. Building 2D or 3D apps for HoloLens
- 49. Try your app on the HoloLens emulator today You need: Visual Studio 2015 or 2017 64-bit Windows 10 Pro, Enterprise, or Education with a 64-bit CPU (4+ cores) 8GB RAM GPU (DirectX 11, WDDM 1.2 driver) Windows 10 SDK (10.0.10586 or newer) HoloLens Emulator (requires, Hardware- assisted virtualization, SLAT & DEP) A UWP app that builds for x86 Unity not needed for 2D UWP apps dev.microsoft.com/windows/mixed-reality
- 50. Work with our teams or our agencies Join the community Online tools & resources dev.windows.com/mixedreality Download the tools aka.ms/hololensdevtools Follow the training aka.ms/holographicacademy Forums.hololens.com Questions, discussion, and feedback from the mixed reality development community. Github/microsoft aka.ms/GalaxyExplorer aka.ms/holotoolkitunity aka.ms/holotoolkit aka.ms/windowsdeviceportalwrapper aka.ms/holographicacademygithub aka.ms/MRcommunity Microsoft Technology Centers Experience HoloLens & discuss core business uses aka.ms/iwantmr Join MR@MS: A program tailored to your needs, providing guidance and support from ideation to publish. aka.ms/MRcommunity Technical Evangelists - Connect with one of our technical evangelists in your area. Meetups: join one of the hundreds of meetups around the world aka.ms/agencies Agency partners have HoloLens development expertise and dedicated teams to take on application development for clients. mpcbdesk@microsoft.com Our teams will work with you from envisioning, to proof of concepts, all the way to deployment.
- 51. Acer - Windows Mixed Reality Development Edition Microsoft HoloLens Development Edition Available today on microsoftstore.com Shipping to : Australia, Canada, France, Germany, Ireland, Japan, New Zealand, United Kingdom and United States. (pre-order available soon for China) English only HoloLens Development Edition: $3000 HoloLens Commercial Suite: $5000 For more information: www.hololens.com Sign up today on aka.ms/iwantmr Shipping to: TBA Languages: English, French, German, Chinese (simplified) and Japanese
- 52. Cognitive Services Developer Resources Pricing https://www.microsoft.com/cognitive-services/en-us/pricing Documentation https://www.microsoft.com/cognitive-services/en-us/computer-vision-api/documentation Client SDKs https://github.com/Microsoft/ProjectOxford-ClientSDK https://github.com/felixrieseberg/project-oxford (nodejs) https://github.com/southwood/project-oxford-python Example Code https://github.com/jsturtevant/happy-image-tester-django https://github.com/jsturtevant/happy-image-tester-nodejs Join Our Community https://stackoverflow.com/questions/tagged/microsoft-cognitive https://social.msdn.microsoft.com/forums/azure/en-US/home?forum=mlapi https://cognitive.uservoice.com/
- 56. Online Microsoft training delivered by experts to help technologists continually learn Hundreds of courses for developers, IT Pros, students, entrepreneurs and enthusiasts 11 different languages 3M+ students registered Build your own Learning Plan All free! http://mva.microsoft.com
- 57. Thank You! Slides are in SlideShare. Demos are on GitHub. Contact me and let me know what you build, I will be happy to help promote your apps. Blog: AgeofMobility.com Twitter: @ActiveNick Email: nick.landry@microsoft.com Apps: www.bigbaldapps.com LinkedIn: linkedin.com/in/activenick GitHub: github.com/ActiveNick Slideshare: slideshare.net/ActiveNick