A keynote at a startup event in Berlin about Machine Learning and how we can help bridge the gap for end users with our products.

1. We need you to bridge the future gap…
Chris Heilmann @codepo8, Lange Nacht der Startups, Berlin September 2016

2. Chris Heilmann
@codepo8
christianheilmann.com

4. The Future,
1991
Star Trek TNG S04E19 - The nth degree - http://gb.imdb.com/title/tt0708813/

5. Lifts…

6. Tablet computers…

7. Synchronisation with central servers / cloud
(it was in space, so no clouds, duh)

8. Glasses enabling blind people
to “see” their environment?

9. Voice and intent recognition?

10. Localising people?

11. Most of these are common now!

12. We live in a time of amazing
technology and people don’t
even realise it any longer.🏁

13. This wasn’t always the case…
🔩

14. Lift attendants…
https://www.flickr.com/photos/breynolds/353144443/

15. Whilst we use technology,
people are also afraid of it
and its implications on our
world, especially our jobs…
😨

16. So it is up to us to be good
lift attendants and bring the
benefits of technology to
people…
📡

17. And it is incredibly important
that we do so in a
transparent, trustworthy and
simple to access manner…
😃

18. In other words…
🤔

19. Not as apps that lock people
in or expect them to have a
certain hardware.🔒

20. The closed app honeymoon
is over…
📉http://www.recode.net/2016/6/8/11883518/app-boom-over-snapchat-uber
http://qz.com/253618/most-smartphone-users-download-zero-apps-per-month/

21. Stop throwing logs
in the way of your
users…

22. All technology in the non-
dystopian future is
ubiquitous…🔓

23. For longterm sustainability
and interest, your solutions
should be services and tie in
with what people already
use.
🖇

24. A huge service of that is and
will still be the web.
🌎

25. https://www.youtube.com/playlist?list=PLNYkxOF6rcIAWWNR_Q6eLPhsyx6VvYjVb
📚 Homework: Progressive Web Apps

26. Another big market is chat
systems.
💬

27. In any case, users have high
demands to apps these
days.💎

28. Demands on intelligent apps…
🍒
Personalized, friendly, approachable, natural
✅ Facial recognition, emotion detection
✅ Text and speech interactions
✅ 360 awareness of the user

29. Demands on intelligent apps…
⏱
Predictive, current, and familiar
✅ Changes in real-time based on user action and
new external data
✅ Predictive models based on user context to
anticipate actions

30. Demands on intelligent apps…
🔋
Always available, always contextual
✅ Robust information management required
✅ Experiences delivered across all form factors and a
wide variety of interaction models (e.g. touch,
speech, text)
✅ Distributed support, massive scale, elasticity

31. Yes, that is a lot to cover…
😳

32. The great news is that you
can use services to help you
with that.😅

33. Every big player in
computing has machine
learning services for you to
tap into…
🕹

34. http://www.ibm.com/watson/
IBM Watson

35. https://cloud.google.com/products/machine-learning/
Google’s Cloud ML Services/TensorFlow

36. https://cloud.google.com/products/machine-learning/
Amazon Machine learning / Alexa Skills

37. https://developers.facebook.com/docs/messenger-platform
Facebook Messenger/Bot Services

38. 🤕
I can’t talk about all of them,
mainly because I haven’t
used all…

39. Here’s what I worked with
and I can chat about…
🤓

40. Roll your own with REST APIs
Simple to add: just a few lines
of code required
Make the same API code call on iOS,
Android, and Windows
Integrate into the language
and platform of your choice
Built by experts in their field from Microsoft
Research, Bing, and Azure Machine Learning
Quality documentation, sample code, and
community support
Easy Flexible Tested
GET A
KEY
BUILD
Microsoft Cognitive Services

41. Vision
From faces to feelings, allow your
apps to understand images and video
👁

42. Vision
✅ Analyse an image
✅ OCR Scan Images
✅ Create context-aware cropping and
thumbnails
✅ Detect emotions
👁

46. Face detection
✅ Find faces and their angles
✅ Identify and verify people
✅ Cluster recognised people
9

47. Face detection
Detection Result:
JSON:
[
{
"faceRectangle": {
"width": 109,
"height": 109,
"left": 62,
"top": 62
},
"attributes": {
"age": 31,
"gender": "male",
"headPose": {
"roll": "2.9",
"yaw": "-1.3",
"pitch": "0.0"
}
"faceLandmarks": {
"pupilLeft": {
"x": "93.6",
"y": "88.2"
},
"pupilRight": {
"x": "138.4",
"y": "91.7"
},
...
INPUT
IMAGE
FACIAL
RECTANGLE + LANDMARKS
DETECTION ATTRIBUTES

48. Face verification
Verification Result:
JSON:
[
{
"isIdentical":false,
"confidence":0.01
}
]
Given two faces, determine whether
they are the same person

49. Face verification
CLUSTERED BY
DETECTED PEOPLE

50. Speech
Hear and speak to your users by filtering
noise, identifying speakers, and
understanding intent🎤

51. Speech
✅ Voice Recognition (Speech to Text)
✅ Voice Output (Text to Speech)
✅ Presenter detection (who spoke when)
✅ Same Technology that powers Cortana
✅ So far, seven languages (en-US, en-GB, de-
DE, es-ES, fr-Fr, it-IT, zh-CN)
🎤

54. Language
Process text and learn how to recognize
what users want
🗯

55. Language Understanding
Intelligent Service (LUIS)
✅ Determine intent
✅ Detect Entities
✅ Improve Models
✅ Learns over time from your data
✅ Integrates seamlessly with Speech
Recognition
🗯

56. Knowledge
Tap into rich knowledge amassed from
the web, academia, or your own data
🤔

57. Search
Access billions of web pages, images,
videos, and news with the power of Bing
APIs🔎

58. Emotion Speaker Recognition
Speech
Custom RecognitionComputer Vision
Face
Video
microsoft.com/cognitive
SearchSpeech Language KnowledgeVision
Linguistic Analysis
Language
Understanding
Bing Spell Check
Entity Linking
Knowledge
Exploration
Academic
Knowledge
Bing
Image Search
Bing
Video Search
Bing
Web Search
WebLM
Text Analytics Recommendations
Bing
Autosuggest
Bing
News Search
Translator
Microsoft Cognitive Services

59. Bot Framework Preview
Your bots – wherever your users converse
Bot Connector Service
Connect your bot(s) seamlessly to text/
sms, Office 365 mail, Skype,
Slack, Twitter and more
A service to register your bot,
configure channels and publish
to the Bot Directory
Bot Builder SDK
Everything you need to build great
dialogs within your Node.js or C#
bot
An open source SDK hosted
on GitHub
Bot Directory
Discover, try, and add bots to
conversation experiences
A public directory of bots
registered and approved with Bot
Framework
www.botframework.com

60. Lots of demo apps…
Captionbot.ai CelebsLike.Me Projectmurphy.net
How-Old.net TwinsOrNot.net

61. 😕
Let’s talk (very quickly) about
a dirty topic…

63. 💸How can you afford all this?

64. Microsoft Bizspark Plus www.bizspark.com

65. Supporting Startups Through Their Life Cycle
Discovery
Startups need How we engage
An abundant of
resources and tools
Access to partners, VCs,
Introduction to local
customers
Microsoft Accelerator program:
Space, equipment, platforms
and
tools estimated at $1M
Mentors, experts,
via accelerators
AccesstotopVCs,customers
&partners,introductionto
industryleaders,MarketingandPR
Alumni program
Success managers
Ongoing
support
A platform to
experiment with
Meetups, workshops
BizSpark
Office hours
Sounding board,
no strings
attached
Thriving ecosystem
Constant challenging
and guidance
A powerful Launchpad
to set up trajectory
Go to market and
BizDev support
Extensive tech
enablement
BizSpark+
Azure Offer $120K+
Validation Growth
Startups need How we engage Startups need How we engage

66. Microsoft Bizspark
WHAT YOU GET IS – 3 YEARS OF
Free cloud services with Microsoft Azure up to $8.5k
Free software (Windows, Office, Visual Studio, SQL,…)
DO YOU QUALIFY?
Developing software?
Privately held?
Less than five years old?
Making less than $1m annually?
FACTS
75k+ actual members
Easy online registration
www.bizspark.com

67. Accelerator Program
We serve as a strategic
partner for startups and
provide unparalleled routes to
market by connecting
startups with our global
network of customers,
partners, business mentors
and technical experts.
We have 7 accelerators
around the world
Bangalore
Platforms & tools for
3 years
Access to Customers &
Partners
Office space Hands on mentoring No Equity!
Beijing
Berlin
Paris
London
Tel Aviv
Seattle
www.microsoftaccelerator.com

68. 🦄Back to my world…

69. Technology should
help the human and
make a better world
for everyone!

70. Make your solutions
more human, and
this goal is easier to
achieve…

72. @But, wait a second, Chris…

73. Glasses enabling blind people
to “see” their environment?

74. http://captionbot.ai

75. http://captionbot.ai

76. http://captionbot.ai

77. https://www.youtube.com/watch?v=R2mC-NUAmMk

78. CHRIS HEILMANN
@CODEPO8
CHRISTIANHEILMANN.COM
THANKS!