Augmented Reality is a thing, Mixed Reality is another world. Add some Artificial Intelligence inside, you'll get a futuristic solution right now. Just like what Robert Zemeckis and Bob Gale described in Back to the future.We'll build an app for Hololens that leverage AI from the cloud to help the user to identify what's around him.You'll see what Hololens and AR can do, how to create a Mixed Reality app and how an app can quickly get some killer features using Azure Cognitive Services.

1. Mixed Reality &
Artificial Intelligence with
Hololens at
Devoxx 2019

2. THE TEAM
Sébastien Bovo
AppConsult Engineer
@sbovo
THE GOOD
Christopher Maneu
Cloud Developer Advocate
@cmaneu
THE BAD
Alex Danvy
Technical Evangelist
@danvy
THE UGLY

3. AGENDA
Mixed Reality
Artificial Intelligence
Démos plus que des mots

6. THIRD WAVE OF COMPUTING
Mixed Reality
Computing power at the
edge that blends of the
physical and digital worlds
Smartphones
Computingpowerforall withon-the-go
access and some contextualawareness
Personal Computers
Computingpowerformany but
immobileand no contextualawareness
Personal Computers
Computingpowerformany but
immobileand no contextualawareness
Smartphones
Computingpowerforall withon-the-go
access and some contextualawareness

7. Back to the future 2 (1989)

8. AUGMENTED REALITY
DIGITAL WORLDPHYSICAL WORLD
VIRTUAL REALITY
MIXED REALITY SPECTRUM
MIXED REALITY
A blending of the physical and digital worlds in which users may interact
with digital and real-world objects while maintaining presence in the physical world

9. Ready Player One (2018)

10. Star Wars: Episode III – Revenge of the Sith (2005)

11. MIXED REALITY SAMPLE USE CASES
Remote
assistance
Empower employees to
work together, even
when they’re worlds
apart.
Training & task
guidance
Enhance learning with
step-by-step instructions
that help employees
learn new skills faster.
Collaborative
visualization
Visualize room layouts
and product designs
before building out
physical models.
Contextual
data access
Gain real-time insight
from the working
environment to improve
operational efficiency.

12. « Je suis convaincu que la réalité augmentée va permettre d'enrichir le discours, la qualité d'expérience, d
renforcer l'émotion et de permettre une meilleure compréhension »
Cédric Villani, Mathématicien et Président du Fonds de dotation de l'IHP

13. « Face à ce plan d’une finesse et d’une minutie incroyable, HoloLens apporte aux matériaux un supplément d’âme qui
nous entraîne et nous fait nous interroger : pourquoi et comment s’installer dans un lieu si inhospitalier ? Pourquoi
avoir lutté pour conquérir cet îlot ?
La réalité mixte nous ouvre de nouvelles voies de nature à susciter la curiosité du spectateur »
Emmanuel Starcky, Directeur du Musée des Plans-Reliefs

15. UNIVERSAL FIT

16. PIVOTING VISOR

17. LARGER FIELD OF VIEW

18. AZURE KINECT

19. SPATIAL MAPPING

20. FULLY ARTICULATED HAND TRACKING

21. WINDOWS HELLO AND EYE-TRACKING

22. HOLOGRAPHIC PROCESSING UNIT 2.0

23. The Terminator (1984)

25. MICROSOFT VISION

26. MICROSOFT VISION

27. 2001 Space Odyssey (1968)

28. 5.1%
Switchboard speech
recognition test
96%
RESNET vision test
152 layers
88.493%
SQuAD reading
comprehension test
69.9%
MT
research system
MICROSOFT AI ADVANCEMENTS

29. Vision Speech KnowledgeLanguage LabsSearch
AZURE COGNITIVE SERVICES

30. Capability overview
Azure Cognitive Services
SearchVision Speech
Intent: PlayCall
Language

31. Demos

32. Azure AI Services
Azure Infrastructure
Tools
MICROSOFT AI PLATFORM

33. THE MICROSOFT MIXED REALITY STACK
Devices
Azure Spatial Anchors Azure Remote RenderingAzure Digital Twins
Mixed Reality
Services
Applications
Vision Speech Language Knowledge Search Labs
Cognitive
Services

34. MICROSOFT AZURE MIXED REALITY SERVICES
Share and collaborate with cross-
platform mixed reality
AZURE SPATIAL ANCHORS AZURE REMOTE RENDERING
Experience 3D without compromise to
fuel decisions and design efficiency
AZURE DIGITAL TWINS
Model the physical world and relationship
between people, places and devices

35. #OPEN INVITATION
Build with tools you choose and leverage open standards

36. Slides – Code - Experiment & develop
http://bit.ly/devoxxmrai
Sébastien Bovo
@sbovo
Christopher Maneu
@cmaneu
Alex Danvy
@danvy
YOUR TURN!

37. © Copyright Microsoft Corporation. All rights reserved.