12. RealSense Mission
12
Add “Senses” to the “Brain” of the PC:
Eyes, Ears, Voice, Touch, Emotion and
Context
for experiences that are….
N I Iatural ntuitive mmersive
Using Human Senses
to interact
Easy to use and
understand
Blurred barrier
between user and
machine
22. Face Detection
22
• Accurate 3D detection and
tracking
• Up to 4 faces with marked
rectangles for face
boundaries
• Developers can choose
which 4 faces to detect
• Only one face has
landmarks
• Works up to 1.2 meters
25. Speech Recognition
Feature API
Command and Control SetVoiceCommands, CreateGrammar, AddGrammar
Use command-and-control to creative intuitive voice-controlled interfaces
Short Sentence Dictation SetDictation
Text-to-Speech QueueSentence
Add speech-recognition to your application
Benefits? Allows users to interact naturally via speech
• Command and Control
• Dictation
• Text to Speech
• Supports 9 languages and 27 countries
27. Background Subtraction
Feature API
Segment Image EnableSegmentation, QuerySegmentationImage,
Define depth of field for segmentation
Image blending QuerySegmentationBlendedImage
Toggle “Image Blending” for smoother edges
For video chat, real-time green screen and more
Benefits?
•Extract people or objects from their background
•Focus on an image’s relevant information…subtract the rest!
29. Bringing New Experiences to Intel® Architecture Devices
* Other names and brands may be claimed as the property of others. Intel Confidential
Touch Voice Assistance
3D Depth Camera No Passwords
USERINTERFACE
30. Control and Navigation
30
Out-of-reach Device Input
Lean back: movie watching, control, browsing
Clean/Dirty hands, germ free
Intel Confidential - for use under NDA only
31. Immersive Collaboration and Creation
Immersive Multi-User Collaboration
Share memories with friends & family without technology
barriers
Fun and entertaining video conferencing
Broadcast yourself!
Create video blogs and share with friends in minutes
Fast and easy without a green screen
Intel Confidential - for use under NDA only
32. Entertainment and Gaming
Moogie Moko
Redefine the Experience with New Interactions
Multi-modality, hand/finger tracking, speech and head tracking bring
new interaction models to gaming
Enhance the experience with what feels natural
Intel Confidential - for use under NDA only
33. 33
Reality Books & Interaction
AnimatedAnimated
Collaborative Interactions
Table Top – Bring virtual characters to life in a real world
Collaborative Games – blurring the line between
digital and physical for fun and entertainment
Education
Books come to life, interaction with gesture, face, speech
Science is fun with physical and virtual interactions
Personalized Learning – one size does not fit all
Intel Confidential - for use under NDA only
34. Capture the World in 3D
34
Scan it. Share it.
34
Customize and Print it.
Sharing
>500M 2D images get posted on social sites every day,
but we can make it way better!
Get a more complete viewing experience with 3D!
Design & Fun
Print your favorite toy.
Bring your living room to life!
3D capture and reconstruction of objects; editing
and printing
Social MediaSocial Media
Intel Confidential - for use under NDA only
Power/Perf improved by 3.5M times in the last 30 years.
We could close the gap on Performance… Our phone has more Mips than Apollo spaceship
But what about our senses?
Eyes Years
Who Need Performance – every Body, Performance Tidak Cukup
Natural – no keyboard No Mouse, natural,
Intuitive – Not Manual/ Isntruction Book
Immersive – Border antara Real World and Virtual World Sangat Tipis
Switching gears to Intel RealSense 3D camera.
Umesh, what do you have to show here?
Funky Farm – interactive augmented reality using Creative 3D camera
Blaster Game –
Again – you will begin to see the Intel Real Sense 3D camera module integrated into AIO’s, tablets and 2in1/NB systems by the end of the year
Technology that naturally and intuitively understands your interaction with the PC
Depth perception camera and the enabled SW applications
Last year at the conference, we spoke about the new user experiences we were driving across all IA devices. We have made progress and continue to focus on driving a more natural, intuitive interface with our devices…
Could talk for an hour
Will examine several key areas: Touch, Voice, 3D Camera, and No Password
Touch – Two years ago we committed to bring touch to large screen devices and in 2011 launched an ambitious campaign to enable the ecosystem in preparation for Windows8. This was a complex initiative because it required working across supplier, ODMs, OEMs, and the ISV community to bring it to the market. This was the first focus area for how users’ interacted with their device. Just last year, we saw a 5x increase in volume for laptops featuring touch screens. We are continuing to work with the escosystem to drive down the costs.