1. Jamie Tanna and Phillip Zissimou, Application Engineers
Intel Software and Services Group, Developer Relations Division
*Other names and brands may be claimed as the property of others.
3. Introducing
Intel® RealSense™
technology
A combination of hardware and
software to enable human-
computer interaction on a PC.
Uses natural intuitive user
interfaces beyond the mouse,
keyboard and touch including:
Hand and finger tracking
Facial analysis
Background segmentation
Speech recognition
Augmented reality
3D scanning and reconstruction
(coming soon**)**Roadmap Notice: All products, computer systems, dates and figures specified are
preliminary based on current expectations, and are subject to change without notice.
3
4. 4
Intel® RealSense™ SDK for Windows*, (Version 2014,
Gold) is now available
What’s New in this SDK
• Improved quality and accuracy of core capabilities: hand/finger tracking, facial analysis, speech
recognition and synthesis, background segmentation, and augmented reality
• Added localization for multiple languages
CALL TO ACTION for Developers
• Be first in line to build a more immersive experience to your app and take full advantage of Intel®
RealSense™ technologies as systems with Intel® RealSense™ 3D cameras become widespread in the
market.
• Reserve Your Intel® RealSense™ Developer Kit now (includes peripheral camera, SDK, and other updates)
intel.com/realsense/sdk
*Other names and brands may be claimed as the property of others.
Intel® RealSense™ Technology will change the
computing experience for users, creating a more
natural and intuitive interface…
5. 5
Intel® RealSense™ Developer Kit 3D camera
Get started developing quickly
Peripheral depth camera specifications:
– Full VGA depth resolution
– 1080p RGB camera
– 0.2 – 1.2 meter range1**
– USB 3.0 interface
– Requires Intel® Core™ processor
Reserve Yours Now
1Specific algorithms may have different range and accuracy.
**Roadmap Notice: All products, computer systems, dates and figures specified are preliminary based on current expectations, and are subject to change without notice.
*Other names and brands may be claimed as the property of others. **Range and accuracy may vary based on application.
Intel® RealSense™ SDK
for Windows*, Version 2014
supports Windows 8.1 (64-bit)
Windows 7 support coming soon
Download the SDK
intel.com/realsense/sdk
What OS and hardware works with Intel®
RealSense™ technologies?
6. 6
Intel® RealSense™ SDK for Windows*
Create Applications for Intel® RealSense™ 3D
Cameras
Integrated inside
Ultrabook, 2in1 and AIO
RGB up to 1080p@30FPS
Depth up to VGA@60FPS,
HVGA
Intel® Core™ processors
support
SDK for Windows now
SDK add-on for Android*
coming soon (for different
cameras)**
**Roadmap Notice: All products, computer systems, dates and figures specified are preliminary based on current expectations, and are subject to change without notice.
* Other names and brands may be claimed as the property of others.
7. 7
Current available technology focus on
a living-room experience or a sub-set
of Intel RealSense technology
features, whereas Intel® RealSense™
technology focus on developing for
close-range interactions.1
Intel® RealSense™ 3D Camera for Windows*
Designed for close-range interactions
20 cm
120 cm
Intel®RealSense™
3D camera
Intel® RealSense™ SDK for Windows* is your solution
for developing close-range interactions
1Specific algorithms may have different range and accuracy.
*Other names and brands may be claimed as the property of others.
8. 8
The Intel® RealSense™ 3D Camera
Shipping on Multiple Form Factors
Ultrabooks™,
Notebooks
2in1’s / Convertibles All-in-1’s
Integrated in Systems shipping by end of 2014 and in 2015
from Major OEMs
9. Hands
Face
Speech
Environment
9
Intel® RealSense™ SDK for Windows*
Understands 4 basic types of input - Standalone or various permutations
**Roadmap Notice: All products, computer systems, dates and figures specified are preliminary based on current expectations, and are subject to change without notice.
*Other names and brands may be claimed as the property of others.
10. 10
Intel® RealSense™ SDK for Windows*
Categories of Input Capabilities Features
Hands • Hand and Finger
Tracking
• Gesture Recognition
• 22-point Hand and Finger Tracking
• Static Poses and Dynamic Gestures
Face • Face Detection and
Tracking
• Multiple Face Detection and tracking
• 78-point Landmark Detection (facial features)
• Face Recognition and Facial Expressions
• Emotion Detection
• Pulse Estimator (coming soon**)
Speech • Speech Recognition and
Synthesis
• Command and Control
• Dictation
• Text to Speech
Environment • Segmentation
• 3D Scanning
• Augmented Reality
• Background Segmentation
• 3D Object / Face / Room Scanning (coming soon**)
• 2D/3D Object Tracking
• Scene Perception (coming soon**)
**Roadmap Notice: All products, computer systems, dates and figures specified are preliminary based on current expectations, and are subject to change without notice.
*Other names and brands may be claimed as the property of others.
11. 11
Intel® RealSense™ Technology
Enabling Exciting, Diverse Categories of Applications
Capture and Share Immersive
Collaboration/Creation
Interact Naturally
Gaming and PlayLearning and Edutainment
12. Immersive
Collaboration/
Creation
• Using the 3D camera, software can
“segment” an environment, allowing
an application to remove the
background
• With the background removed,
developers can create apps ideal for a
combination of video chat and
collaboration
• Make apps that allow presenters to be
overlaid on top of applications, allow
two people to share an experience on
the web, or for a single person to use
this “digital green screen” to create
compelling content 12
13. Interact
Naturally
• Use our extensive library of
gestures, and facial analysis
and speech recognition
algorithms to build interfaces
that are truly natural
• Leverage our carefully
developed user-experience
guidelines document to
ensure the interfaces you
build will delight your
customers
13
14. Gaming
and Play
• Differentiate your game with
gesture, speech, augmented
reality enhanced with depth,
facial analysis, and more.
• Use the user’s pulse to
determine the stability of a
scope. Allow a user to
physically move their head to
peak around a corner. Use
gesture for a lock-picking
challenge. The possibilities
are tremendous.
14
15. Capture
and Share
• Collaborate with scanning/
printing experts, 3D Systems
• Rotate a small object in front
of the 3D camera to create a
3D mesh + color
• Developers can import scans
from a proprietary 3DS* app
or eventually build scanning
into their own application
• The model is scan, edit, share.
Upload scans to social media,
or sent to a 3D printer 15
**Roadmap Notice: All products, computer systems, dates and figures specified are preliminary based
on current expectations, and are subject to change without notice.
* Other names and brands may be claimed as the property of others.
16. Learning and
‘Edutainment’
• Use augmented reality,
powered by Metaio to track
2D or 3D objects and
incorporate them into a
learning experience.
• Tracking is significantly
improved by the 3D camera.
Enjoy both enhanced
precision and accuracy.
• Interact with stories using
both facial/emotion
recognition and gesture.
Disguise learning as play.
16
17. 17
Intel® RealSense™ SDK for Windows*
Required Hardware A system with a minimum of a 4th generation Intel® Core™ processor including
an Intel® RealSense™ 3D camera (or a peripheral camera)
Required OS Microsoft Windows* 8.1 64-bit Desktop Mode
Microsoft Windows 8.1 New UI (Metro) Mode, Windows 7 (coming soon)**
Support for Android* coming soon**
Supported Programming
Languages
C++, C#, Java, JavaScript
Supported IDE Microsoft* Visual Studio 2010-2013 with service pack 1 or newer
Supported Development
Tools
-Microsoft* .NET 4.0 Framework for C# development
-Unity* PRO 4.1.0 or later for Unity game development
-Processing* 2.1.2 or higher for Processing framework development
-Java* JDK 1.7.0_11 or higher for Java development
The Intel® RealSense™ SDK for Windows does not support Intel® RealSense™ Snapshot, support for that is coming soon.**
**Roadmap Notice: All products, computer systems, dates and figures specified are preliminary based on current expectations, and are subject to change without notice.
*Other names and brands may be claimed as the property of others.
Supported Features
18. 18
Intel® RealSense™ SDK for Windows*
Input Device Manager Multiple applications can access data from the camera
simultaneously
Multi-Mode Support Support multiple usage modes within a single app (e.g. finger
tracking + speech + face tracking) or between apps
Power Management State Apps can manage battery life
Extensible Framework Developers can plug in their own algorithms. New usage modes can
be added. New devices can be supported.
Privacy Notification Tool Notifies user when camera is turned on by an app
Additional Features
*Other names and brands may be claimed as the property of others.
19. 19
Web / HTML5
Run Intel® RealSense™ technology in a browser
Unity Web Player App
HTML5 / JavaScript
SDK Local
Web-Socket Server
Intel® RealSense™
SDK runtime
Operating System
Web Socket Communication
127.0.0.1:4181
Internet Browser
Trigger face and gesture events, just like in C# applications
Switch to the web player platform for deployment
Gestures and Facial Analysis
Unity* Web Player games
HTML5 / JavaScript (interactive web sites)
*Other names and brands may be claimed as the property of others.
20. 20
Productivity extension for Unity* games
Add Intel® RealSense™ technology
to your games
• A set of scripts that provides
configurable actions/rules
based on the capabilities
provided in the SDK.
• Programming: Associate your
game objects with the action
scripts.
• Programming: Create rules.
Associate your game objects
with rules.
Drag and drop programming
Write less code!
*Other names and brands may be claimed as the property of others.
21. 21
Developer Resource Center Program
intel.com/realsense/sdk
A one-stop shop for all developer
needs for
Intel® RealSense™ technology
Developer Tools
Tutorials, Demos, Code Samples,
Documentation
Community Forums
Hacker Labs, Virtual AE Sessions,
Webinars
App Challenges
22. 22
Get Started Now!
Reserve Your Developer Kit now (includes peripheral camera, the
latest SDK, and other software updates)
Provided by Intel
Free Intel® RealSense™ SDK for Windows, (Version 2014, Gold)
Intel® RealSense™ Developer Kit camera available for purchase
Huge opportunity to reach customers with integrated 3D camera
Works with languages/frameworks/engines developers already use
High-level APIs for NUI beginners. Low-level APIs for NUI experts
intel.com/realsense/sdk
Seize the Opportunity