Augmented Reality with the Intel® RealSense™ SDK and R200 Camera
•
6 gefällt mir•3,715 views
Augmented Reality with the Intel® RealSense™ SDK and R200 Camera
Empfohlen
Empfohlen
Weitere ähnliche Inhalte
Was ist angesagt?
Was ist angesagt? (20)
Ähnlich wie Augmented Reality with the Intel® RealSense™ SDK and R200 Camera
Ähnlich wie Augmented Reality with the Intel® RealSense™ SDK and R200 Camera (20)
Mehr von Intel® Software
Mehr von Intel® Software (20)
Kürzlich hochgeladen
Kürzlich hochgeladen (20)
Augmented Reality with the Intel® RealSense™ SDK and R200 Camera
- 1. Intel® RealSense™ Technology | Intel® Software Kevin Arthur, Senior User Experience Researcher Meghana Rao, Developer Evangelist Augmented Reality with the Intel® RealSense™ SDK and R200 Camera User Experience and Development Best Practices
- 2. Intel® RealSense™ Technology | Intel® Software 2 Outline Part 1, Kevin • Overview of R200 camera and tablet augmented reality use cases • User experience guidelines highlights Part 2, Meghana • SDK overview • Sample code and demos
- 3. Intel® RealSense™ Technology | Intel® Software 3 New R200 Depth Camera For Tablets, Peripheral Dev Kit Available Now
- 4. Intel® RealSense™ Technology | Intel® Software 4 R200 View Volume and SDK Features R200 with Intel® RealSense™ SDK • Scene Perception Module, enables scene-aware AR • Camera tracking and localization • Mesh reconstruction • Other Modules • 3D capture • Depth-enhanced photo and video • Measurement • Face detection and tracking • Speech (Windows SDK only)
- 5. Intel® RealSense™ Technology | Intel® Software 5 Use Cases for R200 Mixed and Augmented Reality Gaming and Play Education and Training Visualization
- 6. Intel® RealSense™ Technology | Intel® Software 6 Video
- 7. Intel® RealSense™ Technology | Intel® Software 7 Video – ToyZ Game Shows real-time scene perception for collision and occlusion (no pre- scan) Try it at the Intel booth By Shachar Oz, Omek Studio at Intel
- 8. Intel® RealSense™ Technology | Intel® Software 8 Video – Procedural Island Shows scan as part of “capture and play” Illustrates procedural shaders and set dressing By Eddy Ortega, Garrett Stevens, Perceptual Computing at Intel
- 9. Intel® RealSense™ Technology | Intel® Software UX Guidelines for R200 Tablet AR Designing real, usable apps for a mass market
- 10. Intel® RealSense™ Technology | Intel® Software 10 Lesson 1: Give People a Reason to Move, or They Won’t Tablet as window into a virtual space vs. tablet as fixed screen Address with motion hints
- 11. Intel® RealSense™ Technology | Intel® Software 11 Motion Hints – Explicit Registered with scene Or registered with window
- 12. Intel® RealSense™ Technology | Intel® Software 12 Motion Hints – Implicit, Part of Experience Lead the user with content Example: “Windy Day” (Google Spotlight Stories)
- 13. Intel® RealSense™ Technology | Intel® Software 13 Lesson 2: But Let People Relax Too Support both Active Camera Mode • Tiring Inactive Camera Mode • Less tiring
- 14. Intel® RealSense™ Technology | Intel® Software 14 Active-Camera and Inactive-Camera Modes Active Camera Mode • Touch interaction less comfortable, less precise Inactive Camera Mode • Touch interaction more comfortable, more precise Make the main controls easy to reach with the thumbs during Active Camera modes . During Inactive Camera modes, placing controls elsewhere is acceptable. AVOID OKOKOK Make the main controls easy to reach with the thumbs during Active Camera modes . During Inactive Camera modes, placing controls elsewhere is acceptable. AVOID OKOKOK Touch Zones Touch Zones
- 15. Intel® RealSense™ Technology | Intel® Software 15 Two Styles of Mixed-Reality Games Augmented Reality Capture and Play Active Camera Inactive Camera
- 16. Intel® RealSense™ Technology | Intel® Software 16 Lesson 3: Plan for the Scene • Consider size of play space, and use appropriate voxel resolution
- 17. Intel® RealSense™ Technology | Intel® Software 17 Game Design Considerations • What objects does the user need? • Level design has more unknowns • Enhance and transform everyday objects in interesting ways
- 18. Intel® RealSense™ Technology | Intel® Software 18 Procedural Set Dressing
- 19. Intel® RealSense™ Technology | Intel® Software 19 Plan for the Scene • Understand the camera limitations. Depth data is less accurate on • Very bright areas • Clear glass • Black surfaces • Give relevant feedback • Fail gracefully, don’t prevent play
- 20. Intel® RealSense™ Technology | Intel® Software 20 More UX Guidelines software.intel.com/articles/realsense-ux-design-guidelines
- 21. Intel® RealSense™ Technology | Intel® Software Developing Augmented Reality applications with R200
- 22. Intel® RealSense™ Technology | Intel® Software 22 What is Scene Perception? • Provides Augmented Reality experiences through • Adding virtual content in real time to live camera feed • Handling occlusions of virtual objects with physical objects • Providing motion estimation and metric measurement • Intel® RealSense™ SDK library for Scene Perception • libPXCScenePerception
- 23. Intel® RealSense™ Technology | Intel® Software 23 Scene Perception in Action
- 24. Intel® RealSense™ Technology | Intel® Software 24 Augmented Reality in Action
- 25. Intel® RealSense™ Technology | Intel® Software 25 Metric Measurements in Action
- 26. Intel® RealSense™ Technology | Intel® Software 26 Requirements for Scene Perception • The scene being captured has to be static • Works within the bounds of a close object / cubicle space/ living room • You can track camera movement in 3D space along six degrees of freedom -courtesy: http://en.wikipedia.org/wiki/Six_degrees_of_freedom
- 27. Intel® RealSense™ Technology | Intel® Software Modalities you will learn about ( R200 ) • Using Scene Perception for Augmented Reality • Configuring Scene Perception • Setting Initial Camera Pose • Setting Meshing Threshold • Setting Voxel Resolution • Starting Scene Quality • Checking Scene Quality • Enabling Scene Reconstruction • Tracking Data • Camera Pose • Volume Preview • Mesh Data
- 28. Intel® RealSense™ Technology | Intel® Software 28 Guidelines for using Scene Perception • Works best in the depth camera working range • The observed environment is assumed to be containing some visual texture and/or having some 3D structure: • Tracking may be inaccurate when tracking reflective or monotonous surfaces, flat walls, dark black areas or scene with limited geometric structure • Using appropriate VoxelResolution::XYZ_RESOLUTION settings: • VoxelResolution::HIGH_RESOLUTION for object size use cases • VoxelResolution::LOW_RESOLUTION for room sized environments
- 29. Intel® RealSense™ Technology | Intel® Software Intel® RealSense™ Front-Facing 3D Camera (F200) and Augmented Reality Usages
- 30. Intel® RealSense™ Technology | Intel® Software 30 Augmented Reality apps can make use of: • Contour Mode • Hand Data • Joint Data • Finger Data • Extremity points • Hand Openness • Usages • Nail Salon • Virtual Shopping – Jewelry • Games AR Usages Using Hand Module
- 31. Intel® RealSense™ Technology | Intel® Software 31 Augmented Reality apps can make use of: • Landmark • Pose detection • Eye Movement • Expression Detection Usages: • Face Makeup • Virtual Shopping for glasses • Games/Entertainment • Plastic Surgery AR Usages using Face Module
- 32. Intel® RealSense™ Technology | Intel® Software 32 Resources software.intel.com/realsense software.intel.com/articles/realsense-ux-design-guidelines kevin.arthur@intel.com, @karthur meghana.s.rao@intel.com, @RaoIntel
- 33. Intel® RealSense™ Technology | Intel® Software