Diese Präsentation wurde erfolgreich gemeldet.
Wir verwenden Ihre LinkedIn Profilangaben und Informationen zu Ihren Aktivitäten, um Anzeigen zu personalisieren und Ihnen relevantere Inhalte anzuzeigen. Sie können Ihre Anzeigeneinstellungen jederzeit ändern.

VR/AR needs to be multi-modal and multi-format

316 Aufrufe

Veröffentlicht am

Multi-Format VR and AR
Video at https://www.youtube.com/watch?v=4tRmDDM8lTs
You can download the free book on Spatial Augmented Reality at http://raskar.info/book/

Veröffentlicht in: Technologie

VR/AR needs to be multi-modal and multi-format

  1. 1. Spatial Augmented Reality | Raskar | MIT Media Lab Ramesh Raskar MIT Media Lab Cambridge, MA Spatial Augmented Reality: Overlay Inserting in the Real World
  2. 2. Spatial Augmented Reality | Raskar | MIT Media Lab Multi-ModeMulti-Format
  3. 3. Spatial Augmented Reality | Raskar | MIT Media Lab Multi-ModeMulti-Format
  4. 4. Spatial Augmented Reality | Raskar | MIT Media Lab Augmented Reality (AR) Augmented Human: Beyond X-ray vision © Andrei State
  5. 5. Spatial Augmented Reality | Raskar | MIT Media Lab Augmented Reality (AR) World Input Process Output World Sense beyond human ability Abstract Present within human comprehensibility
  6. 6. Spatial Augmented Reality | Raskar | MIT Media Lab Augmented Reality (AR) World Input Process Output World Camera, Location Sensors Identify, Track, Abstract Display, Overlay Interaction
  7. 7. Spatial Augmented Reality | Raskar | MIT Media Lab Augmented Reality (AR) World Input Process Output World Camera, Location Sensors Identify, Track, Abstract Display, Overlay Interaction Henry FuchsCyborg, Bionic Eye, HMD
  8. 8. Spatial Augmented Reality | Raskar | MIT Media Lab Bits Photons CV/Machine Learning Optics Sensors Computational Imaging Computational Photography AR – Imaging Centric View Signal Processing Light Transport Displays
  9. 9. Spatial Augmented Reality | Raskar | MIT Media Lab MR Laboratory’s COASTAR HMD (Co-Optical Axis See-Through Augmented Reality) Parallax-free video see-through HMD Camera + Viewmaster LCD Display
  10. 10. Spatial Augmented Reality | Raskar | MIT Media Lab MicroOptical display Courtesy: Sam Ogden Nomad display Courtesy: Microvision Courtesy: Azuma 1995 Near Eye Displays
  11. 11. Spatial Augmented Reality | Raskar | MIT Media Lab Real world, Tracking free, Gear free, Multi person, All 3D Cues
  12. 12. Spatial Augmented Reality | Raskar | MIT Media Lab Head-mounted Display Projectors © Andrei State Multi-Mode Augmented Reality
  13. 13. Spatial Augmented Reality | Raskar | MIT Media Lab hand-held display spatial see-through display head- mounted display retinal display Head-attached Body-attached spatial projector Spatial Augmented Reality 1998 Multi-Mode AR Real Object
  14. 14. Spatial Augmented Reality | Raskar | MIT Media Lab Virtual Reflectance Virtual Illumination InteractionVirtual Motion ShaderLamps 1997 - 2000
  15. 15. Spatial Augmented Reality | Raskar | MIT Media Lab Virtual Reflectance Virtual Illumination Lamps for Colorfully Shading the World 1997 - 2000
  16. 16. Spatial Augmented Reality | Raskar | MIT Media Lab Shader Lamps on a Saturn
  17. 17. Spatial Augmented Reality | Raskar | MIT Media Lab Guerilla Marketing FHM Magazine
  18. 18. Spatial Augmented Reality | Raskar | MIT Media Lab VienViewer (Luminetx) Near-IR camera locates subcutaneous veins and project their location onto surface of the skin. Coaxial IR camera + Projector
  19. 19. Spatial Augmented Reality | Raskar | MIT Media Lab Hong Hua, U of Arizona Projective HMD Jannick Rolland (U. Central Florida) Frank Biocca (Michigan St. U.)
  20. 20. Spatial Augmented Reality | Raskar | MIT Media Lab Augmented Reality (AR) World Input Process Output World Camera, Location Sensors Identify, Track, Abstract Display, Overlay Interaction Self-ID (barcodes)
  21. 21. Spatial Augmented Reality | Raskar | MIT Media Lab AR Issues • Preprocessing: – Authoring • Runtime: – Identification: Recognition of objects • Using markers and visual tags – Registration: Finding relative pose of display device • Dynamic estimate of translation and rotation • Render/Warp images – Interaction: • Widgets, Gesture recognition, Visual feedback
  22. 22. Spatial Augmented Reality | Raskar | MIT Media Lab Siggraph 2004 Where are products about to expire ?
  23. 23. Spatial Augmented Reality | Raskar | MIT Media Lab ARToolKit [Kato and Billinghurst 1999] ARTag [Fiala 2005] Self-ID via Barcodes for Camera Phones
  24. 24. Spatial Augmented Reality | Raskar | MIT Media Lab Bokode
  25. 25. Spatial Augmented Reality | Raskar | MIT Media Lab Defocus blur of Bokode
  26. 26. Spatial Augmented Reality | Raskar | MIT Media Lab Pieces of the Puzzle Actuated Surfaces Actuated Workbench [Pangaro, Maynes-Aminzade, Ishii UIST 2002]
  27. 27. Spatial Augmented Reality | Raskar | MIT Media Lab Bits Photons CV/Machine Learning Optics Sensors Computational Imaging Computational Photography AR Centric View Signal Processing Light Transport Displays
  28. 28. Spatial Augmented Reality | Raskar | MIT Media Lab Augmented Reality (AR) World Input Process Output World Camera, Location Sensors Identify, Track, Abstract Display, Overlay Interaction Self-ID
  29. 29. Spatial Augmented Reality | Raskar | MIT Media Lab Materials: Displays Contenders Organic LED Light Emitting Polymers E-Ink
  30. 30. Spatial Augmented Reality | Raskar | MIT Media Lab Dream Material: Sticky Pixels Project Once, pixels persist, day/night Phosphorescent Photochromic + Saakes, Chiu, Hutchinson, Naoya, Inami, Raskar 2010, slowdisplay.org
  31. 31. Spatial Augmented Reality | Raskar | MIT Media Lab Oliver Bimber Projecting on Holograms Hologram Projected + Hologram
  32. 32. Spatial Augmented Reality | Raskar | MIT Media Lab Spatial Augmented Reality World Input Process Output World Camera, Location Sensors Identify, Track, Abstract Display, Overlay Interaction Shape & Appearance Morphing Self-Id
  33. 33. Spatial Augmented Reality | Raskar | MIT Media Lab John Fan Don’t overwhelm Pattie Maes: Monocle Hiroshi Ishii Tangible Bits Mark Billinghurst Fundamentals! Steve Feiner 50 Years since Sutherland
  34. 34. Spatial Augmented Reality | Raskar | MIT Media Lab Poor Man’s Palace
  35. 35. Spatial Augmented Reality | Raskar | MIT Media Lab Poor Man’s Palace Augment the world, projectors and proxy geometry, controlling light every millimeter at every millisecond.
  36. 36. Spatial Augmented Reality | Raskar | MIT Media Lab hand-held display spatial see-through display head- mounted display retinal display Head-attached Body-attached spatial projector Spatial Augmented Reality 1998 Multi-Mode AR Real Object
  37. 37. Spatial Augmented Reality | Raskar | MIT Media Lab Acknowledgements • Camera Culture Group, MIT Media Lab • MERL • Amit Agrawal, Ashok Veeraraghavan, Ankit Mohan, Jack Tumblin, Jeroen van Baar, Paul Beardsley, Remo Ziegler, Thomas Willwacher, Srinivas Rao, Cliff Forlines, Paul Dietz, Joe Marks, Darren Leigh • Office of the Future group at UNC Chapel Hill • Greg Welch, Kok-lim Low, Deepak B’padhyay, Aditi Majumder, Michael Brown, Ruigang Yang • Henry Fuchs, Herman Towles • Wei-chao Chen • Organizers • + John Werner
  38. 38. Spatial Augmented Reality | Raskar | MIT Media Lab Spatial Augmented Reality • Special Effects in Real World – Poor Man’s Palace – Beyond Flat Displays – Upgrade the world • Tools – Untethered solution for fusion – Geometry, Photometry, Id – Sense, Control, Compensate – Projectors, RFID, Sensors • Open Problems – All senses: haptic, olfactory, proprioception – Natural phenomenon, complex BRDF, other displays – Signal Processing: Efficient overlays exploiting rank – Materials: display, sticky pixels • Next Challenge: Photorealistic AR around us

×