SlideShare ist ein Scribd-Unternehmen logo
1 von 141
Downloaden Sie, um offline zu lesen
Augmented	
  reality	
  techniques
Sergi	
  Grau	
  Carrión	
  
http://sergigrau.cat	
  
@sergi_grau
Adapted	
  milgram's	
  VR-­‐AR	
  
continuum

http://en.wikipedia.org/wiki/File:Adapted_milgrams_VR-­‐AR_continuum.png
Virtual	
  reality	
  -­‐	
  Immersive

http://www.youtube.com/watch?v=yf0sllpZx3w
Virtual	
  reality	
  -­‐	
  Immersive

http://www.youtube.com/watch?v=WYG7xGFByJ8
Virtual	
  reality	
  -­‐	
  Semi	
  immersive

http://www.youtube.com/watch?v=7MVyT1lgGGQ
Adapted	
  milgram's	
  VR-­‐AR	
  
continuum

http://en.wikipedia.org/wiki/File:Adapted_milgrams_VR-­‐AR_continuum.png
Augmented	
  reality

Started	
  in	
  1957	
  (Roosevelt	
  home)
Augmented	
  reality

http://www.youtube.com/watch?v=DjevdT5XpFw
Augmented	
  reality
Augmented	
  reality
Augmented	
  reality
Augmented	
  reality

See-­‐through
Augmented	
  reality

Monitor	
  based
Augmented	
  reality
Augmented	
  reality
Augmented	
  reality
Adapted	
  milgram's	
  VR-­‐AR	
  
continuum

http://en.wikipedia.org/wiki/File:Adapted_milgrams_VR-­‐AR_continuum.png
TUI
TUI

http://www.ted.com/talks/david_merrill_demos_siftables_the_smart_blocks.html
TUI

https://vimeo.com/82277562
Adapted	
  Virtuality-­‐Reality	
  
continuum

http://en.wikipedia.org/wiki/File:Adapted_milgrams_VR-­‐AR_continuum.png
Augmented	
  Reality
Capture	
  real	
  world	
  
Computer	
  Vision

Capture	
  virtual	
  world	
  
Computer	
  Graphics

http://wearables.unisa.edu.au
Diminished	
  reality

http://www.youtube.com/watch?v=FgTq-­‐AgYlTE
Diminished	
  reality

http://tangible.media.mit.edu/project/focalspace/
Ingredients	
  for	
  successful	
  AR	
  
http://www.youtube.com/watch?v=yDjHbLjtL-­‐c
Environment	
  analysis
+
Realistic	
  augmentation
Environment	
  analysis

Real-­‐time	
  3D	
  tracking	
  of	
  user	
  viewpoint	
  w.r.t.	
  World
•
•
•
•
•

Geolocalization	
  
Electro-­‐magnetic	
  
Acoustic	
  
Inertial	
  
Vision-­‐based	
  (active	
  or	
  passive)
Image-­‐based	
  3D	
  tracking

Inside-­‐out
Image-­‐based	
  3D	
  tracking

Outside-­‐in
OpenCV

http://www.youtube.com/watch?v=Z43_hCM74rU
Color	
  tracking
Hand	
  tracking

http://www.youtube.com/watch?v=B4dwu3si9x0
Hand	
  Tracking

http://www.youtube.com/watch?v=CYJjQgV0mZY
Optical	
  Flow

Optical	
  Flow
http://www.youtube.com/watch?v=5rR_9YIcg_s
Optical	
  Flow

http://www.youtube.com/watch?v=1D93RmW_eN4
Optical	
  Flow

http://www.youtube.com/watch?v=C95bngCOv9Q
Optical	
  Flow

http://www.youtube.com/watch?v=0L34HsXXU00
Face	
  tracking

http://www.youtube.com/watch?v=JyBMxeVCQkc
Head	
  tracking
Face	
  tracking

http://www.youtube.com/watch?v=h9kPI7_vhAU
Face	
  tracking
Face	
  tracking
Face	
  substitution

http://auduno.github.io/clmtrackr/examples/facesubstitution.html
Image-­‐based	
  3D	
  reconstruction
Computer	
  vision	
  is	
  good	
  at	
  location	
  features:	
  
Points	
  
Regions	
  
Textures	
  
Contours	
  
...
Image-­‐based	
  3D	
  reconstruction
Geometry
3D	
  reconstruction:	
  what	
  is	
  where?
Semantic:	
  augmentation	
  of	
  context	
  
Object	
  recognition	
  
Interpretation	
  of	
  content
3D	
  reconstruction	
  of	
  regions
Based	
  on	
  planar	
  equations.	
  
– Hypothesis:	
  world	
  is	
  piece-­‐wise	
  planar

3D	
  registration	
  by	
  Iterative	
  Closest	
  Point	
  (ICP)
ARToolkit

http://www.youtube.com/watch?v=VR12e7WnkxU
ARToolkit

http://www.youtube.com/watch?v=YWG4nhdsySE
ARToolkit
ARToolkit
Fast	
  and	
  cheap	
  6D	
  marker	
  tracking	
  
Easy	
  calibration	
  routine:	
  
– Measure	
  camera	
  properties:	
  
• Center	
  point	
  of	
  the	
  camera	
  image.	
  
• The	
  lens	
  distortion.	
  
• Camera	
  focal	
  length.	
  

!
!
!

Virtual	
  objects	
  appear	
  only	
  when	
  complete	
  markers	
  are	
  
visible.
Image	
  processing
Image	
  processing
Image	
  processing
Image	
  processing
Image	
  processing
Pattern	
  matching
Feature	
  tracking:	
  SIFT
Markerless	
  tracking
Depth	
  cameras

Infer	
  depth	
  for	
  ALL	
  pixels
Depth	
  cameras

Zcam	
  (3DV	
  Systems)	
  2007	
  –	
  1.3Megapixel	
  60fps
ZCam
Kinect

http://www.youtube.com/watch?v=YTBvjLGDluY
Kinect

http://www.youtube.com/watch?v=NqjopQmqWAE
Kinect
Kinect
Kinect
Motion	
  capture

http://people.csail.mit.edu/rywang/handtracking/handtracking.mov
Motion	
  capture
Markless	
  motion	
  capture

http://vimeo.com/33323400
http://structure.io
http://structure.io
Depth	
  Cameras

Solves	
  the	
  “where”	
  but	
  not	
  the	
  “what”:	
  	
  
objects	
  must	
  still	
  be	
  identified	
  (segmented)
Realistic	
  augmentation
Environment	
  analysis
+
Realistic	
  augmentation
Realistic	
  augmentation
!

2	
  components:	
  	
  
	
   Geometric	
  coherency	
   	
  
	
   Lighting	
  coherency	
  
	
  
CG	
  Blending
Approximate	
  real	
  world	
  to	
  simulate	
  interaction

Virtual	
  in	
  front	
  of	
  real

Virtual	
  behind	
  real
Light	
  coherency

http://www.kevinkarsch.com/publications/sa11.html
Light	
  coherency
Light	
  coherence

http://www.youtube.com/watch?v=P3roYysI6pM
Light	
  probe

Aim:	
  Capture	
  light	
  coming	
  from	
  light	
  sources	
  in	
  real	
  world
Light	
  probe
Light	
  probe

Half-­‐life	
  2
Light	
  coherence

http://www.youtube.com/watch?v=ihhKLex2Na8
Light	
  coherence

http://handheldar.icg.tugraz.at/
Camera	
  effects
AR	
  Hardware
Lumus	
  DK-­‐40	
  AR	
  Glasses

Oculus	
  Rift	
  ‘Crystal	
  Cove’

Heapsylon	
  Sensoria	
  Fitness	
  socks

LG	
  Lifeband	
  Touch

Edison-­‐	
  Intel‘s	
  Development	
  Board

Sony’s	
  ‘wearable	
  HDTV’

Sony	
  SmartBand

Pebble
Google	
  Glasses
ORA	
  Glasses
http://optinvent.com/
Epson	
  Moverio	
  BT-­‐100
Meta	
  Pro	
  Glasses
Lumus	
  HUD	
  Display
Telepathy	
  One
NTT	
  DOCOMO
http://www.reconinstruments.com
vrAse
Reevu	
  Intelligent	
  Helmet’s	
  heads	
  up	
  display
Intel	
  RealSense	
  3D	
  camera
Creative	
  Senz3D
SeeSpace	
  InAir
 i-­‐Air	
  Touch	
  Technology
Interaction	
  and	
  Collaboration
http://www.youtube.com/watch?v=RlHOhYF_jqM
Interaction	
  and	
  Collaboration
http://www.youtube.com/watch?v=Y3TzhXYF0Lg
Augmented	
  reality	
  techniques
Sergi	
  Grau	
  Carrión	
  
http://sergigrau.cat	
  
@sergi_grau

Weitere ähnliche Inhalte

Andere mochten auch

Teleimmersion
TeleimmersionTeleimmersion
Teleimmersionstudent
 
Crime Scene Diagramming and Reconstruction by Det. Mike Anderson
Crime Scene Diagramming and Reconstruction by Det. Mike AndersonCrime Scene Diagramming and Reconstruction by Det. Mike Anderson
Crime Scene Diagramming and Reconstruction by Det. Mike AndersonPPI_Group
 
Shape from Distortion - 3D Digitization
Shape from Distortion - 3D DigitizationShape from Distortion - 3D Digitization
Shape from Distortion - 3D DigitizationVanya Valindria
 
OpenStreetMap in 3D - current developments
OpenStreetMap in 3D - current developmentsOpenStreetMap in 3D - current developments
OpenStreetMap in 3D - current developmentsvirtualcitySYSTEMS GmbH
 
Lecture 01 frank dellaert - 3 d reconstruction and mapping: a factor graph ...
Lecture 01   frank dellaert - 3 d reconstruction and mapping: a factor graph ...Lecture 01   frank dellaert - 3 d reconstruction and mapping: a factor graph ...
Lecture 01 frank dellaert - 3 d reconstruction and mapping: a factor graph ...mustafa sarac
 
Build Your Own 3D Scanner: The Mathematics of 3D Triangulation
Build Your Own 3D Scanner: The Mathematics of 3D TriangulationBuild Your Own 3D Scanner: The Mathematics of 3D Triangulation
Build Your Own 3D Scanner: The Mathematics of 3D TriangulationDouglas Lanman
 
Programación 3D y Modelado de Realidad Virtual para Internet con VRML 2.0
Programación 3D y Modelado de Realidad Virtual para Internet con VRML 2.0Programación 3D y Modelado de Realidad Virtual para Internet con VRML 2.0
Programación 3D y Modelado de Realidad Virtual para Internet con VRML 2.0Stephenson Prieto
 
Build Your Own 3D Scanner: Course Notes
Build Your Own 3D Scanner: Course NotesBuild Your Own 3D Scanner: Course Notes
Build Your Own 3D Scanner: Course NotesDouglas Lanman
 
Overview of 3D GIS Capabilties
Overview of 3D GIS CapabiltiesOverview of 3D GIS Capabilties
Overview of 3D GIS CapabiltiesErik Van Der Zee
 
Inside Matters - 3D X-Ray Microscopy - Software - Octopus Imaging
Inside Matters - 3D X-Ray Microscopy - Software - Octopus ImagingInside Matters - 3D X-Ray Microscopy - Software - Octopus Imaging
Inside Matters - 3D X-Ray Microscopy - Software - Octopus ImagingLeiv Hendrickx
 
3D Scanning Technology Overview: Kinect Reconstruction Algorithms Explained
3D Scanning Technology Overview: Kinect Reconstruction Algorithms Explained3D Scanning Technology Overview: Kinect Reconstruction Algorithms Explained
3D Scanning Technology Overview: Kinect Reconstruction Algorithms ExplainedVoxelMetric
 
Build Your Own 3D Scanner: 3D Scanning with Swept-Planes
Build Your Own 3D Scanner: 3D Scanning with Swept-PlanesBuild Your Own 3D Scanner: 3D Scanning with Swept-Planes
Build Your Own 3D Scanner: 3D Scanning with Swept-PlanesDouglas Lanman
 
Inside Matters - 3D X-Ray Microscopy - Services
Inside Matters - 3D X-Ray Microscopy - ServicesInside Matters - 3D X-Ray Microscopy - Services
Inside Matters - 3D X-Ray Microscopy - ServicesLeiv Hendrickx
 
Pixie Dust - SIGGGRAPH 2014
Pixie Dust - SIGGGRAPH 2014Pixie Dust - SIGGGRAPH 2014
Pixie Dust - SIGGGRAPH 2014Yoichi Ochiai
 
Build Your Own 3D Scanner: 3D Scanning with Structured Lighting
Build Your Own 3D Scanner: 3D Scanning with Structured LightingBuild Your Own 3D Scanner: 3D Scanning with Structured Lighting
Build Your Own 3D Scanner: 3D Scanning with Structured LightingDouglas Lanman
 
A Three-Dimensional Representation method for Noisy Point Clouds based on Gro...
A Three-Dimensional Representation method for Noisy Point Clouds based on Gro...A Three-Dimensional Representation method for Noisy Point Clouds based on Gro...
A Three-Dimensional Representation method for Noisy Point Clouds based on Gro...Sergio Orts-Escolano
 
Low-cost data-driven 3D reconstruction and its applications @ 6th ICE 3D Body...
Low-cost data-driven 3D reconstruction and its applications @ 6th ICE 3D Body...Low-cost data-driven 3D reconstruction and its applications @ 6th ICE 3D Body...
Low-cost data-driven 3D reconstruction and its applications @ 6th ICE 3D Body...Alfredo BALLESTER FERNÁNDEZ
 
Técnicas de ingeniería inversa para diseño producto
Técnicas de ingeniería inversa para diseño productoTécnicas de ingeniería inversa para diseño producto
Técnicas de ingeniería inversa para diseño productoDiseño e Ingeniería
 
DimEye Corp Presents Revolutionary VLS (Video Laser Scan) at SS IMMR 2013
DimEye Corp Presents Revolutionary VLS (Video Laser Scan) at SS IMMR 2013DimEye Corp Presents Revolutionary VLS (Video Laser Scan) at SS IMMR 2013
DimEye Corp Presents Revolutionary VLS (Video Laser Scan) at SS IMMR 2013Patrick Raymond
 

Andere mochten auch (20)

Teleimmersion
TeleimmersionTeleimmersion
Teleimmersion
 
Crime Scene Diagramming and Reconstruction by Det. Mike Anderson
Crime Scene Diagramming and Reconstruction by Det. Mike AndersonCrime Scene Diagramming and Reconstruction by Det. Mike Anderson
Crime Scene Diagramming and Reconstruction by Det. Mike Anderson
 
Shape from Distortion - 3D Digitization
Shape from Distortion - 3D DigitizationShape from Distortion - 3D Digitization
Shape from Distortion - 3D Digitization
 
OpenStreetMap in 3D - current developments
OpenStreetMap in 3D - current developmentsOpenStreetMap in 3D - current developments
OpenStreetMap in 3D - current developments
 
Lecture 01 frank dellaert - 3 d reconstruction and mapping: a factor graph ...
Lecture 01   frank dellaert - 3 d reconstruction and mapping: a factor graph ...Lecture 01   frank dellaert - 3 d reconstruction and mapping: a factor graph ...
Lecture 01 frank dellaert - 3 d reconstruction and mapping: a factor graph ...
 
Build Your Own 3D Scanner: The Mathematics of 3D Triangulation
Build Your Own 3D Scanner: The Mathematics of 3D TriangulationBuild Your Own 3D Scanner: The Mathematics of 3D Triangulation
Build Your Own 3D Scanner: The Mathematics of 3D Triangulation
 
Programación 3D y Modelado de Realidad Virtual para Internet con VRML 2.0
Programación 3D y Modelado de Realidad Virtual para Internet con VRML 2.0Programación 3D y Modelado de Realidad Virtual para Internet con VRML 2.0
Programación 3D y Modelado de Realidad Virtual para Internet con VRML 2.0
 
Acosutic Trail, GPS manos libres
Acosutic Trail, GPS manos libresAcosutic Trail, GPS manos libres
Acosutic Trail, GPS manos libres
 
Build Your Own 3D Scanner: Course Notes
Build Your Own 3D Scanner: Course NotesBuild Your Own 3D Scanner: Course Notes
Build Your Own 3D Scanner: Course Notes
 
Overview of 3D GIS Capabilties
Overview of 3D GIS CapabiltiesOverview of 3D GIS Capabilties
Overview of 3D GIS Capabilties
 
Inside Matters - 3D X-Ray Microscopy - Software - Octopus Imaging
Inside Matters - 3D X-Ray Microscopy - Software - Octopus ImagingInside Matters - 3D X-Ray Microscopy - Software - Octopus Imaging
Inside Matters - 3D X-Ray Microscopy - Software - Octopus Imaging
 
3D Scanning Technology Overview: Kinect Reconstruction Algorithms Explained
3D Scanning Technology Overview: Kinect Reconstruction Algorithms Explained3D Scanning Technology Overview: Kinect Reconstruction Algorithms Explained
3D Scanning Technology Overview: Kinect Reconstruction Algorithms Explained
 
Build Your Own 3D Scanner: 3D Scanning with Swept-Planes
Build Your Own 3D Scanner: 3D Scanning with Swept-PlanesBuild Your Own 3D Scanner: 3D Scanning with Swept-Planes
Build Your Own 3D Scanner: 3D Scanning with Swept-Planes
 
Inside Matters - 3D X-Ray Microscopy - Services
Inside Matters - 3D X-Ray Microscopy - ServicesInside Matters - 3D X-Ray Microscopy - Services
Inside Matters - 3D X-Ray Microscopy - Services
 
Pixie Dust - SIGGGRAPH 2014
Pixie Dust - SIGGGRAPH 2014Pixie Dust - SIGGGRAPH 2014
Pixie Dust - SIGGGRAPH 2014
 
Build Your Own 3D Scanner: 3D Scanning with Structured Lighting
Build Your Own 3D Scanner: 3D Scanning with Structured LightingBuild Your Own 3D Scanner: 3D Scanning with Structured Lighting
Build Your Own 3D Scanner: 3D Scanning with Structured Lighting
 
A Three-Dimensional Representation method for Noisy Point Clouds based on Gro...
A Three-Dimensional Representation method for Noisy Point Clouds based on Gro...A Three-Dimensional Representation method for Noisy Point Clouds based on Gro...
A Three-Dimensional Representation method for Noisy Point Clouds based on Gro...
 
Low-cost data-driven 3D reconstruction and its applications @ 6th ICE 3D Body...
Low-cost data-driven 3D reconstruction and its applications @ 6th ICE 3D Body...Low-cost data-driven 3D reconstruction and its applications @ 6th ICE 3D Body...
Low-cost data-driven 3D reconstruction and its applications @ 6th ICE 3D Body...
 
Técnicas de ingeniería inversa para diseño producto
Técnicas de ingeniería inversa para diseño productoTécnicas de ingeniería inversa para diseño producto
Técnicas de ingeniería inversa para diseño producto
 
DimEye Corp Presents Revolutionary VLS (Video Laser Scan) at SS IMMR 2013
DimEye Corp Presents Revolutionary VLS (Video Laser Scan) at SS IMMR 2013DimEye Corp Presents Revolutionary VLS (Video Laser Scan) at SS IMMR 2013
DimEye Corp Presents Revolutionary VLS (Video Laser Scan) at SS IMMR 2013
 

Ähnlich wie Ar techniques@sergi grau

3. augmented reality uninpahu 2019-1
3. augmented reality uninpahu 2019-13. augmented reality uninpahu 2019-1
3. augmented reality uninpahu 2019-1Javier Daza
 
1545 doohf chris grayson
1545 doohf chris grayson1545 doohf chris grayson
1545 doohf chris graysonMediaPost
 
mediaman visualtech en
mediaman visualtech enmediaman visualtech en
mediaman visualtech enmediaman
 
Make believe - Droidcon UK 2015
Make believe - Droidcon UK 2015Make believe - Droidcon UK 2015
Make believe - Droidcon UK 2015Shanee Nishry
 
Motion Capture Technology
Motion Capture TechnologyMotion Capture Technology
Motion Capture TechnologyGameyan Studio
 
Seminar presentation
Seminar presentationSeminar presentation
Seminar presentationBrij Kishore
 
Virtual reality
Virtual realityVirtual reality
Virtual realitySTUDENT
 
AR: A view of the future with Microsoft technologies
AR: A view of the future with Microsoft technologies AR: A view of the future with Microsoft technologies
AR: A view of the future with Microsoft technologies Lee Stott
 
Natural User Interfaces Course - Class 2 [Augmented Reality]
Natural User Interfaces Course - Class 2 [Augmented Reality]Natural User Interfaces Course - Class 2 [Augmented Reality]
Natural User Interfaces Course - Class 2 [Augmented Reality]cristiangb
 
Quick dive into WebVR
Quick dive into WebVRQuick dive into WebVR
Quick dive into WebVRJanne Aukia
 
virtual reality
virtual realityvirtual reality
virtual realitySTUDENT
 
Synthetic environment
Synthetic environmentSynthetic environment
Synthetic environmentUllas Gupta
 
SASTA UNREAL Science - using AR and VR
SASTA UNREAL Science - using AR and VRSASTA UNREAL Science - using AR and VR
SASTA UNREAL Science - using AR and VRgarybau
 
Aesthetec at MEIC5, augmenting the world
Aesthetec at MEIC5, augmenting the worldAesthetec at MEIC5, augmenting the world
Aesthetec at MEIC5, augmenting the worldAesthetec Studio
 
VR digest. August 2018
VR digest. August 2018VR digest. August 2018
VR digest. August 2018ElifTech
 
Augmented Reality
Augmented RealityAugmented Reality
Augmented Realityav2194
 

Ähnlich wie Ar techniques@sergi grau (20)

3. augmented reality uninpahu 2019-1
3. augmented reality uninpahu 2019-13. augmented reality uninpahu 2019-1
3. augmented reality uninpahu 2019-1
 
1545 doohf chris grayson
1545 doohf chris grayson1545 doohf chris grayson
1545 doohf chris grayson
 
mediaman visualtech en
mediaman visualtech enmediaman visualtech en
mediaman visualtech en
 
Make believe - Droidcon UK 2015
Make believe - Droidcon UK 2015Make believe - Droidcon UK 2015
Make believe - Droidcon UK 2015
 
Easy Virtual Reality
Easy Virtual RealityEasy Virtual Reality
Easy Virtual Reality
 
Motion Capture Technology
Motion Capture TechnologyMotion Capture Technology
Motion Capture Technology
 
Motion capture by Rj
Motion capture by RjMotion capture by Rj
Motion capture by Rj
 
Seminar presentation
Seminar presentationSeminar presentation
Seminar presentation
 
Virtual reality
Virtual realityVirtual reality
Virtual reality
 
Virtual Production - Brief Overview
Virtual Production - Brief OverviewVirtual Production - Brief Overview
Virtual Production - Brief Overview
 
AR: A view of the future with Microsoft technologies
AR: A view of the future with Microsoft technologies AR: A view of the future with Microsoft technologies
AR: A view of the future with Microsoft technologies
 
Natural User Interfaces Course - Class 2 [Augmented Reality]
Natural User Interfaces Course - Class 2 [Augmented Reality]Natural User Interfaces Course - Class 2 [Augmented Reality]
Natural User Interfaces Course - Class 2 [Augmented Reality]
 
Quick dive into WebVR
Quick dive into WebVRQuick dive into WebVR
Quick dive into WebVR
 
virtual reality
virtual realityvirtual reality
virtual reality
 
Raskar Computational Camera Fall 2009 Lecture 01
Raskar Computational Camera Fall 2009 Lecture 01Raskar Computational Camera Fall 2009 Lecture 01
Raskar Computational Camera Fall 2009 Lecture 01
 
Synthetic environment
Synthetic environmentSynthetic environment
Synthetic environment
 
SASTA UNREAL Science - using AR and VR
SASTA UNREAL Science - using AR and VRSASTA UNREAL Science - using AR and VR
SASTA UNREAL Science - using AR and VR
 
Aesthetec at MEIC5, augmenting the world
Aesthetec at MEIC5, augmenting the worldAesthetec at MEIC5, augmenting the world
Aesthetec at MEIC5, augmenting the world
 
VR digest. August 2018
VR digest. August 2018VR digest. August 2018
VR digest. August 2018
 
Augmented Reality
Augmented RealityAugmented Reality
Augmented Reality
 

Ar techniques@sergi grau