A talk from the Inspire Track at AWE Europe 2017 - the largest conference for AR+VR in Munich, Germany October 19-20, 2017
Joerg Tewes (Avegant): How Light Field Technology Will Change the Future of Augmented and Mixed Reality
The adoption of augmented and mixed reality are being held back for a simple reason: no solution exists to see virtual objects within arm’s length. Light field displays change this by revolutionizing the optical architectures for augmented and mixed reality solutions. In this talk, Joerg Tewes will discuss the merits and drawbacks of light field technologies including sections on multi-focal imagery and near-field image generation. A look at the current state of the art will follow, concluded by details on the light field solution employed by Avegant and its potential for the future.
2. Mixed Reality: Convergence of the Virtual and Physical Worlds
Superimposition of digital content on the world
Limited or no interaction
Total Immersion into a digital world
Digitally rendered 3D content and environments
Integration and interaction with 3D digital objects
in the physical world
Improved functionality and greater use cases than
AR
1
Mixed Reality
Virtual RealityAugmented Reality Mixed Reality
3. Mixed Reality Will Reinvent Life as We Know It
2
Real time interaction with the world around us New perspectives to solve problems
Endless possibilities to entertain and amaze usInstant collaboration bridges the physical divide
4. Mixed Reality is the Foundation of Ambient Computing
3
Avegant is solving the most important issue: Optics &
Displays
Optics &
Displays
Audio
Interaction
AI
Ambient Computing Needs to Solve…
UX
Computer
Vision
1980s & 1990s Mid-2000s Near Future
Personal
Computing
Mobile
Computing
Ambient
Computing
“Tech was once always in your way.
Soon, it will be almost invisible.”
Mossberg: The Invisible Computer
5. 4
Image Credit: Super Ventures
size
battery life
heat
immersion
ergonomics
content
light field
field of view (FOV)
processing power
Challenges for MR mass adoption
quality rendering
price
7. Avegant’s Display Technology Unlocks Mixed Reality’s True Potential
Retinal imaging reflects
lights off of microscopic
mirror arrays and
projects onto the retina
Ultra HD resolution: no
pixelation, no screen
door effect
High performance, ultra
low latency
Proven
commercialization and
production capability
Light Field
simultaneously displays
images at multiple focal
planes
Focus of physical and
digital worlds matches
at any distance
Read text, close or far
away, with perfect
clarity
Manufacturable at scale
today
Realizing the Market Potential
6
Healthcare:
Enhanced Resolution
Intuitive User Interface
Readable Text
Design & Engineering:
Near Eye Capability
Entertainment:
Realistic Experience
Retinal Imaging Light Field
10. The convergence / accommodation problem without light field
Image source: Journal of Vision - ARVO Journals
11. The Human Eye Has Little Room For Error
10
Comfort Zone
Little tolerance for error
<1m
FocusDistance(m)
Convergence Distance (m)
0.3 1 3 10 30
0.3131030
12. Avegant’s Light Field Technology
A groundbreaking near-eye display technology that
solves one of mixed reality’s greatest challenges:
Enabling virtual objects to appear real at distances both
near and far
Light Field also allows the focus of virtual objects to
match that of real world objects, enabling the whole
experience to feel natural
Manufacturable today, at low cost, requiring very little
computational overhead
The visualization of high-quality objects across multiple
focal planes opens up a wide spectrum of professional
and personal uses
11
13. Two closely connected advantages of light field display technology
See things up close Immersive depth of field
17. Our Solution is Applicable to Numerous Industries Right Now
Healthcare
16
CommerceCommunication
Design &
Engineering
Education &
Training
Enterprise Consumer
Consumer Use