A talk from the Develop/Create at AWE Tel Aviv 2018 - the World's #1 XR Conference & Expo in Tel Aviv, Israel, November 5, 2018. Dedi Gadot (Magic Leap): An Introduction to Magic Leap We will introduce Magic Leap, talk about our research work and (some) plans ahead. http://AugmentedWorldExpo.com

1. CONFIDENTIAL
Magic Leap
!1
Magic Leap
Free Your Mind

2. !2
Shot using developer tools

3. !3
Dedi Gadot
Director, Computer Vision & Algorithms
Magic Leap Israel

4. ● Magic Leap One
● How We Do It
● The Future
● Magic Leap Israel

5. Magic Leap ONE

6. CONFIDENTIAL !6
From A to Magic Leap One

7. FILL ENTIRE SLIDE WITH DARK IMAGE
Select Image, then Press Cntrl + Down-Arrow (win) or Command+Down-Arrow to move the backgroundimage to bottom layer

8. Key Product Features
LRA Haptic Device
6DoF Tracking
12-LED (RGB) ring with diffuser
Built-in rechargeable lithium-ion battery (control)
NVIDIA® Parker SOC
8 GB RAM, 128 GB Storage Capacity
Dedicated computer vision processor
CPU: 2 Denver 2.0 64b cores + 4 ARM Cortex A57 64b
cores
Integrated Spatial Audio
Eye tracking + Sensor Suite
Biometric ID
Voice Recognition/Detection
Bluetooth 4.0
WiFi 802.11ac/b/g/n,
USB-C
Built-in rechargeable lithium-ion battery (wearable)

9. CONFIDENTIAL !9
Input Methods

10. 30 second wrap-up

12. How we do it?

13. How?
Tracking, Mapping &
Localizing
World Reconstruction
Eye Tracking
Hand Tracking
Credit goes to ML’s CV teams
Credit goes to ML’s CV teams

14. Tracking & Mapping
Visual Inertial Odometry
Persistent Coordinate Frames

15. Localizing
Persistency and sharing
Map Selection

16. Localizing
Persistency and sharing
Map Selection
Pose Estimation

17. Localizing
Persistency and sharing
Map Selection
Pose Estimation
Restore PCFs

18. World Reconstruction
Visual Occlusions
Physics Based
Interactions
Environment
Reasoning

19. World Reconstruction

20. Hand Tracking
● Gesture classification (8 gestures)
● Keypoint Tracking (9 points)

21. SDK for Unity SDK for Unreal Engine Lumin SDK Helio Web Platform
4 Ways for App Developers to Develop

22. The Future

23. CONFIDENTIAL !23
Credit goes to ML’s AI & CG teams
Credit goes to ML’s HCAI and dDNA teams

24. CONFIDENTIAL !24
The MagicVERSE

25. Where the academia is headed
CNN-SLAM: Keisuke Tateno, Federico Tombari, Iro Laina, Nassir Navab

26. Where the academia is headed
Taskonomy: Amir R. Zamir, Alexander Sax*, William B. Shen*
Leonidas Guibas, Jitendra Malik, Silvio Savarese

27. Active research by Magic Leap
SuperPoint Towards a Geometric Deep SLAM

28. Magic Leap Israel

29. CONFIDENTIAL
Magic Leap Israel
!29
● Offices in Haifa (MATAM) and Tel Aviv (Azrieli Sarona)
● Working on a lot of what was described in this lecture
● Open positions! Check them out at our website: https://www.magicleap.com/careers
● dgadot@magicleap.com

30. THANK YOU!
You’re welcome to come
and see a demo
Thank You!
Come see a demo!