A talk from the Develop Track at AWE EU 2018 - the World's #1 XR Conference & Expo in Munich, Germany 18 -19, October, 2018. Pablo Fraile (Arm): AR: Lessons from the Mobile Revolution For over 25 years, Arm has carried out its vision of enabling low-power technology wherever computing happens. With a vibrant global ecosystem of over 1,100 partners and over 100 billion Arm-based chips shipped to date, Arm processors started the mobile revolution and now are a key part of today’s connected world. Yet, another compute revolution is on the horizon. Augmented Reality (AR) sets to bring a paradigm shift in computing. Whilst the technology is still in preliminary stage, AR will be one of the biggest sources of digital disruption since the smartphone. AR comes with vast new processing demands to power compelling experiences in multiple form-factors. Similarly, it poses new exciting challenges that require innovative solutions. In this talk, we will share our vision of the future, and how together with our developer ecosystem we can enable this upcoming computing revolution. http://AugmentedWorldExpo.com

1. © 2018 Arm Limited
Augmented reality,
the next computing
revolution
• Pablo Fraile, Director Developer Ecosystems
• 18 October 2018

2. 2 © 2018 Arm Limited
Arm-based chips expected to
have shipped by Arm
partners in 2018
20 billion
AI performance increase
with Arm DynamIQ
>50% Global population reached
by Arm technologies
Arm-based chips shipped the last 26
years with the next 100 billion
expected to ship in next 4 years
125 billion
of the world’s smartphones
are based on Arm
>95%
Arm: The Industry’s Architecture of Choice
Arm Mali GPUs shipped last
year by our partners
1.2 billion

3. 3 © 2018 Arm Limited
From comm devices to mobile phones

4. 4 © 2018 Arm Limited
The era of mobile phones ushered in
Global life-transforming disruption
Infrastructure
Cool and niche is the precursor
of mass market Standards

5. 5 © 2018 Arm Limited
The era of mobile phones ushered in
Global life-transforming disruption
Mass appeal derived from
satisfying basic human needs
Iterations improve performance,
capabilities and user experience
Driven by power and cost
reduction

6. 6 © 2018 Arm Limited
What we learnt from the mobile revolution

7. 7 © 2018 Arm Limited
Open, flexible technology
• Provide the building blocks for people to build
successful products
• With a few missteps along the way
• Don’t dictate the right approach but enable innovation

8. 8 © 2018 Arm Limited
Market dynamics will determine winners and losers
• Enable the contenders with the tools to win
• Process will evolve products into the right solution

9. 9 © 2018 Arm Limited
A new wave of computing is beginning...
Security
Privacy
Identity
Immersive
media
Vision + Cognition + Augmentation + HMI
Augment/Virtual Reality
New
comms
standards
Real-world
comprehension

10. 10 © 2018 Arm Limited
eCommerce
Social
Cinema Gaming Live video
Live Support
Smart cities
Engineering UI Health
Navigation
Education
xR + AI
has the potential
to revolutionize
many areas

11. 11 © 2018 Arm Limited
Form factor decisions are fundamental
Smartphone
AR
All-In-One VR Companion
AR/VR
Dual device
AR
All-In-One AR
- Mobile devices: remove antenna, keyboard yes/no
- Now, wearable nature means relationship between tech and body is open.

12. 12 © 2018 Arm Limited
Form factors present biggest challenges
What’s different this time?
• Weight/comfort
• Typically prescription glasses weight just 25g
• Lithium-ion battery density is 10-27 Wh/100g
• Typical All-In-One Smartglasses today has only ~2Hrs battery life
• Thermals:
• Typically smaller form factors
• Always-on – incessant need to constantly “See, Understand, Augment”
• Solution will require a system-wide view
Power &
Thermals
Smartglasses –
lower thermals,
still want all-day
use
Comfort will be
priority for
consumer
Most difficult
heterogenous
workload

13. 13 © 2018 Arm Limited
This has implications across the stack
HW vendors
Camera(s)
Sensor(s)
SoC
OS
Microsoft
Apple
Google
Linux
OEM
Smartphone
Smart-glasses
SLAM
Proprietary
Open-source
AR SDK
ARCore (Google)
ARKit (Apple)
Wikitude
Vuforia
…
Dev. Tools
Unity
Unreal
Proprietary
SW Developer
Games
Apps

14. 14 © 2018 Arm Limited
The importance of software platforms
• Smart vs “dumb” phone direction
• What is a Platform?
• Today: OS + App Store & Services
• Tomorrow: Unknown
• Post-OS world
• Beyond a collection of icons
• Non-linear development – decentralized distribution
• Developers are key determinants of success!

15. 15 © 2018 Arm Limited
Smartphone
TV
Video Game Console
Microcomputer (PC)
0.00
10.00
20.00
30.00
40.00
50.00
60.00
70.00
80.00
90.00
100.00
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51
Market penetration/adoption [ % ]
# of years since introduction
Technology Adoption Trends
Where are we in the XR revolution
ARKit (2017)
AR
ARCore (2018)
AR
Magic Leap (2018)
MR
HoloLens (2016)
MR
GearVR (2015)
VR
Rift (2013)
VR
Source: Asymco, see: www.docs.google.com/spreadsheets/d/1uvn7o1X19Equ5EDvjXEMxpziAEAsXTJK9Xbf8NwYiAo/htmlview.

16. 16 © 2018 Arm Limited
0.00
10.00
20.00
30.00
40.00
50.00
60.00
70.00
80.00
90.00
100.00
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51
Market penetration/adoption [ % ]
# of years since introduction
Technology Adoption Trends
Smartphone TV Video Game Console Microcomputer (PC)
Where are we in the XR revolution
ARKit (2017)
AR
ARCore (2018)
AR
Magic Leap (2018)
MR
HoloLens (2016)
MR
GearVR (2015)
VR
Rift (2013)
VR

17. 17 © 2018 Arm Limited
Open, flexible tech in the hands of the ecosystem
Silicon increasingly more powerful
Arm single-core performance estimated for compute platform. Results are measured estimates using specific computer systems, software components, operations, and functions and changes to any of these factors will cause the results to vary.

18. 18 © 2018 Arm Limited
“The number of people announcing
the death of Moore’s Law doubles
every 18 months”
But is Moore’s Law is dead?
Introducing Ellis’ Law:

19. 19 © 2018 Arm Limited
CPU, GPU, ML performance
Exponential grown in other areas

20. 20 © 2018 Arm Limited
Introducing new APIs to enable new software ecosystems
• APIs will drive standardisation in the same way GSM did
• Key to enable experimentation
• Another essential part of open, flexible technology

21. 21 © 2018 Arm Limited
Introducing new APIs to enable new software ecosystems
• APIs will drive standardisation in the
same way GSM did
• Key to enable experimentation
• Another essential part of open, flexible
technology
Arm Hardware IP for AI/ML
AI/ML Applications and Frameworks
CPU
GPU Hardware
Software
Ecosystem
Libraries Optimized for Arm Hardware
NPU
Android NNAPI

22. 22 © 2018 Arm Limited
Optimized software key to performance moving forward
Increased performance even with unchanged hardware and workloads
1 2 3 4 5 6 7 8 9 10 11 12 13 14
CPU time*
Software stack element
Month #
*Representative of real-world data
0.5t
t

23. 23 © 2018 Arm Limited
Process to Success Timeline
Visualization of system
performance metrics,
software profile and system
events over time
Log
Chronologic list of text and
graphic user annotations sent
to Streamline, offering
flexible filtering
Functions
Flat software profile table,
listing shared libraries and
function hotspots
Call Paths
Hierarchical profile table,
aggregating samples per
process, thread, and function
call chain
Code
Source and instruction level
profile. Color coded source
code lines for easy
identification

24. 24 © 2018 Arm Limited
In summary
• More solutions, more powerful and more readily available than ever before.
• Heterogenous computing increasingly used for complex workloads.
• APIs enable experimentation and rapid development in the software stack.
• Optimized software can be a key competitive advantage. Use it.

25. 25 © 2018 Arm Limited
Want to know more?
Arm Mali Developer Guides & Tools
https://developer.arm.com/graphics
Arm NN Software Developer Kit
https://developer.arm.com/products/processors/machine-learning/arm-nn
Questions?
developer@arm.com

26. 26 26
Thank You
Danke
Merci
谢谢
ありがとう
Gracias
Kiitos
감사합니다
धन्यवाद
‫תודה‬
© 2018 Arm Limited