SlideShare a Scribd company logo
1 of 16
Download to read offline
www.abiresearch.com
A TRANSFORMATIVE SHIFT SUPPORTED BY THE INTRODUCTION OF 5G
The synergistic relationship between upcoming technologies in the connectivity and computing space often leads to a
revolution across markets. With applications and use cases morphing to take full advantage of new technologies, such as
5G, cloud, and edge computing, the industry is investigating new business opportunities, otherwise not possible before the
introduction of these technologies.
This white paper will focus on augmented reality (AR) and virtual reality (VR), among the most attractive use cases for 5G.
These technologies are promising to transform the way content is consumed and communicated, and will no doubt help
a wide variety of industries increase productivity and change the way they do business. Workflow assistance and “see-what-I-
see” remote interaction and guidance have seen strong uptake already among existing AR rollouts. ABI Research estimates the
total AR market will reach US$114 billion by 2021, and the total VR market will reach US$65 billion within the same timeframe.
AugmentedandVirtualReality:
theFirstWaveof5GKillerApps
2
AUGMENTED AND VIRTUAL REALITY: THE FIRST WAVE OF 5G KILLER APPSwww.abiresearch.com
AR and VR have similar underlying technologies, but distinct experiences. As described in this study, both AR
and VR applications can be very sensitive to network performance, as any associated hiccup can penalize
the overall user experience. Today’s typical 4G networks place serious limitations on AR and VR applications,
such as latency and capacity, which can negate some use cases entirely. Although current 4G networks
are sufficient for some early adopter AR and VR experiences, the introduction of 5G, which represents a
considerable leap over 4G, will no doubt strengthen existing experiences, enable novel ones, and make them
available for mass adoption. Offering much more capacity, lower latency, and a more uniform experience,
5G will not only improve, but will also be a requirement for some of the most exciting AR and VR use cases
outlined in this paper: automotive content streaming, social sharing from event venues, next-generation
video, and tactile Internet.
These key use cases impose diverse network requirements that go well beyond what 4G can deliver.
For example, high-mobility automotive content streaming requires strong network uniformity, combined
with increased capacity to handle growing bitrate requirements for content consumption. In the case of
live streaming a sporting event on social media, the network is required to provide a very dense coverage
and high capacity to bring AR and VR applications close to the end user and make the overall experience
consistent throughout the venue. Next-generation video formats, like interactive 6 degrees of freedom
(6DoF) video, will be most demanding in terms of bandwidth, with up to 10X the bitrate required for 4K
video. Network requirements for remotely controlled devices and tactile Internet, on the other hand, are
expanding. Introducing AR or VR into remote control intensifies latency requirements. Tactile Internet adds
haptic feedback to remote control, creating an even greater need for ultra-low latency.
AR AND VR ARE PROMISING, BUT STILL REQUIRE DEVELOPMENT
AR and VR are unique in that the technologies have the potential to touch so many different markets,
use cases, and applications, allowing the opening up of a substantial addressable market. However, both
technologies are currently in their infancy and face several challenges.
On the hardware side, there is much progress to be made for both AR and VR, most of which will also have
an impact on network performance requirements. Battery life for untethered devices is currently inadequate,
as is processing for graphically intensive applications. Pixel density on current generation displays is lacking
as well, most noticeably in media and entertainment scenarios in VR. Field of view is another concern, limiting
usability in AR and immersion in VR. Standalone VR devices, housing all required components in a single
device, will begin to grow over the next 5 years to compete with mobile VR. This introduces a difficult
and novel hardware form factor to contend with, in addition to the individual component difficulties
mentioned above.
Outside of AR and VR head-mounted device (HMD) hardware, supporting infrastructure is the next step.
Building out 5G infrastructure will take time, but early identification of the most promising applications
3
AUGMENTED AND VIRTUAL REALITY: THE FIRST WAVE OF 5G KILLER APPSwww.abiresearch.com
that rely on or can be improved with this infrastructure creates a stronger foundation for future growth.
Enterprise applications for AR and VR are growing in attractiveness as ROI metrics, such as error reduction
and employee efficiency, are identified and proven. As the hardware footprint continues to grow, the need
for reliable and efficient connectivity will as well.
This white paper looks in detail at the network requirements of AR and VR use cases mentioned above. It will
highlight the key challenges facing the current generation of networks in addressing these requirements and
how 5G will help these use cases achieve their full potential for sustaining credible and lucrative business
opportunities. Before looking at these use cases, let us first elaborate on the general benefits 5G brings to
AR and VR applications.
THREE KEY ADVANTAGES OF 5G
5G networks are heterogeneous by default, offering different types of connectivity optimized for different
types of services. They will offer enhanced mobile broadband connections, but will also support low latency
and high reliability mission-critical services, which are necessary requirements for immersive AR and VR ex-
periences. If one takes into account IMT-2020 guidelines, 5G promises to achieve goals, such as:
▪▪ 20 Gbps peak data rate
▪▪ 100 Mbps data rates, even at cell edges
▪▪ 1 million devices per km2
▪▪ 10 Mbps/m2
for area capacity
▪▪ 1 ms roundtrip over-the-air latency
Compared to 4G, this translates to targets such as a 10X improvement in throughout, a 10X decrease
in latency, a 100X improvement in traffic capacity, and a 100X improvement in network efficiency.1
As
history has shown, an entire range of opportunities opens up when wireless connectivity becomes
faster and costs less. Omnipresent connectivity spanning millions of bandwidth-hungry devices will push
capacity requirements of the network even further, especially considering the visually-intensive data used
for immersive AR and VR.
In addition, as 5G technology matures, it will become fundamental for AR and VR services and experienc-
es to be ubiquitous across heterogeneous networks, including 4G, 5G, and Wi-Fi. Ubiquitous 4G coverage
with Gigabit Class speed, which is expected to see commercial deployments starting in 2017, will be the
foundation for initial AR and VR experiences, while 5G will be able to leverage more spectral bands and wider
bandwidths to boost capacity.
In short, the usefulness of AR and VR going forward is heavily dependent on three primary network
components: high capacity, low latency, and a uniform experience. Some applications rely on one
component more than another, but supporting all three simultaneously is critical to enabling all AR and VR
use cases under the same network.
4
AUGMENTED AND VIRTUAL REALITY: THE FIRST WAVE OF 5G KILLER APPSwww.abiresearch.com
CAPACITY
5G is expected to bring enhanced mobile broadband speeds to mobile networks and increase network
capacity many times compared to previous generations. Capacity need is a result of two primary drivers:
bandwidth per application and simultaneous usage of those applications. Although there are numerous
compelling AR and VR applications, video is the most important and unique in its high bandwidth
requirements. ABI Research expects a progression in demand from the current tens of Mbps per user to
hundreds of Mbps per user in the 5G timeframe for premium content, delivered through AR and VR.
AR and VR Video will Drive 5G Capacity Improvements
The next generation of video includes new formats, such as stereoscopic, high dynamic range (HDR), and
360°, at increased resolutions (8K+) and higher framerates (90+ fps). Although basic implementations of
these formats may be delivered through 4G networks, large-scale adoption of applications that use these
formats will soon congest the network, thus rendering the user experience intolerable.
These new video formats will offer higher quality experiences, but at the cost of higher bandwidth.
For example, higher resolutions are required for 360° video to maintain pixel density across the image,
counteracting the close proximity, increased field-of-view, and optic losses associated with HMD viewing.
Those higher resolutions bring higher bitrates. Stereoscopic video, which separates left and right eye views
to create depth perception, thereby doubling the video streams, is required for immersive VR and AR
viewing and further drives increased video data bandwidth. In addition, HDR video, which offers visual quality
improvements in color fidelity and brightness, will become more mainstream and may increase bitrate by up
to 20% depending on the HDR scheme and video format used.2 In terms of video compression, it is expected
that H.265/HEVC will be the primary encoding and decoding format in the 5G timeframe, offering 30% to
50% improvement in bitrate reduction for similar quality as compared to H.264. Despite this efficiency,
ABI Research expects AR and VR applications to push network requirements, with visual improvements and
associated bitrate requirements outpacing compression improvements for several years.
The ability to view 360° video at 4K 30 fps, which requires 10 Mbps to 50 Mbps depending on quality
selected when using the HEVC video codec, will soon be common and will likely be handled by existing 4G
infrastructure. However, in the 5G timeframe, stereoscopic HDR 360° video at 8K 90 fps, which requires
higher than 200 Mbps, will be feasible. Looking even further out, 6DoF video that allows translational
movement (discussed in more detail in Section 3.3) presents novel compression and transcoding obstacles
and requires 200 Mbps to 1 Gbps per user, which could challenge the cell capacity of current 4G networks.
5
AUGMENTED AND VIRTUAL REALITY: THE FIRST WAVE OF 5G KILLER APPSwww.abiresearch.com
Figure 1:The bandwidth requirements for streaming various visual content, especially video,
will stress network capacity.
(Source: ABI Research)
Multiple users simultaneously consuming or sharing premium content is the other half of the capacity story.
Current 4G networks will struggle when the number of concurrent users increases. AR and VR will compound
this issue by adding many more concurrent users. For example, the vision for AR is the mass adoption of
an all-day wearable device that is constantly connected, uploading and downloading vast amounts of data
throughout the day. Image and video data will increase naturally with the visual nature of AR, and constant
network calls for metrics such as location, status, and AI assistance will drive total requests and concurrency
up even further. As AR and VR seep into the consumer space, these numbers will be exacerbated. For
reference, ABI Research forecasts that the AR smart glasses installed base will reach 48 million units in 2021,
with the VR device installed base numbering over 200 million units globally.
Breaking the Speed Barrier with 5G NR
5G networks are built to support very high bandwidth applications, while the standardization community
is creating specific use cases around AR and VR and the video formats discussed above. The 3GPP is
working toward a new radio standard called 5G New Radio (NR) that will use new technologies to increase
network speeds to tens of Gbps. One of these technologies is millimeter wave (mmWave) communications,
in which the frequency of the link is loosely defined as being above 24 GHz. This promises vast amounts of
bandwidth (including unlicensed bandwidth) and capacity improvements. For example, several field trials
have taken place during 2016 that broke the 10 Gbps barrier, often using more than 1 GHz or even 2 GHz
of channel bandwidth.
There are several ongoing industry trials illustrating user-tracking pencil beams connecting the base station
and the UE, allowing speeds of several Gbps. The added benefit is that these links are spatially separated,
thus allowing mmWave spectrum to be reused even in the same cell for each individual user. However, there
are several challenges to overcome before mmWave communications are used on a large-scale basis; for
example, tracking hundreds of users in real time or dealing with non-line of sight connections between the
base station and user device.
BANDWIDTH
BANDWIDTH
200 to 1000 Mbps
6DoF video or Point Cloud
50 to 200 Mbps Next-gen 360° video
(8K, 90+ FPS, HDR, stereoscopic)
10 to 50 Mbps Current-gen
360° video (4K)
5 to 25 Mbps Two-way telepresence
2 to 20 Mbps 3D model
and data visualization
2 Mbps Video conferencing
1 Mbps Image and
workflow downloading
200-1000 Mbps
6 DoF video or Point Cloud
50.200 Mbps Next-gen 360° video
(BK, 90+ FPS, HDR, stereoscopic)
10-50 Mbps Current-gen
360° video (4K)
5-25 Mbps Two-way telepresence
2-20 Mbps 3D model
and data visualization
2Mbps Video conferencing
1 Mbps Image and
workflow downloading
6
AUGMENTED AND VIRTUAL REALITY: THE FIRST WAVE OF 5G KILLER APPSwww.abiresearch.com
Nevertheless, mmWave shows great promise, and highlights one technology candidate for 5G NR that is not
a simple evolution of existing 4G technologies. Lab trials are now advancing to field trials, and will soon cre-
ate the mmWave radio technologies capable of supporting commercial networks. The speeds required by
certain AR and VR applications will reach the Gbps limit of 4G networks, meaning that mmWave may be a key
enabling technology for these applications. In addition to these higher bands, initial 5G NR deployments in
licensed spectrum are also targeting lower spectrum bands, such as new spectrum around 3 GHz and 4 GHz.
LATENCY
Latency plays an important role for AR and VR experiences, but it is important to understand when low
latency is crucial and what type of latency is being discussed.
Latency is Critical for Interactive AR and VR User Experiences
For non-interactive content that can use a buffer, such as a streamed 360° video, network latency is generally
not an issue if the buffer remains, making this content more tolerant to higher and inconsistent latency.
Interactive content, on the other hand, is more susceptible to network latency. Low latency is required to
ensure responsiveness for certain user interactions, such as virtually shooting an opponent in online multi-
player gaming, playing virtual ping pong, controlling remote machinery, or interactively collaborating on a
vehicle design. In these scenarios, the visuals require a full rendering of the scene based on the additional
interactions. If the network is transporting the interaction information, then a reduction in latency is
paramount to the experience (e.g., it may be the determining factor between shooting your opponent or
being shot by your opponent).
Head movement while wearing an HMD with head tracking is another specific interaction with distinct latency
requirements that warrants more discussion. Motion-to-photon (MTP) latency is the time between an action
(a head movement) and reaction (the display is updated based on the movement). When a user moves their
head, the brain expects an instantaneous visual and aural update, so delaying that even minutely can be
problematic. A MTP latency below 20 ms is currently targeted for many VR user experiences, but studies have
shown that achieving a MTP latency of less than 15 ms makes the delay imperceptible to nearly all users.
Considering the strict MTP requirements associated with HMD usage, ABI Research expects that AR and VR
applications will keep MTP processing on the device (the HMD itself). There are hybrid-computing scenarios
where 3D rendering happens off the device. PCs and game consoles tethered to VR HMDs are available
today, while network edge or cloud rendering may be possible in the future. For these hybrid scenarios,
ABI research expects that the processing will be intelligently split between cloud-based 3D rendering, which
requires low network latency, and additional processing on the untethered mobile device to ensure high-
quality visuals at a fixed low MTP latency.
7
AUGMENTED AND VIRTUAL REALITY: THE FIRST WAVE OF 5G KILLER APPSwww.abiresearch.com
5G Latency Improvements
A major requirement of the 5G standard is ultra-low latency, with a targeted 1 ms roundtrip latency over the
air. While 4G has already improved latency over 3G by flattening the network architecture, 3GPP is now also
working to reduce over-the-air latency closer to the 1 ms range, guaranteeing an even lower latency.
Strict latency requirements that go beyond the air-interface latency are not specifically defined in standards
because they should include additional network transport components that are scenario and deployment
dependent. For example, a latency-sensitive application may require proprietary components today that
are tightly integrated to deliver this functionality specifically, e.g., real-time banking transactions. This may
translate to specific functionality at the base station, specific core network components, and proprietary
software at the network control and business system domain. On the other hand, 5G promises to offer this
functionality through a standardized and consistent manner.
Moving content and network functionality to the edge of the network can reduce latency, which will be
required for applications heavily dependent on ultra-low latency. Applications that are required to span
end-to-end, such as remote machinery control, will require 5G at least when dealing with long distances
between nodes.
Figure 2: Network topology will significantly impact content delivery latency and thus
user experience. The diagram shows three different network topologies and their
associated latencies.
(Source: ABI Research)
LOCAL SOURCE
Telco Edge: 1 to 2 ms
Telco Cloud: 20 to 50 ms
Public Cloud: 50 to 100 ms
ORIGINAL SOURCE (CLOUD)
Application point
Base station/
network edge Core network Internet
Application (CSP) Application (OTT)
8
AUGMENTED AND VIRTUAL REALITY: THE FIRST WAVE OF 5G KILLER APPSwww.abiresearch.com
5G latency can be broken down into three network topologies, assuming a roundtrip ping scenario:
▪▪ Public cloud to device: 50 ms to 100 ms
▪▪ Telco cloud to device: 20 ms to 50 ms
▪▪ Telco edge to device: 1 ms to 2 ms
These latency figures were derived from background research, including 5G-PPP targets3,
ETSI, and ITU
documents4
, and real-life 3G and 4G network latencies5. As 5G network architectures are yet undecided, it
is not clear what end-to-end latencies will be achieved. The 1 ms over-the-air latency target for certain 5G
use cases is very aggressive, but ABI Research has assumed latencies of this order may be achievable if an
application is hosted at the edge of the network, e.g., in a Mobile-Edge Computing (MEC) server. For public
cloud and telco cloud to device scenarios, core network improvements can be expected as 5G is built out,
and the latency numbers quoted above will most likely become significantly lower.
The needs of each use case will dictate the network topology. For instance, a stadium can house content
on-premises at the network edge, allowing for near-immediate upstream and downstream. On the other
hand, mobile video streaming may need to stretch to the telco cloud or public cloud to access content.
UNIFORM EXPERIENCE
Enabling ultra-fast connections is relatively straight-forward; making sure that users get a consistent
experience with ultra-fast connectivity is not. Reliably delivering bandwidth to a significant portion of mobile
users is equally important and cannot be understated for AR and VR use cases. For example, delivering 10
Gbps to a stationary user with strong coverage is one thing, but maintaining an acceptable signal as the user
reaches network edges, while minimizing low data rate areas, is paramount for AR and VR applications where
stutter, lag, and general disruption is unacceptable for user experience and comfort.
High mobility use cases further emphasize this. For example, buffering video is much more disruptive
while using an HMD with head tracking than on a traditional display. Also, highly variable network speeds
can disrupt experiences in other ways. In highly immersive VR applications, picture quality fluctuations from
adaptive bitrate can be distracting. Inconsistent roundtrip latency for input can also emerge from poor
network uniformity, disrupting user experience and potentially barring input-critical applications from use.
5G is attempting to solve this challenge through two different methods: by becoming the “network of
networks” that consolidates all previous networks into one and by introducing further advancements in
network capabilities that also improve uniformity, including:
▪▪ The use of a large number of antennas (referred to as Massive MIMO) to steer the signal energy to the user’s
location increases both uniformity and overall capacity. IMT-2020 requirements call for >100 Mbps user
throughput, even at cell edges, and not just multi-Gbps peak user data rates.
▪▪ Simultaneous multi-connectivity, in which a user is simultaneously connected to multiple 5G access points
and across 4G and Wi-Fi deployments, will also increase uniformity. One key example is when a user may be
simultaneously connected to a 5G mmWave and a 4G access point, providing a seamless mobility experience
and the ability to send data on both links.
9
AUGMENTED AND VIRTUAL REALITY: THE FIRST WAVE OF 5G KILLER APPSwww.abiresearch.com
EARLY AR AND VR USE CASES AND 5G NETWORK REQUIREMENTS
AR and VR offer an immense number of promising applications. In enterprise verticals, AR and VR offer
promising ROI, improved safety, and novel workforce capabilities, while in the consumer space, users are
promised immersive content and new social experiences. Delivering these use cases from source to end
user will tax existing networks and require the advantages of 5G to properly function.
This paper explores four uses cases: high mobility using automotive, high-capacity venue upload, high-band-
width 6DoF experiences, and low-latency remote control, and to certain extent, tactile Internet, to exemplify
the requirements that VR and AR impose on 5G in terms of capacity, uniformity, and latency.
Figure 3: The four AR and VR use cases described in this paper require 5G. The diagram shows
the approximate connectivity requirements in terms of latency (x-axis) and capacity (y-axis) for
each use case. Uniform experience, although not shown, is also required for each use case.
Latency sensitive
Capacitysensitive
Best-effort
data access
Stadium
content upload
Automotive video
streaming
Tactile internet
Live 6DoF video
4G USER CASE
5G USER CASES
(Source: ABI Research)
HIGH MOBILITY EXAMPLE: AUTOMOTIVE VIDEO STREAMING
Current roadmaps suggest a working, but expanding 5G network map starting around 2020. Within that
timeframe, the automotive landscape will also start to transition to semi-autonomous and fully autonomous
vehicles, unlocking additional time for entertainment and productivity. Passengers in a traditionally piloted
car or a “driver” and passengers in a fully autonomous vehicle will consume compelling AR and VR content
10
AUGMENTED AND VIRTUAL REALITY: THE FIRST WAVE OF 5G KILLER APPSwww.abiresearch.com
while commuting. This use case is especially challenging for two reasons: high capacity and high mobility of
users. The massive bandwidth associated with premium AR and VR content causes capacity requirements to
scale up quickly, while users rapidly transition between cells.
As an example, traffic during rush hour on a highway can be dense. Assume that:
▪▪ Each car is 3 meters long and leaves a 9-meter gap between the car in front while driving 16 km/h.
The highway has 8 lanes to be served.
▪▪ One cell tower is located directly at the highway with a cell radius of 500 meters, thus covering a stretch of 1
km serving ~667 cars.
▪▪ There is some level of autonomous driving in this timeframe. Assume that there are 1.0 potential AR/VR users
(passengers of non-autonomous vehicles, or “drivers” and passengers of autonomous vehicles) per car due
to increased carpooling, and that the penetration rate of AR or VR usage is 1%. Thus, we would have 0.01 VR
or AR users per car.
If each VR or AR app consumes 100 Mbps, then this use case would consume 667 Mbps (667 cars x 0.01
users per car x 100 Mbps). For 10 bps/Hz spectral efficiency, the cell site would require 67 MHz of spec-
trum to support this capacity need. As autonomous cars reach the mass market, the percentage of people
using AR or VR in the car increases, and thus the capacity required will increase significantly. Continuing the
example with 10% penetration rate, we would need 10X more capacity, which can be solved through cell
densification (decreasing the cell radius to less than 500 meters in this example) and more spectrum (which
is only available at higher bands, including mmWave).
With mobility, network handoff can be troublesome for streaming content, but 5G adds the concept
of simultaneous multi-connectivity to remove the need for a traditional handoff. Simultaneous multi-con-
nectivity is especially helpful in this case since the user can simultaneously receive data from two cell sites in
range, which also helps to create a more uniform experience. In addition, the potential for 200 Mbps bitrate
streams highlights the necessity for 5G’s promise of a more uniform and higher capacity network.
High Mobility Automotive Video Streaming
Required Pillars of 5G Capacity • Mobility • Uniformity
Technical challenge: Ubiquitous mobile multi-Gbps connections Multiples of 100 MHz of spectrum per cell
HIGH CAPACITY EXAMPLE: SOCIAL SHARING FROM EVENT VENUES
Much attention is paid to downstream bandwidth with 5G. However, the upload side of the story is equally
interesting and important, especially with the simultaneous usage of applications that would take place in a
crowded event venue like a stadium. Not only will stadium goers be able to reliably and quickly upload their
content, but those outside the venue will have a large selection of content to view. Social media services
11
AUGMENTED AND VIRTUAL REALITY: THE FIRST WAVE OF 5G KILLER APPSwww.abiresearch.com
like Facebook Live, Periscope, Instagram, and Snapchat are made possible with highly connected and highly
capable capture devices, such as AR glasses, smartphones, or other 360° cameras. The potential for tens of
thousands of users to simultaneously upload content could bog down a network, and this is exacerbated
in the 5G timeline with content increasing in complexity and size (e.g., pictures migrating to 360° videos).
Imagine being at the Super Bowl and trying to live stream the kickoff, along with 50,000 other fans, using the
multiple cameras in your convenient and hands-free AR glasses. That could easily be a 1.25 Tbps spike in
bandwidth (4K 360° video @ 25 Mbps x 50,000 users) within the area of the stadium (0.1 km2
), reaching a to-
tal capacity of 12.5 Tbps/km2
(=12.5 Mbps/m2
). Fans at home using VR will be able to enjoy these experiences
in real time and feel like they are at the game as long as the network is not bogged down. For reference, IMT-
2020 targets traffic capacity of 10 Mbps/m2
, which this scenario approaches or could exceed.
A stadium network implementation has the advantage of a more accessible edge network infrastructure, al-
lowing for content created both on-site and externally to be housed on the edge for very low latency delivery.
In a sporting venue, low latency is equally as important for downstream and upstream applications. Support-
ing high upload concurrency of rich data, with low delay, allows for near real-time content updates. On-site
value-add stadium experiences, such as games, interactive video, crowd participation, etc., can be enabled
with near real-time upload as well. This is especially pertinent as compelling home sports content consump-
tion grows, and ticket sales are endangered. With many fans questioning whether tickets are worthwhile
when their home viewing experience can be equal or better in some situations, these unique experiences
can drive interest back to the stadium.
Stadium Content Upload
Required Pillars of 5G Capacity • Uniformity • Latency
Technical challenge: Total capacity per area 12.5 Mbps/m2
HIGH BANDWIDTH EXAMPLE: 6DOF CONTENT
Next-generation VR and AR experiences will have 6DoF for the next level of immersion, allowing users to
move within and intuitively interact with the environment. 6DoF content is an order of magnitude richer in
naturalness and interactivity than 3 degrees of freedom (3DoF) video. Current 3DoF experiences, such as
360° video, allow the user to rotationally look around from a fixed position. 6DoF experiences, which are
available in video games today, allow the user to move spatially through the environment just by walking
or leaning the head forward. 6DoF head motion tracking is required to enjoy 6DoF content in an intuitive
manner. One solution to provide precise 6DoF head motion tracking is visual-inertial odometry (VIO), which
estimates the relative position and orientation of a moving device in an unknown environment using a cam-
era and motion sensors. A huge advantage of VIO is that it can be processed on the HMD with no additional
setup for a truly mobile experience, unlike other solutions that require external sensors, markers, cameras,
or lasers to be set up throughout the room.
12
AUGMENTED AND VIRTUAL REALITY: THE FIRST WAVE OF 5G KILLER APPSwww.abiresearch.com
Synthetic (computer-generated) 6DoF environments can be rendered in the cloud today, while 6DoF video,
sometimes referred to as “point cloud video,” is in its early stages. Sports, tourism, education, and other
forms of immersive video will flourish as 6DoF technologies evolve, but the current state is nascent. Most
components of the video delivery pipeline are currently ill-suited for 6DoF video, including capture devices,
production software, codecs, compression algorithms, the network, and players. 6DoF video also demands
bit-rates in the range of 200 Mbps to 1 Gbps depending on the end-to-end latency. Overall, the pipeline must
mature to enable the 6DoF content.
For these reasons, streaming live 6DoF content to deliver a “be there” experience is certainly a compelling
and forward-looking use case, but also one that will require 5G and beyond. While streamed 3DoF video
(360° video) content traditionally can cope with network latency via a jitter buffer, the rendering of 6DoF
content is dependent on the user’s head and body movements; hence, it is sensitive to bi-directional end-
to-end latency as well. This use case is akin to streaming a video game, so end-to-end latencies must be on
the order of a few tens of milliseconds. Network operators should be aware that a trade-off between latency
and bandwidth exists for 6DoF content delivery. With lower end-to-end latency for communicating the user’s
movement, fewer viewpoints around the user need to be sent. For example, when end-to-end latency is on
the order of 1 ms to 5 ms, then the bit-rate for 6DoF content can be reduced to ~100 Mbps to 200 Mbps.
However, if the end-to-end latency of the system is 5 ms to 20 ms, then the bit-rate is closer to ~400 Mbps to
600 Mbps, because more viewpoints around the user need to be sent. As a result of this, 6DoF content will
most likely be limited to edge streaming scenarios during the 5G timeframe.
6DoF Experiences
Required Pillars of 5G Capacity • Latency • Uniformity
Technical challenges: User throughput (bit-rate) & Latency
200 Mbps to 1,000 Mbps
< 20 ms, the lower latency the better
LOW LATENCY EXAMPLE: REMOTE CONTROL AND TACTILE INTERNET
Remote collaboration through telepresence is a huge boon for enterprise use cases powered by AR and VR.
Truly interactive remote experiences require low end-to-end latency often ranging from 40 ms to 300 ms,
depending on the use case.6
In general, reduced latency increases the amount of interactivity possible, thus
expanding potential use cases to things like remote medical procedures, collaborative remote manipulation
of objects, and online gaming. Remote machinery control through user-guided tele-operation, such as a re-
mote control forklift, has a roundtrip latency threshold of ~100 ms. Consider that a single roundtrip commu-
nication between two mobile endpoints may involve four wireless link traversals (that equals two over-the-air
roundtrips and two networks’ transport legs). When accounting for processing latency within the endpoints,
multiple edge network traversals, core network latency, and physical distance latency, it becomes clear that
low-latency 5G edge networks are essential to achieving remote interactivity for AR and VR. As an example,
enabling sub-40 ms end-to-end latency may require as little as 5 ms roundtrip latency for each of the two
links if we allow for a 30 ms delay to the network.
13
AUGMENTED AND VIRTUAL REALITY: THE FIRST WAVE OF 5G KILLER APPSwww.abiresearch.com
Looking beyond the remote machine control of today to the tactile Internet of the future, research suggests
that ultra-low latency feedback below 5 ms will enable novel uses of multi-sensory remote tactile control with
responses rapid enough to be imperceptible to the operator.7
Use cases, such as vehicle control, with fast
motion involving the user, environment, or an object, require these ultra-low latencies, as latency is more
perceptible in these cases.
Near-field remote control is most feasible early on and is a promising application of 5G with AR and VR. As
5G continues to evolve and be built out, long-range tactile Internet applications come into focus and become
more attainable with 5G’s aggressive latency promises.
Remote Machinery Control
Required Pillars of 5G Latency • Uniformity
Technical Challenge: Latency < 5 ms latency for tactile Internet
CONCLUSION
5G is envisioned to bring higher capacity, a uniform experience, and lower overall latency—all of which are
critical for AR and VR applications over a network—while also reducing the cost per bit. This white paper
outlined four examples of AR and VR requiring 5G to empower new user experiences and improve existing
ones as the number of users increases.
Semi-autonomous and fully autonomous vehicles present additional time for content consumption, but also
challenging mobility and capacity requirements for network streaming. Applications at densely populated
stadiums are already stressing wireless networks, and content upload by thousands of simultaneous users
at a stadium will demand capacity on the order of 10 Mbps/m2
. The impressive growth of video will only be-
come more substantial as AR and VR grow in market share, with next-generation content formats like 6DoF
video stressing networks even more with individual data consumption in the range of 200 Mbps to 1 Gbps.
Ideal end-to-end latency requirements in the 10 ms range for remote machinery control and tactile Internet
will also push the boundaries of these networks, and could require over-the-air latencies as low as 1 ms. In
a way, the AR and VR industry is thirsty for the capabilities 5G promises and this is a profound change in the
way cellular networks have traditionally been developed: if you build it (the network), they will come (applica-
tions and users).
The uses cases outlined above illustrate that current 4G networks and their evolution will not be able to
sustain a consistent user experience for many AR and VR applications, without which the industry will not be
able to build solid business cases for these applications. Moreover, new use cases for AR and VR will manifest
as the capabilities of 5G networks actualize. ABI Research expects AR and VR to transform industries, and 5G
will be crucial in making that a reality.
14
AUGMENTED AND VIRTUAL REALITY: THE FIRST WAVE OF 5G KILLER APPSwww.abiresearch.com
ACKNOWLEDGEMENTS:
This study is sponsored by Qualcomm and focuses on why 5G is needed for AR and VR use cases, aiming
to discuss key opportunities and challenges. ABI Research would like to thank the Qualcomm AR/VR and 5G
teams for helping us to navigate through the technology complexity of AR/VR and to identify the role 5G will
play in enabling many AR/VR use cases.
ABOUT QUALCOMM:
Qualcomm’s technologies powered the smartphone revolution and connected billions of people. Qualcomm
pioneered 3G and 4G, and now is leading the way to 5G and a new era of intelligent, connected devices.
Its products are revolutionizing industries, including automotive, computing, IoT, healthcare, and data cen-
ters, and allowing millions of devices to connect with each other in ways never before imagined. Qualcomm
Incorporated includes its licensing business, QTL, and the vast majority of its patent portfolio. Qualcomm
Technologies, Inc., a subsidiary of Qualcomm Incorporated, operates, along with its subsidiaries, all of Qual-
comm’s engineering, research and development functions, and all of its products and services businesses,
including, its QCT semiconductor business. For more information, visit Qualcomm’s website, OnQ blog, Twit-
ter, and Facebook pages.
ABOUT ABI RESEARCH:
Innovative business leaders trust ABI Research to help make transformative technology decisions. For more
than 25 years, ABI Research has been embedded in the planning and workflows of the world’s leading tech-
nology and innovation organizations. ABI Research is their execution partner, providing business intelligence
and accelerating their overall decision-making process to more quickly and confidently execute strategies.
15
AUGMENTED AND VIRTUAL REALITY: THE FIRST WAVE OF 5G KILLER APPSwww.abiresearch.com
REFERENCES:
1 “Standards development for broadband wireless access,” Colin Langtry, ITU Radiocommunication Bureau,
https://www.itu.int/net4/wsis/forum/2016/Content/AgendaFiles/document/9d6c7b67-33a7-4ac6-96c7-
ebf2231d83c2/ITU-BR_Colin_Langtry.pdf.
2. “HDR Starts to Roll amid Growing Clarity on Bitrate & Quality Issues,” ScreenPlays Magazine,
http://www.screenplaysmag.com/2015/10/02/hdr-starts-to-role-amid-growing-clarity-on-bitrate-quality-
issues/.
3. “View on 5G Architecture,” 5G PPP Architecture Working Group, https://5g-ppp.eu/wp-content/
uploads/2014/02/5G-PPP-5G-Architecture-WP-For-public-consultation.pdf.
4. “Standards development for broadband wireless access,” Colin Langtry, ITU Radiocommunication Bu-
reau, https://www.itu.int/net4/wsis/forum/2016/Content/AgendaFiles/document/9d6c7b67-33a7-4ac6-
96c7-ebf2231d83c2/ITU-BR_Colin_Langtry.pdf.
5. “State of Mobile Networks: USA,” OpenSignal, February 2016, https://opensignal.com/reports/2016/02/
usa/state-of-the-mobile-network/.
6. “A Distributed Architecture for Multiplayer Interactive Applications on the Internet,” IEEE, http://ieeex-
plore.ieee.org/document/777437/
7. “The Tactile Internet: ITU-T Technology Watch Report,” August 2014, https://www.itu.int/dms_pub/itu-t/
oth/23/01/T23010000230001PDFE.pdf.
Published February 1, 2017
©2017 ABI Research
249 South Street
Oyster Bay, New York 11771 USA
Tel: +1 516-624-2500
www.abiresearch.com
© 2017 ABI Research. Used by permission. ABI Research is an independent producer of market analysis and insight and this ABI Research
product is the result of objective research by ABI Research staff at the time of data collection. The opinions of ABI Research or its analysts on any
subject are continually revised based on the most current data available. The information contained herein has been obtained from sources believed to
be reliable. ABI Research disclaims all warranties, express or implied, with respect to this research, including any warranties of merchantability or fitness
for a particular purpose.
www.abiresearch.com

More Related Content

What's hot

Ericsson Technology Review: Simplifying the 5G ecosystem by reducing architec...
Ericsson Technology Review: Simplifying the 5G ecosystem by reducing architec...Ericsson Technology Review: Simplifying the 5G ecosystem by reducing architec...
Ericsson Technology Review: Simplifying the 5G ecosystem by reducing architec...Ericsson
 
See the driving force and challenge of 6G in 7 major dimensions - C&T RF Ante...
See the driving force and challenge of 6G in 7 major dimensions - C&T RF Ante...See the driving force and challenge of 6G in 7 major dimensions - C&T RF Ante...
See the driving force and challenge of 6G in 7 major dimensions - C&T RF Ante...Antenna Manufacturer Coco
 
5G - Vision for the next generation of connectivity
5G - Vision for the next generation of connectivity5G - Vision for the next generation of connectivity
5G - Vision for the next generation of connectivityQualcomm Research
 
What's in the future of 5G millimeter wave?
What's in the future of 5G millimeter wave? What's in the future of 5G millimeter wave?
What's in the future of 5G millimeter wave? Qualcomm Research
 
The essential role of technology standards
The essential role of technology standardsThe essential role of technology standards
The essential role of technology standardsQualcomm Research
 
Turn on 5G with Ericsson 5G Platform
Turn on 5G with Ericsson 5G PlatformTurn on 5G with Ericsson 5G Platform
Turn on 5G with Ericsson 5G PlatformEricsson
 
5G positioning for the connected intelligent edge
5G positioning for the connected intelligent edge5G positioning for the connected intelligent edge
5G positioning for the connected intelligent edgeQualcomm Research
 
5g, creating everything connection architecture - C&T RF Antennas Inc
5g, creating everything connection architecture - C&T RF Antennas Inc5g, creating everything connection architecture - C&T RF Antennas Inc
5g, creating everything connection architecture - C&T RF Antennas IncAntenna Manufacturer Coco
 
Ericsson Technology Review: 5G evolution: 3GPP releases 16 & 17 overview (upd...
Ericsson Technology Review: 5G evolution: 3GPP releases 16 & 17 overview (upd...Ericsson Technology Review: 5G evolution: 3GPP releases 16 & 17 overview (upd...
Ericsson Technology Review: 5G evolution: 3GPP releases 16 & 17 overview (upd...Ericsson
 
From broadband to 5G
From broadband to 5GFrom broadband to 5G
From broadband to 5GDamjan Slapar
 
Mavenir: Why and How Private LTE & 5G Networks Are Rapidly Evolving for Enter...
Mavenir: Why and How Private LTE & 5G Networks Are Rapidly Evolving for Enter...Mavenir: Why and How Private LTE & 5G Networks Are Rapidly Evolving for Enter...
Mavenir: Why and How Private LTE & 5G Networks Are Rapidly Evolving for Enter...Mavenir
 
Understanding 5G, Benefits of 5G courses
Understanding 5G, Benefits of 5G coursesUnderstanding 5G, Benefits of 5G courses
Understanding 5G, Benefits of 5G coursesBryan Len
 

What's hot (20)

Ericsson Technology Review: Simplifying the 5G ecosystem by reducing architec...
Ericsson Technology Review: Simplifying the 5G ecosystem by reducing architec...Ericsson Technology Review: Simplifying the 5G ecosystem by reducing architec...
Ericsson Technology Review: Simplifying the 5G ecosystem by reducing architec...
 
See the driving force and challenge of 6G in 7 major dimensions - C&T RF Ante...
See the driving force and challenge of 6G in 7 major dimensions - C&T RF Ante...See the driving force and challenge of 6G in 7 major dimensions - C&T RF Ante...
See the driving force and challenge of 6G in 7 major dimensions - C&T RF Ante...
 
NB-IoT and 5G
NB-IoT and 5GNB-IoT and 5G
NB-IoT and 5G
 
5G - Vision for the next generation of connectivity
5G - Vision for the next generation of connectivity5G - Vision for the next generation of connectivity
5G - Vision for the next generation of connectivity
 
What's in the future of 5G millimeter wave?
What's in the future of 5G millimeter wave? What's in the future of 5G millimeter wave?
What's in the future of 5G millimeter wave?
 
5g tutorial
5g tutorial5g tutorial
5g tutorial
 
5G Technology
5G Technology5G Technology
5G Technology
 
The essential role of technology standards
The essential role of technology standardsThe essential role of technology standards
The essential role of technology standards
 
Turn on 5G with Ericsson 5G Platform
Turn on 5G with Ericsson 5G PlatformTurn on 5G with Ericsson 5G Platform
Turn on 5G with Ericsson 5G Platform
 
5G positioning for the connected intelligent edge
5G positioning for the connected intelligent edge5G positioning for the connected intelligent edge
5G positioning for the connected intelligent edge
 
Parallel Wireless Webinar: 5G at #MWC19
Parallel Wireless Webinar: 5G at #MWC19Parallel Wireless Webinar: 5G at #MWC19
Parallel Wireless Webinar: 5G at #MWC19
 
5G TO MARS
5G TO MARS5G TO MARS
5G TO MARS
 
5g, creating everything connection architecture - C&T RF Antennas Inc
5g, creating everything connection architecture - C&T RF Antennas Inc5g, creating everything connection architecture - C&T RF Antennas Inc
5g, creating everything connection architecture - C&T RF Antennas Inc
 
5G in Europe 2020
5G in Europe 20205G in Europe 2020
5G in Europe 2020
 
5G Technology
5G Technology5G Technology
5G Technology
 
Ericsson Technology Review: 5G evolution: 3GPP releases 16 & 17 overview (upd...
Ericsson Technology Review: 5G evolution: 3GPP releases 16 & 17 overview (upd...Ericsson Technology Review: 5G evolution: 3GPP releases 16 & 17 overview (upd...
Ericsson Technology Review: 5G evolution: 3GPP releases 16 & 17 overview (upd...
 
From broadband to 5G
From broadband to 5GFrom broadband to 5G
From broadband to 5G
 
Economics of 4G Introduction in Growth Markets
Economics of 4G Introduction in Growth MarketsEconomics of 4G Introduction in Growth Markets
Economics of 4G Introduction in Growth Markets
 
Mavenir: Why and How Private LTE & 5G Networks Are Rapidly Evolving for Enter...
Mavenir: Why and How Private LTE & 5G Networks Are Rapidly Evolving for Enter...Mavenir: Why and How Private LTE & 5G Networks Are Rapidly Evolving for Enter...
Mavenir: Why and How Private LTE & 5G Networks Are Rapidly Evolving for Enter...
 
Understanding 5G, Benefits of 5G courses
Understanding 5G, Benefits of 5G coursesUnderstanding 5G, Benefits of 5G courses
Understanding 5G, Benefits of 5G courses
 

Viewers also liked

augmented reality paper presentation
augmented reality paper presentationaugmented reality paper presentation
augmented reality paper presentationVaibhav Mehta
 
Providing the connectivity fabric for everything
Providing the connectivity fabric for everythingProviding the connectivity fabric for everything
Providing the connectivity fabric for everythingQualcomm Research
 
Virtual Reality / Augmented Reality State of the Art February 2017
Virtual Reality / Augmented Reality State of the Art February 2017Virtual Reality / Augmented Reality State of the Art February 2017
Virtual Reality / Augmented Reality State of the Art February 2017Angel Gutierrez Borjabad
 
Automated & Autonomous Driving
Automated & Autonomous DrivingAutomated & Autonomous Driving
Automated & Autonomous DrivingRoger Atkins
 
[Paper Presentation] FoveAR: Combining an Optically See-Through Near-Eye Disp...
[Paper Presentation] FoveAR: Combining an Optically See-Through Near-Eye Disp...[Paper Presentation] FoveAR: Combining an Optically See-Through Near-Eye Disp...
[Paper Presentation] FoveAR: Combining an Optically See-Through Near-Eye Disp...Pei-Hsuan (Ike) Tsai
 
seminar on 5g Technology
seminar on 5g Technologyseminar on 5g Technology
seminar on 5g Technologylipunjena
 
MulteFire Technology Progress and Benefits
MulteFire Technology Progress and BenefitsMulteFire Technology Progress and Benefits
MulteFire Technology Progress and BenefitsQualcomm Research
 
Augmented reality, avatars and paper hats: engaging students in their learnin...
Augmented reality, avatars and paper hats: engaging students in their learnin...Augmented reality, avatars and paper hats: engaging students in their learnin...
Augmented reality, avatars and paper hats: engaging students in their learnin...IL Group (CILIP Information Literacy Group)
 
Seminar report on Fifth Generation of Wireless Technologies
Seminar report on Fifth Generation of Wireless TechnologiesSeminar report on Fifth Generation of Wireless Technologies
Seminar report on Fifth Generation of Wireless TechnologiesAbhijith Sambasivan
 
Paving the path to Narrowband 5G with LTE IoT
Paving the path to Narrowband 5G with LTE IoTPaving the path to Narrowband 5G with LTE IoT
Paving the path to Narrowband 5G with LTE IoTQualcomm Research
 
Cellular V2X is Gaining Momentum
Cellular V2X is Gaining MomentumCellular V2X is Gaining Momentum
Cellular V2X is Gaining MomentumQualcomm Research
 
Overview 5G Architecture Options from Deutsche Telekom
Overview 5G Architecture Options from Deutsche TelekomOverview 5G Architecture Options from Deutsche Telekom
Overview 5G Architecture Options from Deutsche TelekomEiko Seidel
 
AT&T View on LTE to 5G Network Migration
AT&T View on LTE to 5G Network Migration AT&T View on LTE to 5G Network Migration
AT&T View on LTE to 5G Network Migration Eiko Seidel
 
5G Network Architecture and Design
5G Network Architecture and Design5G Network Architecture and Design
5G Network Architecture and Design3G4G
 
3GPP Standards for the Internet-of-Things
3GPP Standards for the Internet-of-Things3GPP Standards for the Internet-of-Things
3GPP Standards for the Internet-of-ThingsEiko Seidel
 

Viewers also liked (18)

augmented reality paper presentation
augmented reality paper presentationaugmented reality paper presentation
augmented reality paper presentation
 
Making 5G NR a reality
Making 5G NR a realityMaking 5G NR a reality
Making 5G NR a reality
 
Providing the connectivity fabric for everything
Providing the connectivity fabric for everythingProviding the connectivity fabric for everything
Providing the connectivity fabric for everything
 
Virtual Reality / Augmented Reality State of the Art February 2017
Virtual Reality / Augmented Reality State of the Art February 2017Virtual Reality / Augmented Reality State of the Art February 2017
Virtual Reality / Augmented Reality State of the Art February 2017
 
5G
5G5G
5G
 
Automated & Autonomous Driving
Automated & Autonomous DrivingAutomated & Autonomous Driving
Automated & Autonomous Driving
 
[Paper Presentation] FoveAR: Combining an Optically See-Through Near-Eye Disp...
[Paper Presentation] FoveAR: Combining an Optically See-Through Near-Eye Disp...[Paper Presentation] FoveAR: Combining an Optically See-Through Near-Eye Disp...
[Paper Presentation] FoveAR: Combining an Optically See-Through Near-Eye Disp...
 
seminar on 5g Technology
seminar on 5g Technologyseminar on 5g Technology
seminar on 5g Technology
 
MulteFire Technology Progress and Benefits
MulteFire Technology Progress and BenefitsMulteFire Technology Progress and Benefits
MulteFire Technology Progress and Benefits
 
Augmented reality, avatars and paper hats: engaging students in their learnin...
Augmented reality, avatars and paper hats: engaging students in their learnin...Augmented reality, avatars and paper hats: engaging students in their learnin...
Augmented reality, avatars and paper hats: engaging students in their learnin...
 
Seminar report on Fifth Generation of Wireless Technologies
Seminar report on Fifth Generation of Wireless TechnologiesSeminar report on Fifth Generation of Wireless Technologies
Seminar report on Fifth Generation of Wireless Technologies
 
5G 2
5G 25G 2
5G 2
 
Paving the path to Narrowband 5G with LTE IoT
Paving the path to Narrowband 5G with LTE IoTPaving the path to Narrowband 5G with LTE IoT
Paving the path to Narrowband 5G with LTE IoT
 
Cellular V2X is Gaining Momentum
Cellular V2X is Gaining MomentumCellular V2X is Gaining Momentum
Cellular V2X is Gaining Momentum
 
Overview 5G Architecture Options from Deutsche Telekom
Overview 5G Architecture Options from Deutsche TelekomOverview 5G Architecture Options from Deutsche Telekom
Overview 5G Architecture Options from Deutsche Telekom
 
AT&T View on LTE to 5G Network Migration
AT&T View on LTE to 5G Network Migration AT&T View on LTE to 5G Network Migration
AT&T View on LTE to 5G Network Migration
 
5G Network Architecture and Design
5G Network Architecture and Design5G Network Architecture and Design
5G Network Architecture and Design
 
3GPP Standards for the Internet-of-Things
3GPP Standards for the Internet-of-Things3GPP Standards for the Internet-of-Things
3GPP Standards for the Internet-of-Things
 

Similar to ABI Research White Paper: Augmented and Virtual Reality: The First Wave of 5G Killer Apps

Is 5G The Future of Mobile App Development?
Is 5G The Future of Mobile App Development?Is 5G The Future of Mobile App Development?
Is 5G The Future of Mobile App Development?Consagous Technologies
 
Understanding the Concepts of 5G
Understanding the Concepts of 5G Understanding the Concepts of 5G
Understanding the Concepts of 5G AmoaniIchManuel
 
5G in Africa - Prospects and strategic decisions
5G in Africa - Prospects and strategic decisions5G in Africa - Prospects and strategic decisions
5G in Africa - Prospects and strategic decisionsRussell Southwood
 
Reaching_5G_Plateau_of_Productivity_ Guavus_eBook_2019_.pdf
Reaching_5G_Plateau_of_Productivity_ Guavus_eBook_2019_.pdfReaching_5G_Plateau_of_Productivity_ Guavus_eBook_2019_.pdf
Reaching_5G_Plateau_of_Productivity_ Guavus_eBook_2019_.pdfcarlosm563
 
Indoor-5G-Scenario-Oriented-White-Paper-en (1).pdf
Indoor-5G-Scenario-Oriented-White-Paper-en (1).pdfIndoor-5G-Scenario-Oriented-White-Paper-en (1).pdf
Indoor-5G-Scenario-Oriented-White-Paper-en (1).pdfABDULRAHIMSHAIKH17
 
5G for Business Transformation
5G for Business Transformation5G for Business Transformation
5G for Business TransformationDhiman Chowdhury
 
How 5g Would Change the World | E-Lins Technology
How 5g Would Change the World | E-Lins TechnologyHow 5g Would Change the World | E-Lins Technology
How 5g Would Change the World | E-Lins TechnologyE-Lins Technology Co. Ltd.
 
What Makes 5G Network Different - Digital Nasional Berhad
What Makes 5G Network Different - Digital Nasional BerhadWhat Makes 5G Network Different - Digital Nasional Berhad
What Makes 5G Network Different - Digital Nasional BerhadDigitalNational
 
5 g network white paper
5 g network white paper 5 g network white paper
5 g network white paper Ravi Sharma
 
Gemalto Review: 5G Feature
Gemalto Review: 5G FeatureGemalto Review: 5G Feature
Gemalto Review: 5G FeatureNexus Publishing
 
WTS 2020 Rob van_den_dam
WTS 2020 Rob van_den_damWTS 2020 Rob van_den_dam
WTS 2020 Rob van_den_damRob Van Den Dam
 

Similar to ABI Research White Paper: Augmented and Virtual Reality: The First Wave of 5G Killer Apps (20)

Points for 5G Technology
Points for 5G TechnologyPoints for 5G Technology
Points for 5G Technology
 
Is 5G The Future of Mobile App Development?
Is 5G The Future of Mobile App Development?Is 5G The Future of Mobile App Development?
Is 5G The Future of Mobile App Development?
 
Understanding the Concepts of 5G
Understanding the Concepts of 5G Understanding the Concepts of 5G
Understanding the Concepts of 5G
 
5G
5G5G
5G
 
5G in Africa - Prospects and strategic decisions
5G in Africa - Prospects and strategic decisions5G in Africa - Prospects and strategic decisions
5G in Africa - Prospects and strategic decisions
 
Reaching_5G_Plateau_of_Productivity_ Guavus_eBook_2019_.pdf
Reaching_5G_Plateau_of_Productivity_ Guavus_eBook_2019_.pdfReaching_5G_Plateau_of_Productivity_ Guavus_eBook_2019_.pdf
Reaching_5G_Plateau_of_Productivity_ Guavus_eBook_2019_.pdf
 
5g technologies
5g technologies5g technologies
5g technologies
 
5g and IoT
5g and IoT5g and IoT
5g and IoT
 
Indoor-5G-Scenario-Oriented-White-Paper-en (1).pdf
Indoor-5G-Scenario-Oriented-White-Paper-en (1).pdfIndoor-5G-Scenario-Oriented-White-Paper-en (1).pdf
Indoor-5G-Scenario-Oriented-White-Paper-en (1).pdf
 
5G for Business Transformation
5G for Business Transformation5G for Business Transformation
5G for Business Transformation
 
How 5g Would Change the World | E-Lins Technology
How 5g Would Change the World | E-Lins TechnologyHow 5g Would Change the World | E-Lins Technology
How 5g Would Change the World | E-Lins Technology
 
5G Network
5G Network5G Network
5G Network
 
What Makes 5G Network Different - Digital Nasional Berhad
What Makes 5G Network Different - Digital Nasional BerhadWhat Makes 5G Network Different - Digital Nasional Berhad
What Makes 5G Network Different - Digital Nasional Berhad
 
Presentation.pptx
Presentation.pptxPresentation.pptx
Presentation.pptx
 
Quick Quote App Portfolio
Quick Quote App PortfolioQuick Quote App Portfolio
Quick Quote App Portfolio
 
Cor review2018-a
Cor review2018-aCor review2018-a
Cor review2018-a
 
When to use 5g and when to use wifi 6?
When to use 5g and when to use wifi 6?When to use 5g and when to use wifi 6?
When to use 5g and when to use wifi 6?
 
5 g network white paper
5 g network white paper 5 g network white paper
5 g network white paper
 
Gemalto Review: 5G Feature
Gemalto Review: 5G FeatureGemalto Review: 5G Feature
Gemalto Review: 5G Feature
 
WTS 2020 Rob van_den_dam
WTS 2020 Rob van_den_damWTS 2020 Rob van_den_dam
WTS 2020 Rob van_den_dam
 

More from Qualcomm Research

Generative AI at the edge.pdf
Generative AI at the edge.pdfGenerative AI at the edge.pdf
Generative AI at the edge.pdfQualcomm Research
 
Qualcomm Webinar: Solving Unsolvable Combinatorial Problems with AI
Qualcomm Webinar: Solving Unsolvable Combinatorial Problems with AIQualcomm Webinar: Solving Unsolvable Combinatorial Problems with AI
Qualcomm Webinar: Solving Unsolvable Combinatorial Problems with AIQualcomm Research
 
Why and what you need to know about 6G in 2022
Why and what you need to know about 6G in 2022Why and what you need to know about 6G in 2022
Why and what you need to know about 6G in 2022Qualcomm Research
 
Understanding the world in 3D with AI.pdf
Understanding the world in 3D with AI.pdfUnderstanding the world in 3D with AI.pdf
Understanding the world in 3D with AI.pdfQualcomm Research
 
Enabling the metaverse with 5G- web.pdf
Enabling the metaverse with 5G- web.pdfEnabling the metaverse with 5G- web.pdf
Enabling the metaverse with 5G- web.pdfQualcomm Research
 
Presentation - Model Efficiency for Edge AI
Presentation - Model Efficiency for Edge AIPresentation - Model Efficiency for Edge AI
Presentation - Model Efficiency for Edge AIQualcomm Research
 
Bringing AI research to wireless communication and sensing
Bringing AI research to wireless communication and sensingBringing AI research to wireless communication and sensing
Bringing AI research to wireless communication and sensingQualcomm Research
 
How will sidelink bring a new level of 5G versatility.pdf
How will sidelink bring a new level of 5G versatility.pdfHow will sidelink bring a new level of 5G versatility.pdf
How will sidelink bring a new level of 5G versatility.pdfQualcomm Research
 
Scaling 5G to new frontiers with NR-Light (RedCap)
Scaling 5G to new frontiers with NR-Light (RedCap)Scaling 5G to new frontiers with NR-Light (RedCap)
Scaling 5G to new frontiers with NR-Light (RedCap)Qualcomm Research
 
Realizing mission-critical industrial automation with 5G
Realizing mission-critical industrial automation with 5GRealizing mission-critical industrial automation with 5G
Realizing mission-critical industrial automation with 5GQualcomm Research
 
3GPP Release 17: Completing the first phase of 5G evolution
3GPP Release 17: Completing the first phase of 5G evolution3GPP Release 17: Completing the first phase of 5G evolution
3GPP Release 17: Completing the first phase of 5G evolutionQualcomm Research
 
AI firsts: Leading from research to proof-of-concept
AI firsts: Leading from research to proof-of-conceptAI firsts: Leading from research to proof-of-concept
AI firsts: Leading from research to proof-of-conceptQualcomm Research
 
Setting off the 5G Advanced evolution with 3GPP Release 18
Setting off the 5G Advanced evolution with 3GPP Release 18Setting off the 5G Advanced evolution with 3GPP Release 18
Setting off the 5G Advanced evolution with 3GPP Release 18Qualcomm Research
 
Enabling on-device learning at scale
Enabling on-device learning at scaleEnabling on-device learning at scale
Enabling on-device learning at scaleQualcomm Research
 
The essential role of AI in the 5G future
The essential role of AI in the 5G futureThe essential role of AI in the 5G future
The essential role of AI in the 5G futureQualcomm Research
 
How AI research is enabling next-gen codecs
How AI research is enabling next-gen codecsHow AI research is enabling next-gen codecs
How AI research is enabling next-gen codecsQualcomm Research
 
Role of localization and environment perception in autonomous driving
Role of localization and environment perception in autonomous drivingRole of localization and environment perception in autonomous driving
Role of localization and environment perception in autonomous drivingQualcomm Research
 
Intelligence at scale through AI model efficiency
Intelligence at scale through AI model efficiencyIntelligence at scale through AI model efficiency
Intelligence at scale through AI model efficiencyQualcomm Research
 

More from Qualcomm Research (20)

Generative AI at the edge.pdf
Generative AI at the edge.pdfGenerative AI at the edge.pdf
Generative AI at the edge.pdf
 
The future of AI is hybrid
The future of AI is hybridThe future of AI is hybrid
The future of AI is hybrid
 
Qualcomm Webinar: Solving Unsolvable Combinatorial Problems with AI
Qualcomm Webinar: Solving Unsolvable Combinatorial Problems with AIQualcomm Webinar: Solving Unsolvable Combinatorial Problems with AI
Qualcomm Webinar: Solving Unsolvable Combinatorial Problems with AI
 
Why and what you need to know about 6G in 2022
Why and what you need to know about 6G in 2022Why and what you need to know about 6G in 2022
Why and what you need to know about 6G in 2022
 
Understanding the world in 3D with AI.pdf
Understanding the world in 3D with AI.pdfUnderstanding the world in 3D with AI.pdf
Understanding the world in 3D with AI.pdf
 
Enabling the metaverse with 5G- web.pdf
Enabling the metaverse with 5G- web.pdfEnabling the metaverse with 5G- web.pdf
Enabling the metaverse with 5G- web.pdf
 
Presentation - Model Efficiency for Edge AI
Presentation - Model Efficiency for Edge AIPresentation - Model Efficiency for Edge AI
Presentation - Model Efficiency for Edge AI
 
Bringing AI research to wireless communication and sensing
Bringing AI research to wireless communication and sensingBringing AI research to wireless communication and sensing
Bringing AI research to wireless communication and sensing
 
How will sidelink bring a new level of 5G versatility.pdf
How will sidelink bring a new level of 5G versatility.pdfHow will sidelink bring a new level of 5G versatility.pdf
How will sidelink bring a new level of 5G versatility.pdf
 
Scaling 5G to new frontiers with NR-Light (RedCap)
Scaling 5G to new frontiers with NR-Light (RedCap)Scaling 5G to new frontiers with NR-Light (RedCap)
Scaling 5G to new frontiers with NR-Light (RedCap)
 
Realizing mission-critical industrial automation with 5G
Realizing mission-critical industrial automation with 5GRealizing mission-critical industrial automation with 5G
Realizing mission-critical industrial automation with 5G
 
3GPP Release 17: Completing the first phase of 5G evolution
3GPP Release 17: Completing the first phase of 5G evolution3GPP Release 17: Completing the first phase of 5G evolution
3GPP Release 17: Completing the first phase of 5G evolution
 
AI firsts: Leading from research to proof-of-concept
AI firsts: Leading from research to proof-of-conceptAI firsts: Leading from research to proof-of-concept
AI firsts: Leading from research to proof-of-concept
 
Setting off the 5G Advanced evolution with 3GPP Release 18
Setting off the 5G Advanced evolution with 3GPP Release 18Setting off the 5G Advanced evolution with 3GPP Release 18
Setting off the 5G Advanced evolution with 3GPP Release 18
 
Enabling on-device learning at scale
Enabling on-device learning at scaleEnabling on-device learning at scale
Enabling on-device learning at scale
 
The essential role of AI in the 5G future
The essential role of AI in the 5G futureThe essential role of AI in the 5G future
The essential role of AI in the 5G future
 
How AI research is enabling next-gen codecs
How AI research is enabling next-gen codecsHow AI research is enabling next-gen codecs
How AI research is enabling next-gen codecs
 
Role of localization and environment perception in autonomous driving
Role of localization and environment perception in autonomous drivingRole of localization and environment perception in autonomous driving
Role of localization and environment perception in autonomous driving
 
Pioneering 5G broadcast
Pioneering 5G broadcastPioneering 5G broadcast
Pioneering 5G broadcast
 
Intelligence at scale through AI model efficiency
Intelligence at scale through AI model efficiencyIntelligence at scale through AI model efficiency
Intelligence at scale through AI model efficiency
 

Recently uploaded

Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesDavid Newbury
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintMahmoud Rabie
 
PicPay - GenAI Finance Assistant - ChatGPT for Customer Service
PicPay - GenAI Finance Assistant - ChatGPT for Customer ServicePicPay - GenAI Finance Assistant - ChatGPT for Customer Service
PicPay - GenAI Finance Assistant - ChatGPT for Customer ServiceRenan Moreira de Oliveira
 
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Will Schroeder
 
Introduction to Quantum Computing
Introduction to Quantum ComputingIntroduction to Quantum Computing
Introduction to Quantum ComputingGDSC PJATK
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioChristian Posta
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfAijun Zhang
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UbiTrack UK
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1DianaGray10
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostMatt Ray
 
Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.YounusS2
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URLRuncy Oommen
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataSafe Software
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024D Cloud Solutions
 
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...Aggregage
 
RAG Patterns and Vector Search in Generative AI
RAG Patterns and Vector Search in Generative AIRAG Patterns and Vector Search in Generative AI
RAG Patterns and Vector Search in Generative AIUdaiappa Ramachandran
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaborationbruanjhuli
 
20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf
20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf
20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdfJamie (Taka) Wang
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsSeth Reyes
 
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfUiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfDianaGray10
 

Recently uploaded (20)

Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond Ontologies
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership Blueprint
 
PicPay - GenAI Finance Assistant - ChatGPT for Customer Service
PicPay - GenAI Finance Assistant - ChatGPT for Customer ServicePicPay - GenAI Finance Assistant - ChatGPT for Customer Service
PicPay - GenAI Finance Assistant - ChatGPT for Customer Service
 
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
 
Introduction to Quantum Computing
Introduction to Quantum ComputingIntroduction to Quantum Computing
Introduction to Quantum Computing
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and Istio
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdf
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
 
Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URL
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024
 
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
 
RAG Patterns and Vector Search in Generative AI
RAG Patterns and Vector Search in Generative AIRAG Patterns and Vector Search in Generative AI
RAG Patterns and Vector Search in Generative AI
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
 
20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf
20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf
20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and Hazards
 
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfUiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
 

ABI Research White Paper: Augmented and Virtual Reality: The First Wave of 5G Killer Apps

  • 1. www.abiresearch.com A TRANSFORMATIVE SHIFT SUPPORTED BY THE INTRODUCTION OF 5G The synergistic relationship between upcoming technologies in the connectivity and computing space often leads to a revolution across markets. With applications and use cases morphing to take full advantage of new technologies, such as 5G, cloud, and edge computing, the industry is investigating new business opportunities, otherwise not possible before the introduction of these technologies. This white paper will focus on augmented reality (AR) and virtual reality (VR), among the most attractive use cases for 5G. These technologies are promising to transform the way content is consumed and communicated, and will no doubt help a wide variety of industries increase productivity and change the way they do business. Workflow assistance and “see-what-I- see” remote interaction and guidance have seen strong uptake already among existing AR rollouts. ABI Research estimates the total AR market will reach US$114 billion by 2021, and the total VR market will reach US$65 billion within the same timeframe. AugmentedandVirtualReality: theFirstWaveof5GKillerApps
  • 2. 2 AUGMENTED AND VIRTUAL REALITY: THE FIRST WAVE OF 5G KILLER APPSwww.abiresearch.com AR and VR have similar underlying technologies, but distinct experiences. As described in this study, both AR and VR applications can be very sensitive to network performance, as any associated hiccup can penalize the overall user experience. Today’s typical 4G networks place serious limitations on AR and VR applications, such as latency and capacity, which can negate some use cases entirely. Although current 4G networks are sufficient for some early adopter AR and VR experiences, the introduction of 5G, which represents a considerable leap over 4G, will no doubt strengthen existing experiences, enable novel ones, and make them available for mass adoption. Offering much more capacity, lower latency, and a more uniform experience, 5G will not only improve, but will also be a requirement for some of the most exciting AR and VR use cases outlined in this paper: automotive content streaming, social sharing from event venues, next-generation video, and tactile Internet. These key use cases impose diverse network requirements that go well beyond what 4G can deliver. For example, high-mobility automotive content streaming requires strong network uniformity, combined with increased capacity to handle growing bitrate requirements for content consumption. In the case of live streaming a sporting event on social media, the network is required to provide a very dense coverage and high capacity to bring AR and VR applications close to the end user and make the overall experience consistent throughout the venue. Next-generation video formats, like interactive 6 degrees of freedom (6DoF) video, will be most demanding in terms of bandwidth, with up to 10X the bitrate required for 4K video. Network requirements for remotely controlled devices and tactile Internet, on the other hand, are expanding. Introducing AR or VR into remote control intensifies latency requirements. Tactile Internet adds haptic feedback to remote control, creating an even greater need for ultra-low latency. AR AND VR ARE PROMISING, BUT STILL REQUIRE DEVELOPMENT AR and VR are unique in that the technologies have the potential to touch so many different markets, use cases, and applications, allowing the opening up of a substantial addressable market. However, both technologies are currently in their infancy and face several challenges. On the hardware side, there is much progress to be made for both AR and VR, most of which will also have an impact on network performance requirements. Battery life for untethered devices is currently inadequate, as is processing for graphically intensive applications. Pixel density on current generation displays is lacking as well, most noticeably in media and entertainment scenarios in VR. Field of view is another concern, limiting usability in AR and immersion in VR. Standalone VR devices, housing all required components in a single device, will begin to grow over the next 5 years to compete with mobile VR. This introduces a difficult and novel hardware form factor to contend with, in addition to the individual component difficulties mentioned above. Outside of AR and VR head-mounted device (HMD) hardware, supporting infrastructure is the next step. Building out 5G infrastructure will take time, but early identification of the most promising applications
  • 3. 3 AUGMENTED AND VIRTUAL REALITY: THE FIRST WAVE OF 5G KILLER APPSwww.abiresearch.com that rely on or can be improved with this infrastructure creates a stronger foundation for future growth. Enterprise applications for AR and VR are growing in attractiveness as ROI metrics, such as error reduction and employee efficiency, are identified and proven. As the hardware footprint continues to grow, the need for reliable and efficient connectivity will as well. This white paper looks in detail at the network requirements of AR and VR use cases mentioned above. It will highlight the key challenges facing the current generation of networks in addressing these requirements and how 5G will help these use cases achieve their full potential for sustaining credible and lucrative business opportunities. Before looking at these use cases, let us first elaborate on the general benefits 5G brings to AR and VR applications. THREE KEY ADVANTAGES OF 5G 5G networks are heterogeneous by default, offering different types of connectivity optimized for different types of services. They will offer enhanced mobile broadband connections, but will also support low latency and high reliability mission-critical services, which are necessary requirements for immersive AR and VR ex- periences. If one takes into account IMT-2020 guidelines, 5G promises to achieve goals, such as: ▪▪ 20 Gbps peak data rate ▪▪ 100 Mbps data rates, even at cell edges ▪▪ 1 million devices per km2 ▪▪ 10 Mbps/m2 for area capacity ▪▪ 1 ms roundtrip over-the-air latency Compared to 4G, this translates to targets such as a 10X improvement in throughout, a 10X decrease in latency, a 100X improvement in traffic capacity, and a 100X improvement in network efficiency.1 As history has shown, an entire range of opportunities opens up when wireless connectivity becomes faster and costs less. Omnipresent connectivity spanning millions of bandwidth-hungry devices will push capacity requirements of the network even further, especially considering the visually-intensive data used for immersive AR and VR. In addition, as 5G technology matures, it will become fundamental for AR and VR services and experienc- es to be ubiquitous across heterogeneous networks, including 4G, 5G, and Wi-Fi. Ubiquitous 4G coverage with Gigabit Class speed, which is expected to see commercial deployments starting in 2017, will be the foundation for initial AR and VR experiences, while 5G will be able to leverage more spectral bands and wider bandwidths to boost capacity. In short, the usefulness of AR and VR going forward is heavily dependent on three primary network components: high capacity, low latency, and a uniform experience. Some applications rely on one component more than another, but supporting all three simultaneously is critical to enabling all AR and VR use cases under the same network.
  • 4. 4 AUGMENTED AND VIRTUAL REALITY: THE FIRST WAVE OF 5G KILLER APPSwww.abiresearch.com CAPACITY 5G is expected to bring enhanced mobile broadband speeds to mobile networks and increase network capacity many times compared to previous generations. Capacity need is a result of two primary drivers: bandwidth per application and simultaneous usage of those applications. Although there are numerous compelling AR and VR applications, video is the most important and unique in its high bandwidth requirements. ABI Research expects a progression in demand from the current tens of Mbps per user to hundreds of Mbps per user in the 5G timeframe for premium content, delivered through AR and VR. AR and VR Video will Drive 5G Capacity Improvements The next generation of video includes new formats, such as stereoscopic, high dynamic range (HDR), and 360°, at increased resolutions (8K+) and higher framerates (90+ fps). Although basic implementations of these formats may be delivered through 4G networks, large-scale adoption of applications that use these formats will soon congest the network, thus rendering the user experience intolerable. These new video formats will offer higher quality experiences, but at the cost of higher bandwidth. For example, higher resolutions are required for 360° video to maintain pixel density across the image, counteracting the close proximity, increased field-of-view, and optic losses associated with HMD viewing. Those higher resolutions bring higher bitrates. Stereoscopic video, which separates left and right eye views to create depth perception, thereby doubling the video streams, is required for immersive VR and AR viewing and further drives increased video data bandwidth. In addition, HDR video, which offers visual quality improvements in color fidelity and brightness, will become more mainstream and may increase bitrate by up to 20% depending on the HDR scheme and video format used.2 In terms of video compression, it is expected that H.265/HEVC will be the primary encoding and decoding format in the 5G timeframe, offering 30% to 50% improvement in bitrate reduction for similar quality as compared to H.264. Despite this efficiency, ABI Research expects AR and VR applications to push network requirements, with visual improvements and associated bitrate requirements outpacing compression improvements for several years. The ability to view 360° video at 4K 30 fps, which requires 10 Mbps to 50 Mbps depending on quality selected when using the HEVC video codec, will soon be common and will likely be handled by existing 4G infrastructure. However, in the 5G timeframe, stereoscopic HDR 360° video at 8K 90 fps, which requires higher than 200 Mbps, will be feasible. Looking even further out, 6DoF video that allows translational movement (discussed in more detail in Section 3.3) presents novel compression and transcoding obstacles and requires 200 Mbps to 1 Gbps per user, which could challenge the cell capacity of current 4G networks.
  • 5. 5 AUGMENTED AND VIRTUAL REALITY: THE FIRST WAVE OF 5G KILLER APPSwww.abiresearch.com Figure 1:The bandwidth requirements for streaming various visual content, especially video, will stress network capacity. (Source: ABI Research) Multiple users simultaneously consuming or sharing premium content is the other half of the capacity story. Current 4G networks will struggle when the number of concurrent users increases. AR and VR will compound this issue by adding many more concurrent users. For example, the vision for AR is the mass adoption of an all-day wearable device that is constantly connected, uploading and downloading vast amounts of data throughout the day. Image and video data will increase naturally with the visual nature of AR, and constant network calls for metrics such as location, status, and AI assistance will drive total requests and concurrency up even further. As AR and VR seep into the consumer space, these numbers will be exacerbated. For reference, ABI Research forecasts that the AR smart glasses installed base will reach 48 million units in 2021, with the VR device installed base numbering over 200 million units globally. Breaking the Speed Barrier with 5G NR 5G networks are built to support very high bandwidth applications, while the standardization community is creating specific use cases around AR and VR and the video formats discussed above. The 3GPP is working toward a new radio standard called 5G New Radio (NR) that will use new technologies to increase network speeds to tens of Gbps. One of these technologies is millimeter wave (mmWave) communications, in which the frequency of the link is loosely defined as being above 24 GHz. This promises vast amounts of bandwidth (including unlicensed bandwidth) and capacity improvements. For example, several field trials have taken place during 2016 that broke the 10 Gbps barrier, often using more than 1 GHz or even 2 GHz of channel bandwidth. There are several ongoing industry trials illustrating user-tracking pencil beams connecting the base station and the UE, allowing speeds of several Gbps. The added benefit is that these links are spatially separated, thus allowing mmWave spectrum to be reused even in the same cell for each individual user. However, there are several challenges to overcome before mmWave communications are used on a large-scale basis; for example, tracking hundreds of users in real time or dealing with non-line of sight connections between the base station and user device. BANDWIDTH BANDWIDTH 200 to 1000 Mbps 6DoF video or Point Cloud 50 to 200 Mbps Next-gen 360° video (8K, 90+ FPS, HDR, stereoscopic) 10 to 50 Mbps Current-gen 360° video (4K) 5 to 25 Mbps Two-way telepresence 2 to 20 Mbps 3D model and data visualization 2 Mbps Video conferencing 1 Mbps Image and workflow downloading 200-1000 Mbps 6 DoF video or Point Cloud 50.200 Mbps Next-gen 360° video (BK, 90+ FPS, HDR, stereoscopic) 10-50 Mbps Current-gen 360° video (4K) 5-25 Mbps Two-way telepresence 2-20 Mbps 3D model and data visualization 2Mbps Video conferencing 1 Mbps Image and workflow downloading
  • 6. 6 AUGMENTED AND VIRTUAL REALITY: THE FIRST WAVE OF 5G KILLER APPSwww.abiresearch.com Nevertheless, mmWave shows great promise, and highlights one technology candidate for 5G NR that is not a simple evolution of existing 4G technologies. Lab trials are now advancing to field trials, and will soon cre- ate the mmWave radio technologies capable of supporting commercial networks. The speeds required by certain AR and VR applications will reach the Gbps limit of 4G networks, meaning that mmWave may be a key enabling technology for these applications. In addition to these higher bands, initial 5G NR deployments in licensed spectrum are also targeting lower spectrum bands, such as new spectrum around 3 GHz and 4 GHz. LATENCY Latency plays an important role for AR and VR experiences, but it is important to understand when low latency is crucial and what type of latency is being discussed. Latency is Critical for Interactive AR and VR User Experiences For non-interactive content that can use a buffer, such as a streamed 360° video, network latency is generally not an issue if the buffer remains, making this content more tolerant to higher and inconsistent latency. Interactive content, on the other hand, is more susceptible to network latency. Low latency is required to ensure responsiveness for certain user interactions, such as virtually shooting an opponent in online multi- player gaming, playing virtual ping pong, controlling remote machinery, or interactively collaborating on a vehicle design. In these scenarios, the visuals require a full rendering of the scene based on the additional interactions. If the network is transporting the interaction information, then a reduction in latency is paramount to the experience (e.g., it may be the determining factor between shooting your opponent or being shot by your opponent). Head movement while wearing an HMD with head tracking is another specific interaction with distinct latency requirements that warrants more discussion. Motion-to-photon (MTP) latency is the time between an action (a head movement) and reaction (the display is updated based on the movement). When a user moves their head, the brain expects an instantaneous visual and aural update, so delaying that even minutely can be problematic. A MTP latency below 20 ms is currently targeted for many VR user experiences, but studies have shown that achieving a MTP latency of less than 15 ms makes the delay imperceptible to nearly all users. Considering the strict MTP requirements associated with HMD usage, ABI Research expects that AR and VR applications will keep MTP processing on the device (the HMD itself). There are hybrid-computing scenarios where 3D rendering happens off the device. PCs and game consoles tethered to VR HMDs are available today, while network edge or cloud rendering may be possible in the future. For these hybrid scenarios, ABI research expects that the processing will be intelligently split between cloud-based 3D rendering, which requires low network latency, and additional processing on the untethered mobile device to ensure high- quality visuals at a fixed low MTP latency.
  • 7. 7 AUGMENTED AND VIRTUAL REALITY: THE FIRST WAVE OF 5G KILLER APPSwww.abiresearch.com 5G Latency Improvements A major requirement of the 5G standard is ultra-low latency, with a targeted 1 ms roundtrip latency over the air. While 4G has already improved latency over 3G by flattening the network architecture, 3GPP is now also working to reduce over-the-air latency closer to the 1 ms range, guaranteeing an even lower latency. Strict latency requirements that go beyond the air-interface latency are not specifically defined in standards because they should include additional network transport components that are scenario and deployment dependent. For example, a latency-sensitive application may require proprietary components today that are tightly integrated to deliver this functionality specifically, e.g., real-time banking transactions. This may translate to specific functionality at the base station, specific core network components, and proprietary software at the network control and business system domain. On the other hand, 5G promises to offer this functionality through a standardized and consistent manner. Moving content and network functionality to the edge of the network can reduce latency, which will be required for applications heavily dependent on ultra-low latency. Applications that are required to span end-to-end, such as remote machinery control, will require 5G at least when dealing with long distances between nodes. Figure 2: Network topology will significantly impact content delivery latency and thus user experience. The diagram shows three different network topologies and their associated latencies. (Source: ABI Research) LOCAL SOURCE Telco Edge: 1 to 2 ms Telco Cloud: 20 to 50 ms Public Cloud: 50 to 100 ms ORIGINAL SOURCE (CLOUD) Application point Base station/ network edge Core network Internet Application (CSP) Application (OTT)
  • 8. 8 AUGMENTED AND VIRTUAL REALITY: THE FIRST WAVE OF 5G KILLER APPSwww.abiresearch.com 5G latency can be broken down into three network topologies, assuming a roundtrip ping scenario: ▪▪ Public cloud to device: 50 ms to 100 ms ▪▪ Telco cloud to device: 20 ms to 50 ms ▪▪ Telco edge to device: 1 ms to 2 ms These latency figures were derived from background research, including 5G-PPP targets3, ETSI, and ITU documents4 , and real-life 3G and 4G network latencies5. As 5G network architectures are yet undecided, it is not clear what end-to-end latencies will be achieved. The 1 ms over-the-air latency target for certain 5G use cases is very aggressive, but ABI Research has assumed latencies of this order may be achievable if an application is hosted at the edge of the network, e.g., in a Mobile-Edge Computing (MEC) server. For public cloud and telco cloud to device scenarios, core network improvements can be expected as 5G is built out, and the latency numbers quoted above will most likely become significantly lower. The needs of each use case will dictate the network topology. For instance, a stadium can house content on-premises at the network edge, allowing for near-immediate upstream and downstream. On the other hand, mobile video streaming may need to stretch to the telco cloud or public cloud to access content. UNIFORM EXPERIENCE Enabling ultra-fast connections is relatively straight-forward; making sure that users get a consistent experience with ultra-fast connectivity is not. Reliably delivering bandwidth to a significant portion of mobile users is equally important and cannot be understated for AR and VR use cases. For example, delivering 10 Gbps to a stationary user with strong coverage is one thing, but maintaining an acceptable signal as the user reaches network edges, while minimizing low data rate areas, is paramount for AR and VR applications where stutter, lag, and general disruption is unacceptable for user experience and comfort. High mobility use cases further emphasize this. For example, buffering video is much more disruptive while using an HMD with head tracking than on a traditional display. Also, highly variable network speeds can disrupt experiences in other ways. In highly immersive VR applications, picture quality fluctuations from adaptive bitrate can be distracting. Inconsistent roundtrip latency for input can also emerge from poor network uniformity, disrupting user experience and potentially barring input-critical applications from use. 5G is attempting to solve this challenge through two different methods: by becoming the “network of networks” that consolidates all previous networks into one and by introducing further advancements in network capabilities that also improve uniformity, including: ▪▪ The use of a large number of antennas (referred to as Massive MIMO) to steer the signal energy to the user’s location increases both uniformity and overall capacity. IMT-2020 requirements call for >100 Mbps user throughput, even at cell edges, and not just multi-Gbps peak user data rates. ▪▪ Simultaneous multi-connectivity, in which a user is simultaneously connected to multiple 5G access points and across 4G and Wi-Fi deployments, will also increase uniformity. One key example is when a user may be simultaneously connected to a 5G mmWave and a 4G access point, providing a seamless mobility experience and the ability to send data on both links.
  • 9. 9 AUGMENTED AND VIRTUAL REALITY: THE FIRST WAVE OF 5G KILLER APPSwww.abiresearch.com EARLY AR AND VR USE CASES AND 5G NETWORK REQUIREMENTS AR and VR offer an immense number of promising applications. In enterprise verticals, AR and VR offer promising ROI, improved safety, and novel workforce capabilities, while in the consumer space, users are promised immersive content and new social experiences. Delivering these use cases from source to end user will tax existing networks and require the advantages of 5G to properly function. This paper explores four uses cases: high mobility using automotive, high-capacity venue upload, high-band- width 6DoF experiences, and low-latency remote control, and to certain extent, tactile Internet, to exemplify the requirements that VR and AR impose on 5G in terms of capacity, uniformity, and latency. Figure 3: The four AR and VR use cases described in this paper require 5G. The diagram shows the approximate connectivity requirements in terms of latency (x-axis) and capacity (y-axis) for each use case. Uniform experience, although not shown, is also required for each use case. Latency sensitive Capacitysensitive Best-effort data access Stadium content upload Automotive video streaming Tactile internet Live 6DoF video 4G USER CASE 5G USER CASES (Source: ABI Research) HIGH MOBILITY EXAMPLE: AUTOMOTIVE VIDEO STREAMING Current roadmaps suggest a working, but expanding 5G network map starting around 2020. Within that timeframe, the automotive landscape will also start to transition to semi-autonomous and fully autonomous vehicles, unlocking additional time for entertainment and productivity. Passengers in a traditionally piloted car or a “driver” and passengers in a fully autonomous vehicle will consume compelling AR and VR content
  • 10. 10 AUGMENTED AND VIRTUAL REALITY: THE FIRST WAVE OF 5G KILLER APPSwww.abiresearch.com while commuting. This use case is especially challenging for two reasons: high capacity and high mobility of users. The massive bandwidth associated with premium AR and VR content causes capacity requirements to scale up quickly, while users rapidly transition between cells. As an example, traffic during rush hour on a highway can be dense. Assume that: ▪▪ Each car is 3 meters long and leaves a 9-meter gap between the car in front while driving 16 km/h. The highway has 8 lanes to be served. ▪▪ One cell tower is located directly at the highway with a cell radius of 500 meters, thus covering a stretch of 1 km serving ~667 cars. ▪▪ There is some level of autonomous driving in this timeframe. Assume that there are 1.0 potential AR/VR users (passengers of non-autonomous vehicles, or “drivers” and passengers of autonomous vehicles) per car due to increased carpooling, and that the penetration rate of AR or VR usage is 1%. Thus, we would have 0.01 VR or AR users per car. If each VR or AR app consumes 100 Mbps, then this use case would consume 667 Mbps (667 cars x 0.01 users per car x 100 Mbps). For 10 bps/Hz spectral efficiency, the cell site would require 67 MHz of spec- trum to support this capacity need. As autonomous cars reach the mass market, the percentage of people using AR or VR in the car increases, and thus the capacity required will increase significantly. Continuing the example with 10% penetration rate, we would need 10X more capacity, which can be solved through cell densification (decreasing the cell radius to less than 500 meters in this example) and more spectrum (which is only available at higher bands, including mmWave). With mobility, network handoff can be troublesome for streaming content, but 5G adds the concept of simultaneous multi-connectivity to remove the need for a traditional handoff. Simultaneous multi-con- nectivity is especially helpful in this case since the user can simultaneously receive data from two cell sites in range, which also helps to create a more uniform experience. In addition, the potential for 200 Mbps bitrate streams highlights the necessity for 5G’s promise of a more uniform and higher capacity network. High Mobility Automotive Video Streaming Required Pillars of 5G Capacity • Mobility • Uniformity Technical challenge: Ubiquitous mobile multi-Gbps connections Multiples of 100 MHz of spectrum per cell HIGH CAPACITY EXAMPLE: SOCIAL SHARING FROM EVENT VENUES Much attention is paid to downstream bandwidth with 5G. However, the upload side of the story is equally interesting and important, especially with the simultaneous usage of applications that would take place in a crowded event venue like a stadium. Not only will stadium goers be able to reliably and quickly upload their content, but those outside the venue will have a large selection of content to view. Social media services
  • 11. 11 AUGMENTED AND VIRTUAL REALITY: THE FIRST WAVE OF 5G KILLER APPSwww.abiresearch.com like Facebook Live, Periscope, Instagram, and Snapchat are made possible with highly connected and highly capable capture devices, such as AR glasses, smartphones, or other 360° cameras. The potential for tens of thousands of users to simultaneously upload content could bog down a network, and this is exacerbated in the 5G timeline with content increasing in complexity and size (e.g., pictures migrating to 360° videos). Imagine being at the Super Bowl and trying to live stream the kickoff, along with 50,000 other fans, using the multiple cameras in your convenient and hands-free AR glasses. That could easily be a 1.25 Tbps spike in bandwidth (4K 360° video @ 25 Mbps x 50,000 users) within the area of the stadium (0.1 km2 ), reaching a to- tal capacity of 12.5 Tbps/km2 (=12.5 Mbps/m2 ). Fans at home using VR will be able to enjoy these experiences in real time and feel like they are at the game as long as the network is not bogged down. For reference, IMT- 2020 targets traffic capacity of 10 Mbps/m2 , which this scenario approaches or could exceed. A stadium network implementation has the advantage of a more accessible edge network infrastructure, al- lowing for content created both on-site and externally to be housed on the edge for very low latency delivery. In a sporting venue, low latency is equally as important for downstream and upstream applications. Support- ing high upload concurrency of rich data, with low delay, allows for near real-time content updates. On-site value-add stadium experiences, such as games, interactive video, crowd participation, etc., can be enabled with near real-time upload as well. This is especially pertinent as compelling home sports content consump- tion grows, and ticket sales are endangered. With many fans questioning whether tickets are worthwhile when their home viewing experience can be equal or better in some situations, these unique experiences can drive interest back to the stadium. Stadium Content Upload Required Pillars of 5G Capacity • Uniformity • Latency Technical challenge: Total capacity per area 12.5 Mbps/m2 HIGH BANDWIDTH EXAMPLE: 6DOF CONTENT Next-generation VR and AR experiences will have 6DoF for the next level of immersion, allowing users to move within and intuitively interact with the environment. 6DoF content is an order of magnitude richer in naturalness and interactivity than 3 degrees of freedom (3DoF) video. Current 3DoF experiences, such as 360° video, allow the user to rotationally look around from a fixed position. 6DoF experiences, which are available in video games today, allow the user to move spatially through the environment just by walking or leaning the head forward. 6DoF head motion tracking is required to enjoy 6DoF content in an intuitive manner. One solution to provide precise 6DoF head motion tracking is visual-inertial odometry (VIO), which estimates the relative position and orientation of a moving device in an unknown environment using a cam- era and motion sensors. A huge advantage of VIO is that it can be processed on the HMD with no additional setup for a truly mobile experience, unlike other solutions that require external sensors, markers, cameras, or lasers to be set up throughout the room.
  • 12. 12 AUGMENTED AND VIRTUAL REALITY: THE FIRST WAVE OF 5G KILLER APPSwww.abiresearch.com Synthetic (computer-generated) 6DoF environments can be rendered in the cloud today, while 6DoF video, sometimes referred to as “point cloud video,” is in its early stages. Sports, tourism, education, and other forms of immersive video will flourish as 6DoF technologies evolve, but the current state is nascent. Most components of the video delivery pipeline are currently ill-suited for 6DoF video, including capture devices, production software, codecs, compression algorithms, the network, and players. 6DoF video also demands bit-rates in the range of 200 Mbps to 1 Gbps depending on the end-to-end latency. Overall, the pipeline must mature to enable the 6DoF content. For these reasons, streaming live 6DoF content to deliver a “be there” experience is certainly a compelling and forward-looking use case, but also one that will require 5G and beyond. While streamed 3DoF video (360° video) content traditionally can cope with network latency via a jitter buffer, the rendering of 6DoF content is dependent on the user’s head and body movements; hence, it is sensitive to bi-directional end- to-end latency as well. This use case is akin to streaming a video game, so end-to-end latencies must be on the order of a few tens of milliseconds. Network operators should be aware that a trade-off between latency and bandwidth exists for 6DoF content delivery. With lower end-to-end latency for communicating the user’s movement, fewer viewpoints around the user need to be sent. For example, when end-to-end latency is on the order of 1 ms to 5 ms, then the bit-rate for 6DoF content can be reduced to ~100 Mbps to 200 Mbps. However, if the end-to-end latency of the system is 5 ms to 20 ms, then the bit-rate is closer to ~400 Mbps to 600 Mbps, because more viewpoints around the user need to be sent. As a result of this, 6DoF content will most likely be limited to edge streaming scenarios during the 5G timeframe. 6DoF Experiences Required Pillars of 5G Capacity • Latency • Uniformity Technical challenges: User throughput (bit-rate) & Latency 200 Mbps to 1,000 Mbps < 20 ms, the lower latency the better LOW LATENCY EXAMPLE: REMOTE CONTROL AND TACTILE INTERNET Remote collaboration through telepresence is a huge boon for enterprise use cases powered by AR and VR. Truly interactive remote experiences require low end-to-end latency often ranging from 40 ms to 300 ms, depending on the use case.6 In general, reduced latency increases the amount of interactivity possible, thus expanding potential use cases to things like remote medical procedures, collaborative remote manipulation of objects, and online gaming. Remote machinery control through user-guided tele-operation, such as a re- mote control forklift, has a roundtrip latency threshold of ~100 ms. Consider that a single roundtrip commu- nication between two mobile endpoints may involve four wireless link traversals (that equals two over-the-air roundtrips and two networks’ transport legs). When accounting for processing latency within the endpoints, multiple edge network traversals, core network latency, and physical distance latency, it becomes clear that low-latency 5G edge networks are essential to achieving remote interactivity for AR and VR. As an example, enabling sub-40 ms end-to-end latency may require as little as 5 ms roundtrip latency for each of the two links if we allow for a 30 ms delay to the network.
  • 13. 13 AUGMENTED AND VIRTUAL REALITY: THE FIRST WAVE OF 5G KILLER APPSwww.abiresearch.com Looking beyond the remote machine control of today to the tactile Internet of the future, research suggests that ultra-low latency feedback below 5 ms will enable novel uses of multi-sensory remote tactile control with responses rapid enough to be imperceptible to the operator.7 Use cases, such as vehicle control, with fast motion involving the user, environment, or an object, require these ultra-low latencies, as latency is more perceptible in these cases. Near-field remote control is most feasible early on and is a promising application of 5G with AR and VR. As 5G continues to evolve and be built out, long-range tactile Internet applications come into focus and become more attainable with 5G’s aggressive latency promises. Remote Machinery Control Required Pillars of 5G Latency • Uniformity Technical Challenge: Latency < 5 ms latency for tactile Internet CONCLUSION 5G is envisioned to bring higher capacity, a uniform experience, and lower overall latency—all of which are critical for AR and VR applications over a network—while also reducing the cost per bit. This white paper outlined four examples of AR and VR requiring 5G to empower new user experiences and improve existing ones as the number of users increases. Semi-autonomous and fully autonomous vehicles present additional time for content consumption, but also challenging mobility and capacity requirements for network streaming. Applications at densely populated stadiums are already stressing wireless networks, and content upload by thousands of simultaneous users at a stadium will demand capacity on the order of 10 Mbps/m2 . The impressive growth of video will only be- come more substantial as AR and VR grow in market share, with next-generation content formats like 6DoF video stressing networks even more with individual data consumption in the range of 200 Mbps to 1 Gbps. Ideal end-to-end latency requirements in the 10 ms range for remote machinery control and tactile Internet will also push the boundaries of these networks, and could require over-the-air latencies as low as 1 ms. In a way, the AR and VR industry is thirsty for the capabilities 5G promises and this is a profound change in the way cellular networks have traditionally been developed: if you build it (the network), they will come (applica- tions and users). The uses cases outlined above illustrate that current 4G networks and their evolution will not be able to sustain a consistent user experience for many AR and VR applications, without which the industry will not be able to build solid business cases for these applications. Moreover, new use cases for AR and VR will manifest as the capabilities of 5G networks actualize. ABI Research expects AR and VR to transform industries, and 5G will be crucial in making that a reality.
  • 14. 14 AUGMENTED AND VIRTUAL REALITY: THE FIRST WAVE OF 5G KILLER APPSwww.abiresearch.com ACKNOWLEDGEMENTS: This study is sponsored by Qualcomm and focuses on why 5G is needed for AR and VR use cases, aiming to discuss key opportunities and challenges. ABI Research would like to thank the Qualcomm AR/VR and 5G teams for helping us to navigate through the technology complexity of AR/VR and to identify the role 5G will play in enabling many AR/VR use cases. ABOUT QUALCOMM: Qualcomm’s technologies powered the smartphone revolution and connected billions of people. Qualcomm pioneered 3G and 4G, and now is leading the way to 5G and a new era of intelligent, connected devices. Its products are revolutionizing industries, including automotive, computing, IoT, healthcare, and data cen- ters, and allowing millions of devices to connect with each other in ways never before imagined. Qualcomm Incorporated includes its licensing business, QTL, and the vast majority of its patent portfolio. Qualcomm Technologies, Inc., a subsidiary of Qualcomm Incorporated, operates, along with its subsidiaries, all of Qual- comm’s engineering, research and development functions, and all of its products and services businesses, including, its QCT semiconductor business. For more information, visit Qualcomm’s website, OnQ blog, Twit- ter, and Facebook pages. ABOUT ABI RESEARCH: Innovative business leaders trust ABI Research to help make transformative technology decisions. For more than 25 years, ABI Research has been embedded in the planning and workflows of the world’s leading tech- nology and innovation organizations. ABI Research is their execution partner, providing business intelligence and accelerating their overall decision-making process to more quickly and confidently execute strategies.
  • 15. 15 AUGMENTED AND VIRTUAL REALITY: THE FIRST WAVE OF 5G KILLER APPSwww.abiresearch.com REFERENCES: 1 “Standards development for broadband wireless access,” Colin Langtry, ITU Radiocommunication Bureau, https://www.itu.int/net4/wsis/forum/2016/Content/AgendaFiles/document/9d6c7b67-33a7-4ac6-96c7- ebf2231d83c2/ITU-BR_Colin_Langtry.pdf. 2. “HDR Starts to Roll amid Growing Clarity on Bitrate & Quality Issues,” ScreenPlays Magazine, http://www.screenplaysmag.com/2015/10/02/hdr-starts-to-role-amid-growing-clarity-on-bitrate-quality- issues/. 3. “View on 5G Architecture,” 5G PPP Architecture Working Group, https://5g-ppp.eu/wp-content/ uploads/2014/02/5G-PPP-5G-Architecture-WP-For-public-consultation.pdf. 4. “Standards development for broadband wireless access,” Colin Langtry, ITU Radiocommunication Bu- reau, https://www.itu.int/net4/wsis/forum/2016/Content/AgendaFiles/document/9d6c7b67-33a7-4ac6- 96c7-ebf2231d83c2/ITU-BR_Colin_Langtry.pdf. 5. “State of Mobile Networks: USA,” OpenSignal, February 2016, https://opensignal.com/reports/2016/02/ usa/state-of-the-mobile-network/. 6. “A Distributed Architecture for Multiplayer Interactive Applications on the Internet,” IEEE, http://ieeex- plore.ieee.org/document/777437/ 7. “The Tactile Internet: ITU-T Technology Watch Report,” August 2014, https://www.itu.int/dms_pub/itu-t/ oth/23/01/T23010000230001PDFE.pdf.
  • 16. Published February 1, 2017 ©2017 ABI Research 249 South Street Oyster Bay, New York 11771 USA Tel: +1 516-624-2500 www.abiresearch.com © 2017 ABI Research. Used by permission. ABI Research is an independent producer of market analysis and insight and this ABI Research product is the result of objective research by ABI Research staff at the time of data collection. The opinions of ABI Research or its analysts on any subject are continually revised based on the most current data available. The information contained herein has been obtained from sources believed to be reliable. ABI Research disclaims all warranties, express or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose. www.abiresearch.com