Diese Präsentation wurde erfolgreich gemeldet.
Wir verwenden Ihre LinkedIn Profilangaben und Informationen zu Ihren Aktivitäten, um Anzeigen zu personalisieren und Ihnen relevantere Inhalte anzuzeigen. Sie können Ihre Anzeigeneinstellungen jederzeit ändern.

How to take advantage of XR over 5G: Understanding XR Viewers

137 Aufrufe

Veröffentlicht am

XR viewers are a new category of AR or VR devices that allow for lighter and smaller designs since they are connected to smartphones or other computer accessories. For more details, check out this great webinar, which has been adapted from a presentation we gave at AWE 2019.

Veröffentlicht in: Technologie
  • Als Erste(r) kommentieren

  • Gehören Sie zu den Ersten, denen das gefällt!

How to take advantage of XR over 5G: Understanding XR Viewers

  1. 1. How to take advantage of XR over 5G in 2019: Understanding XR Viewers Hiren Bhinde Director of XR Product Management Qualcomm Technologies, Inc. @qualcommMay 2019 Augmented World Expo Prince Gupta Senior Product Manager Qualcomm Technologies, Inc.
  2. 2. 2 XR is the next mobile computing platform Everything we’ve learned for smartphones will be used for AR Laptop Smartphone AR glasses
  3. 3. 3 The Final Frontier New optics and projection technologies within a durable, semitransparent display Directional speakers Tracking and recording cameras Ultra-bright LED lights Inertial, haptic, environmental, and health sensors • Many passive and active cameras with fisheye and telephoto lenses Ambient light sensors Multiple high sensitivity audio microphones Eye tracking cameras Multimode connectivity (4G, 5G, etc.) Rear camera
  4. 4. 4 New optics and projection technologies within a durable, semitransparent display Directional speakers Tracking and recording cameras Ultra-bright LED lights Inertial, haptic, environmental, and health sensors Many passive and active cameras with fisheye and telephoto lenses Ambient light sensors Multiple high sensitivity audio microphones Eye tracking cameras Multimode connectivity (4G, 5G, etc.) Rear camera
  5. 5. 55 Click here to watch a recording of this webinar
  6. 6. 6 Next-gen 6-DoF video
  7. 7. 7 Multi-player gaming with photorealistic graphics
  8. 8. 8 Our mobile office or living room, virtually anywhere
  9. 9. 9 Real-time interactive collaboration
  10. 10. 10 Form factors Multiple form factors have unique strengths but also limit experiences Smartphones 1.Not ergonomic 2.Limits seamless usage Standalone 1.Display, weight, power work in progress 2.Content being developed Phone on HMD 1.Weight of phone on Head limits experience 2.No AR experience
  11. 11. 11 Technology needs for AR Heterogeneous computing CPU GPU DSP ISP Video engine Display engine 64-bit OpenCL Shared virtual memory HVX Vulkan Gaming Gaming engines Physics engine Dynamic lighting Virtual reality Motion to photon Motion tracking 360 spherical Positional audio High resolution AI and Computer vision VIO SLAM Scene detection XR Stabilizing the world Realistic occlusion and blending Contextual understanding Machine learning Object tracking Depth perception Area learning Connectivity 2G 3G 802.11g Bluetooth 4G 802.11ac/ad 5G 802.11ax
  12. 12. 12
  13. 13. 13 Always-on Complex concurrencies Real-time Compute intensive Latency sensitive Complex XR workloads Challenging XR form factor Long battery life for all-day use Storage/memory bandwidth Thermally efficient for sleek and ultra-light Smartphone Processing Low latency High capacity Reliable link Distributed Processing – Viewers and Smartphones Additional Compute available Augment on-device rendering Connectivity Provide Low latency and optimized under strict power, thermal, size constraints Premium experiences today that continuously improve Viewers Processing Viewers
  14. 14. 14 5G enhanced mobile broadband is required for XR mass adoption Extreme throughput— multi Gbps Ultra-low latency — down to 1 ms Uniform experience — even at cell edge XR video will be the killer use case for 5G ~50 to 200 Mbps, lower latency Next-generation (2019) 3D 360° 8K/30fps viewport-aware HDR10 video ~10 to 50 Mbps Current-generation 360° 4K/30fps video ~200 to 5000 Mbps, very low latency Next-decade Interactive, real-time 3D “Free-Viewpoint” 6-DoF 8K/90-120fps HDR-next video Sustained network performance
  15. 15. 15 Europe North America Japan South Korea Australia/SEA China Deployments happening in regions across the globe2019 is the year of 5G 5G 5G is here. Qualcomm Snapdragon is a product of Qualcomm Technologies, Inc. and/or its subsidiaries.
  16. 16. 16 Benefits of XR Viewers PowerForm Factor Performance
  17. 17. 17 Form Factor
  18. 18. 18 6 DOF Tracking Cameras Photo / Video Camera
  19. 19. 19 Stereo Display Ultra smooth motion at 90Hz
  20. 20. 20 USB-C
  21. 21. 212121 Performance Sensor sampling and fusion Head pose generation Tracking Accuracy Visual Processing View generation Render / decode Low Latency Adjustment to latest pose (time warp) Quality enhancement and display Total time (motion to photon latency) for steps must be less than 20 milliseconds “Photon” (new pixels’ light emitted from the screen)“Motion”
  22. 22. 22 Power Workloads • Displays • Algorithms • Rendering Constrained mobile wearable environment • Thermally efficient for sleek, ultra-light designs • Long battery life for all-day use
  23. 23. 23 Simple Viewer Smart Viewer Qualcomm Snapdragon is a product of Qualcomm Technologies, Inc. and/or its subsidiaries.
  24. 24. 24 Sensors Perception Rendering Display Processing Improved Form Factor Qualcomm Snapdragon is a product of Qualcomm Technologies, Inc. and/or its subsidiaries.
  25. 25. 25 Sensors Perception Graphics Rendering Display Processing Improved Form Factor Improved Performance Qualcomm Snapdragon is a product of Qualcomm Technologies, Inc. and/or its subsidiaries.
  26. 26. 26 Sensors Perception ATW Video Decoding Video Encode Graphics Rendering Display Processing Improved Form Factor Improved Performance Improved Power Savings Qualcomm Snapdragon is a product of Qualcomm Technologies, Inc. and/or its subsidiaries.
  27. 27. 27 • Smart Viewer enables lower power by running Viewer and Smartphone at lower clock frequency • Smart Viewer enables rich graphics rendering powered by Smartphone, by offloading Perception + ATW from Smartphone to Viewer Power Benefits of Distributed Processing Standalone Perception on Viewer Perception + ATW On Viewer Power Viewer Smartphone
  28. 28. 2828 Big screen experience anywhere with existing apps
  29. 29. 29
  30. 30. 3030 Today’s form factors are great but have its own challenges Viewers provide the best of form factors, compute and feature abilities Call to arms for XR market acceleration: development and cooperation is key XR is the next mobile computing platform
  31. 31. 3131 “You can’t depend on your eyes when your imagination is out of focus” - Mark Twain
  32. 32. Follow us on: For more information, visit us at: www.qualcomm.com & www.qualcomm.com/blog Thank you! Nothing in these materials is an offer to sell any of the components or devices referenced herein. ©2018-2019 Qualcomm Technologies, Inc. and/or its affiliated companies. All Rights Reserved. Qualcomm is a trademark of Qualcomm Incorporated, registered in the United States and other countries. Other products and brand names may be trademarks or registered trademarks of their respective owners. References in this presentation to “Qualcomm” may mean Qualcomm Incorporated, Qualcomm Technologies, Inc., and/or other subsidiaries or business units within the Qualcomm corporate structure, as applicable. Qualcomm Incorporated includes Qualcomm’s licensing business, QTL, and the vast majority of its patent portfolio. Qualcomm Technologies, Inc., a wholly-owned subsidiary of Qualcomm Incorporated, operates, along with its subsidiaries, substantially all of Qualcomm’s engineering, research and development functions, and substantially all of its product and services businesses, including its semiconductor business, QCT.

×