Creating a Virtual Reality in Unity - by Unity Evangelist Kelvin Lo

1. COPYRIGHT 2014 @ UNITY TECHNOLOGIES
CREATING A VIRTUAL
REALITY IN UNITY
Kelvin Lo, Product Evangelist at Unity Technologies

2. COPYRIGHT 2014 @ UNITY TECHNOLOGIESCOPYRIGHT 2014 @ UNITY TECHNOLOGIES
UNITY 5.1+ VR

3. COPYRIGHT 2014 @ UNITY TECHNOLOGIES
UNITY
Oculus Rift
MS Hololens
Gear VR
Playstation VR
Unity
SDK, Runtime Dirver
SDK

4. COPYRIGHT 2014 @ UNITY TECHNOLOGIESCOPYRIGHT 2014 @ UNITY TECHNOLOGIES
WINDOWS MAC
OCULUS VR

5. COPYRIGHT 2014 @ UNITY TECHNOLOGIESCOPYRIGHT 2014 @ UNITY TECHNOLOGIES

6. COPYRIGHT 2014 @ UNITY TECHNOLOGIES

7. COPYRIGHT 2014 @ UNITY TECHNOLOGIESCOPYRIGHT 2014 @ UNITY TECHNOLOGIES

8. COPYRIGHT 2014 @ UNITY TECHNOLOGIES
GEAR VR
• Android SDK
• (osig)
• https://developer.oculus.com/osig/
• Project/Assets/Plugins/Android/assets/

9. COPYRIGHT 2014 @ UNITY TECHNOLOGIES
UNITY
Mobile VR
PC
Mobile VR Google Cardboard
SDK Oculus Mobile SDK Mobile VR
VR
SDK Unity (
HTC Vive )

11. COPYRIGHT 2014 @ UNITY TECHNOLOGIES
BUILD SETTINGS
BUILD
• Texture compression
•
• ETC2 (GLES 3.0)
• Orientation
•
• Landscape left (mobile)
• V-Sync
• Do Not Sync
• Enable Multi-threading
• 4.5+
• Fixed Time step
• 0.01666 ( 60 fps)
• 0.01333 (PC 75 or 90 fps)
• Anti-Aliasing
•
• 2x max

12. COPYRIGHT 2014 @ UNITY TECHNOLOGIES
• Runtime不能降FPS
• 使⽤LOD，遮擋剔除，批次運算
• 減少物體數量,減少物體曲⾯
• 多⽤靜態物體,採⽤烘焙光照
• 使Draw Call保持100左右
• ⼩於100k的三⾓⾯
• 可以採⽤⾼解析的紋理來彌補
• 使⽤物理引擎來避免CPU消耗過⼤
MOBILE PERFORMANCE

13. COPYRIGHT 2014 @ UNITY TECHNOLOGIESCOPYRIGHT 2014 @ UNITY TECHNOLOGIES
VR JAM
1.
2.
3.
4. ASSET STORE

14. COPYRIGHT 2014 @ UNITY TECHNOLOGIESCOPYRIGHT 2014 @ UNITY TECHNOLOGIES
HOW HUMANS WORK

15. COPYRIGHT 2014 @ UNITY TECHNOLOGIES
FOVEATED RENDERING

16. COPYRIGHT 2014 @ UNITY TECHNOLOGIES
FOVEATED RENDERING
•

18. COPYRIGHT 2014 @ UNITY TECHNOLOGIES
HUMAN HEARING
•
•
•
•
•

19. COPYRIGHT 2014 @ UNITY TECHNOLOGIES
HUMANS GET SICK
•
•
•
•
•
•
•
•
•

20. COPYRIGHT 2014 @ UNITY TECHNOLOGIESCOPYRIGHT 2014 @ UNITY TECHNOLOGIES
VR
1.FPS > 75
2. < 20MS

21. COPYRIGHT 2014 @ UNITY TECHNOLOGIES
HUMAN VISION
Field Of View (FOV) of 210º horizontally by 160º vertically
(with neck movement), * 135 pixels per angle = 5.76E

22. COPYRIGHT 2014 @ UNITY TECHNOLOGIESCOPYRIGHT 2014 @ UNITY TECHNOLOGIES
DESIGNING FOR HUMANS

23. COPYRIGHT 2014 @ UNITY TECHNOLOGIES
HUMANS LIKE REALITY
…才怪

24. COPYRIGHT 2014 @ UNITY TECHNOLOGIES
HUMANS LIKE REALITY

25. COPYRIGHT 2014 @ UNITY TECHNOLOGIES
HUMANS GET SCARED
• VR
•
•
•
•

26. COPYRIGHT 2014 @ UNITY TECHNOLOGIES
HUMANS GET TIRED
•
•
•
•
• 2 5
• VR 5 30

27. COPYRIGHT 2014 @ UNITY TECHNOLOGIES
HUMANS CAN EMPATHIZE
• VR
•
•
•
•

28. COPYRIGHT 2014 @ UNITY TECHNOLOGIESCOPYRIGHT 2014 @ UNITY TECHNOLOGIES
DESIGNING FOR VIRTUAL
INTERACTIONS

29. COPYRIGHT 2014 @ UNITY TECHNOLOGIES
• UI
•
•
•
•

30. COPYRIGHT 2014 @ UNITY TECHNOLOGIES
•
•
•
•
•
•

31. COPYRIGHT 2014 @ UNITY TECHNOLOGIES
•
•
•
•
•
• You really want
•

32. COPYRIGHT 2014 @ UNITY TECHNOLOGIESCOPYRIGHT 2014 @ UNITY TECHNOLOGIES
UNITY VR ROADMAP
UNITY VR

33. COPYRIGHT 2014 @ UNITY TECHNOLOGIES
Camera Camera
Camera
API
Culling x 2, Shadow Draw x 2, Drawcall x 2, Render State x 2
GRAPHICS PIPELINE
Set Textures
Set Transforms
Set Geometry State
Draw
Set Textures
Set Transforms
Set Geometry State
Draw
Set Textures
Set Transforms
Set Geometry State
Draw
Set Textures
Set Transforms
Set Geometry State
Draw
Update View
to Other Eye

34. COPYRIGHT 2014 @ UNITY TECHNOLOGIES
Camera Camera
Object
Camera Viewport Transform
Drawcall x 2
GRAPHICS PIPELINE
Set Textures
Set Transforms
Set Geometry State
Draw
Set View State
Draw
Set Textures
Set Transforms
Set Geometry State
Draw
Set View State
Draw
Set Textures
Set Transforms
Set Geometry State
Draw
Set View State
Draw

35. COPYRIGHT 2014 @ UNITY TECHNOLOGIES
之後的圖形流⽔線-其他⽅案
渲染場景時，只檢查⼀次場景，每個Object送出⼀次，建⽴兩個Command
List來分別渲染(需要硬體⽀援,Ex: DX11)
渲染場景時，只檢查⼀次場景，使⽤Instancing技術來double所渲染的物體
(不⽀援OpenGL ES 2.0)
⽀持多GPU
GRAPHICS PIPELINE

36. COPYRIGHT 2014 @ UNITY TECHNOLOGIES

37. COPYRIGHT 2014 @ UNITY TECHNOLOGIES

38. COPYRIGHT 2014 @ UNITY TECHNOLOGIESCOPYRIGHT 2014 @ UNITY TECHNOLOGIES
VR

39. COPYRIGHT 2014 @ UNITY TECHNOLOGIES
VR AR
2015

40. COPYRIGHT 2014 @ UNITY TECHNOLOGIES
VR
Virtual Boy 1995 Oculus Rift 2012
Google Cardboard 2014

41. COPYRIGHT 2014 @ UNITY TECHNOLOGIES
截⽌2017年，累計的VR 設備總數
會達到1320萬台
預計到2020會有2600萬台相關設
備
在2020年VR 設備累計總數會達到
6600萬
99%的復合增⻑率
2020年HMD市場價值為30億美元

42. COPYRIGHT 2014 @ UNITY TECHNOLOGIESCOPYRIGHT 2014 @ UNITY TECHNOLOGIES

43. COPYRIGHT 2014 @ UNITY TECHNOLOGIESCOPYRIGHT 2014 @ UNITY TECHNOLOGIES
VR - 720 VR

44. COPYRIGHT 2014 @ UNITY TECHNOLOGIESCOPYRIGHT 2014 @ UNITY TECHNOLOGIES
A VR DEMO MADE BY MAKOTO ITO

49. COPYRIGHT 2014 @ UNITY TECHNOLOGIES
+
COMBINE 6 GO-PRO CAMERAS
WITH A QUADROTOR

50. Or… buy a Panorama Camera

51. COPYRIGHT 2014 @ UNITY TECHNOLOGIESCOPYRIGHT 2014 @ UNITY TECHNOLOGIES
HOW IT WORKS?

52. COPYRIGHT 2014 @ UNITY TECHNOLOGIES
CREATING A AUGMENTED
REALITY IN UNITY
Kelvin Lo, Unity Technologies

53. COPYRIGHT 2014 @ UNITY TECHNOLOGIESCOPYRIGHT 2014 @ UNITY TECHNOLOGIES
AR DEMO

54. COPYRIGHT 2014 @ UNITY TECHNOLOGIESCOPYRIGHT 2014 @ UNITY TECHNOLOGIES
PROJECT DEMO
1.Vuforia 5 SDK for Unity
2.Target Dataset Unity
3.

55. COPYRIGHT 2014 @ UNITY TECHNOLOGIESCOPYRIGHT 2014 @ UNITY TECHNOLOGIES

56. COPYRIGHT 2014 @ UNITY TECHNOLOGIESCOPYRIGHT 2014 @ UNITY TECHNOLOGIES

57. COPYRIGHT 2014 @ UNITY TECHNOLOGIESCOPYRIGHT 2014 @ UNITY TECHNOLOGIES

58. COPYRIGHT 2014 @ UNITY TECHNOLOGIESCOPYRIGHT 2014 @ UNITY TECHNOLOGIES

59. COPYRIGHT 2014 @ UNITY TECHNOLOGIESCOPYRIGHT 2014 @ UNITY TECHNOLOGIES

60. COPYRIGHT 2014 @ UNITY TECHNOLOGIES
• https://bitbucket.org/Unity-Technologies/2ddemos

61. kelvinlo@unity3d.com