A talk from the Design Track at AWE EU 2018 - the World's #1 XR Conference & Expo in Munich, Germany 18 -19, October, 2018. Robert Wilde (Siemens): Training in AR and VR The talk greatly focuses about the technical and user experience challenges for Virtual Reality and Augmented Reality engineering training at Siemens. From getting the data, creating the experience, to future use cases that include AI assistants. We want to answer the question of how to use VR/AR truly productively in the industrial setting. http://AugmentedWorldExpo.com

1. Restricted © Siemens AG 2018
siemens.comRestricted © Siemens AG 2018
Training in AR & VR
Engineering from Virtual to Reality

2. Restricted © Siemens AG 2018
What‘s up with Virtual
Training@SIEMENS?
11/29/2017 Author / departmentPage 5

3. Restricted © Siemens AG 2018
11/29/2017 Robert Wilde | CT RDA SSI UXD-DEPage 6
SIEMENS Engineering Portfolio

4. Restricted © Siemens AG 2018
But it should be extendable for other scenarios!
Virtual Training @ Siemens
Idea: Train for Bearing Change on Torque Engine

5. Restricted © Siemens AG 2018
11/29/2017 Robert Wilde | CT RDA SSI UXD-DEPage 8
Why Virtual Reality Training?
Costs, Time & Logistics Travel Teaching Methods Scalability
Repeatability Language Barriers Documentation KPIs & Analysis

7. Restricted © Siemens AG 2018
• Text
Authoring Training Co-Location
11/29/2017 Robert Wilde | CT RDA SSI UXD-DEPage 10
Aspects of Virtual Training @ Siemens
• Text • Text

8. Restricted © Siemens AG 2018
Focus: Authoring Without Programming
11/29/2017 Author / departmentPage 11
• Perform the training just like in the real world
• Automated recording of steps, tools, annotations
• Cross platform publication to VR, AR, Tablet, Desktop
• Authoring and Publication directly in VR

9. Restricted © Siemens AG 2018
Where to start?
11/29/2017 Robert Wilde | CT RDA SSI UXD-DEPage 12

10. Restricted © Siemens AG 2018
• CAD Models
• 3D Models of third party tools & equipment
• 3D Models of custom tools and special parts
• Image, Video, Audio files
• Technical Documentation
11/29/2017 Robert Wilde | CT RDA SSI UXD-DEPage 13
Required Content for AR and VR
New business model?
Buy a screwdriver, get a digital copy.
A content management process is
required.

11. Restricted © Siemens AG 2018
3D models have geometry, materials, hierarchy –
that‘s it
Smart models
• From geometry to interactivity
• Finding part relations
• Applying real world properties
• Going from rigid mesh to soft body
Interactive tools
• From tool geometry to interactive, smart tool
• Implementing tool-object relations
11/29/2017 Robert Wilde | CT RDA SSI UXD-DEPage 14
CAD Models are dumb, 3D Scans are dumberer
The Author does not want to deal with any of this!

12. Restricted © Siemens AG 2018
Library content
Create once, reuse for all
Requires
• Modeling, Texturing
• UX, usability, interaction design
• Programming
Request & Publication workflow
Custom content
Required for a specific training
Is not or rarely reused in other trainings
11/29/2017 Robert Wilde | CT RDA SSI UXD-DEPage 15
Approach: Library Content and Custom Content
The Author needs to be able to request a change,
new content or features.

13. Restricted © Siemens AG 2018
Getting Real
11/29/2017 Author / departmentPage 16

14. Restricted © Siemens AG 2018
The User Experience of the AR/VR Training Application
UX
Virtual Tools
& Equipment
Training
Application
Author TraineeTrainer

15. Restricted © Siemens AG 2018
Application
• Teleportation Pattern
• Grab & Release Pattern
• UI Navigation
• Physics
Needs to be learned first.
Tools & Equipment
• VR Controller vs Tool
• Unique User Interfaces
Abstraction from Real World.
Training Document
• Didactics
• Information Quality
• Content Quality
Makes or breaks the Training.
11/29/2017 Robert Wilde | CT RDA SSI UXD-DEPage 18
UX, Abstraction and Learning

16. Restricted © Siemens AG 2018
Is Virtual Training the
Solution?
11/29/2017 Author / departmentPage 21

17. Restricted © Siemens AG 2018
• Exploration
• Simulation
• Playing with Time and Space
• Learning spatial and geometric problems
• Learning step-by-step sequences
11/29/2017 Author / departmentPage 22
Strengths and Weaknesses of VR
• Fine Tooling
• Precision
• Photorealism
• Physics
• Abstraction
• Lack of Sensory Input
Strengths of VR Training Weaknesses of VR Training
Theory Practice
Virtual Training does have the potential to bridge the gap between theory and practice!

18. Restricted © Siemens AG 2018
• Interaction with virtual objects
• Infinite virtual environment
• Object information from VR engine
• Simulation of consequences
• Risk-free
11/29/2017 Author / departmentPage 23
Virtual Reality vs Augmented Reality
• Interaction with real objects
• Environment limited to real world space
• Object tracking & recognition
• Real consequences
• Hazardous
Virtual Reality Augmented Reality
Training Maintenance
Cross-over potential: Remote Field Maintenance
VR AR

19. Restricted © Siemens AG 2018
The VR application provides a canvas and a toolset
• Authors need to have a good didactic concept
• Authors need to know what they‘re doing
• Authors need to be experts in engineering, VR and
teaching
Solutions and Workarounds:
• Wizards
• AI Assistance
• In-App Feedback
• Review Cycles
11/29/2017 Robert Wilde | CT RDA SSI UXD-DEPage 24
Quality Brushes Don‘t Make You A Quality Artist

20. Restricted © Siemens AG 2018
Some issues today:
• Paper or PowerPoint as Training Documents
• Documents of bad quality
• Unqualified trainers, classroom trainings
• Trainings are not recorded
• No processes
• No KPIs
You (probably) don‘t need VR, you need Digitalization
11/29/2017 Robert Wilde | CT RDA SSI UXD-DEPage 25
Effective VR/AR can be the driver for Digitalization!

21. Restricted © Siemens AG 2018
You (probably) don‘t need VR at all…
11/29/2017 Robert Wilde | CT RDA SSI UXD-DEPage 26
Using VR/AR for the wrong use cases
undermines the value of the technology!

22. Restricted © Siemens AG 2018
11/29/2017 Robert Wilde | CT RDA SSI UXD-DEPage 27
…or do you?
The correct use of AR/VR can
open new perspectives.

23. Restricted © Siemens AG 2018
Contact Page
Robert Wilde
Software Engineer & UX Consultant AR/VR
CT RDA SSI UXD-DE
Siemens AG
Otto-Hahn-Ring 6
81739 München
E-mail:
robert.wilde@siemens.com
siemens.com
Page 28 11/29/2017 Author / department