A talk from the Main Stage at AWE EU 2018 - the World's #1 XR Conference & Expo in Munich, Germany 18 -19, October, 2018. Gerald Sailer (Bosch) Tom Pedersen (Bosch) Bosch Technical Trainings Supported by Augmented Reality Today’s training providers are facing challenges, how to best prepare technicians to understand and maintain vehicles considering new technologies, such as driver assistance systems which are often radar and sensor driven, hybrid and electrical powertrains, connected vehicles. Augmented Reality provides an appropriate way how to explain and visualize such systems and how they operate and are being serviced. Bosch training centers have started offering Augmented Reality driven trainings using Microsoft’s HoloLens glasses in order to train technicians to initially understand hybrid and electrical powertrains. Trainers have created the training modules using Bosch’s own Augmented Reality platform, and a new AR Training application has been introduced, allowing several HoloLens devices connecting with one joint training session. The presentation explains about this innovative training application and it’s challenges, it describes the technical solution approach and provides initial feedback and learnings from training sessions that were held in Bosch training facilities and during public events.

1. BOSCH TECHNICAL TRAININGS SUPPORTED
BY AUGMENTED REALITY
AWE EUROPE, 18. OCT. 2018
TOM PEDERSEN & GERALD SAILER

2. Automotive Service Solutions | AA-AS - Sailer / Pedersen | 2018-10-18
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
2
Your speakers
Tom Pedersen
Technical Trainer,
Robert Bosch A/S
Welcome
Gerald Sailer
Product Manager Augmented Reality,
Bosch Automotive Service Solutions GmbH

3. Training with AR
Automotive Service Solutions | AA-AS - Sailer / Pedersen | 2018-10-18
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
3
Hybrid system
Hybrid system
Range extender
EV cars

4. Training with AR
Automotive Service Solutions | AA-AS - Sailer / Pedersen | 2018-10-18
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
4
Radar and camera systems

5. Training with AR
Automotive Service Solutions | AA-AS - Sailer / Pedersen | 2018-10-18
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
5
Network
Front-view
camera ECU
Belt retracting
arrangement
left
Airbag ECU
Electric fuel
pump
Belt retracting
arrangement
right
Gear shift selector
lever ECU
Automatic
transmission ECU
ABS/ESP ECU
Lane-change
Assist ECU
All-wheel drive
ECU
Adaptive
damping ECU
Active
suspension ECU
Seat ECU
Driver
Seat ECU Co-
passenger
Trailer ECU
Tire inflation
pressure check
ECU
Multi-function
switch
Reversing
camera ECU
Air conditioning
system ECU
Passenger
compartment mirror
Sliding roof
control unit
Central electronics 2, REM
Telecommunica
tions-ECU
Audio
amplifier**
Radio-
Infotainment
unit*
Parking-assist
Tailgate lift
TV Tuner
DVD changer
Instrument
cluster
Structure-borne
noise ECU
MOST
Steering Assist
ECU
PT-CAN 2
K-CAN
Ethernet D-CAN
K-CAN 2
**K-CAN 2-linkage depending on
equipping version
Special vehicle
ECU ***
ACC Control
unit
*MOST-and Ethernet-linkage depending on equipping
version
LIN
Engine
Control unit
Central electronics 1, FEM with Gateway
OBD-Port
Central electronics 1, FEM with Gateway
FlexRay

6. Training with AR
Automotive Service Solutions | AA-AS - Sailer / Pedersen | 2018-10-18
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
6
Workshops

7. Training with AR
Automotive Service Solutions | AA-AS - Sailer / Pedersen | 2018-10-18
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
7
Training Center
2017 = 1833 trainings – 14.287 trainees

8. Training with AR
Automotive Service Solutions | AA-AS - Sailer / Pedersen | 2018-10-18
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
8
Training 4.0
 Video Link

9. Training 4.0 Solution
Automotive Service Solutions | AA-AS - Sailer / Pedersen | 2018-10-18
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
9
Overview
 Why:
 New complex vehicle technologies,
‒ e.g. electric vehicles, heavy duty vehicles, Advanced Driver
Assistance Systems (ADAS) and autonomous driving
 require new methods to meet the information needs of the
workshop operator.
 AR added to conventional training techniques
‒ provides all the knowledge needed
 What:
 New Training 4.0 solution with Bosch CAP
 CAP Video: https://www.youtube.com/watch?v=gefW8EC-ZCc
 New training methods integrating Augmented Reality, workshop employees trained for complex systems.
 The training can be performed on physical or virtual vehicles / components

10. Automotive Service Solutions | AA-AS - Sailer / Pedersen | 2018-10-18
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
10
 How:
 "Trainer Mode"
‒ trainer controls the training devices of the trainees
‒ decides what use cases they see on their devices
‒ trainer actions are transferred to trainee’s user equipment
‒ viewing angle remains individual for each participant
‒ All participants of the group actively follow the explanations of the
trainer and experience the training situation together
 "Trainee Mode“
‒ trainer switches to the trainee’s device
‒ give direct hints and tips for topic
Training 4.0 Solution
Overview

11. Automotive Service Solutions | AA-AS - Sailer / Pedersen | 2018-10-18
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
11
T1
T Trainees
Hololense
«Moderator»
Hololens
«Attendee»
Training 4.0 Solution - Hololens or Tablet 1/2
“Trainer controlled”
T2
M Trainer
DTC
DTC
DTC
Control
Control
Physical or augmented
vehicle(s) / object(s)
- on-site or remote locations

12. Automotive Service Solutions | AA-AS - Sailer / Pedersen | 2018-10-18
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
12
T1
T2
T Trainees
Hololense
Standalone
Hololens
Standalone
Training 4.0 Solution - Hololens or Tablet 2/2
“Free exploration by trainee”
T3
M
M Trainer
1 or multiple
physical or
augmented
DTC
DTC
DTC
“Private”
Session

13. CAP Training 4.0 Solution
Automotive Service Solutions | AA-AS - Sailer / Pedersen | 2018-10-18
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
13
AR Platform high-level overview
Publish
Contextu
alize
Workflow
CAP AR Authoring
Tools
Authors
Viewer (Apps)
Server – Online / Cached - local
Authentication Layer
Data Package N
Data Package 1
Deployment Server
CAP Runtime Server
CAP AR Clients
For iOS, Android, Win, HL
Tablet, Smartphone, HoloLens,

14. Automotive Service Solutions | AA-AS - Sailer / Pedersen | 2018-10-18
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
Deployment Server
Authoring Delivery CAP training client
AR Content
Provider
AR Content
Training Content
Provider
Training
Content
MetaData
Authoring Server (Authoring CMS)
AR PubEng
SI Pub Eng. AR Contentlinked
Training Content
AR Content
+ Training
Modules
AR ContentTraining
Content
XML Editor AR 3D Editor AR Tracking
Editor
AR mapping
linked
fetch
fetch
publish
14
Icons
Training
Information
Architecture of AR platform
3D CAD
Target
Image
CAD
Reference
2D
3D
A
u
t
h
e
n
t
i
c
a
t
i
o
n
CAP AR - Training Solution
Core Features (authentication, etc.)
Session control

15. Automotive Service Solutions | AA-AS - Sailer / Pedersen | 2018-10-18
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
15
Building blocks
Consultancy SW Licenses Authoring Services and
Training
Integration and
Implementation Services
• Requirements definition
• Solutions scale and setup
definition
• License package for
authoring system, runtime
system and clients
• Content creation
• Publication / Encapsulation
services
• Solution integration (e.g. in
larger environment)
• What do customers need ?
• Best solution approach ?
• Rollout plan ?
• Corresponding
maintenance and support
contract
• Authoring training to
enable customer
• Authoring support to
continuously help
customer authors
• Feature implementation
(e.g. custom features)
Training 4.0 Solution
Applicable for:
- Sales training
- Technician Training
- Production Training

16. Automotive Service Solutions | AA-AS - Sailer / Pedersen | 2018-10-18
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
16
Overview – Benefits
 Modern training methods in the workshop environment to train more complex systems
 Building knowledge is associated with high costs and time, therefore knowledge retention is important  Higher knowledge
retention
 As a supplement to classic training for more complex system which e.g. need to be disassembled
 Interactive learning method
 Disassembled view  non-destructive via AR
 Reduce cut models  no engine/parts need to be destroyed  save money
 Information at the right time at the right place
 Increase quality of training
 Reduce cost by limiting traveling
 Reduced effort to create training modules using CAP Augmented Reality Platform for authoring and publishing
 CAP AR client available for iOS, Android, Windows and HoloLens
 authored content (single source) can be viewed across devices and operating systems
Training 4.0 Solution

17. Automotive Service Solutions | AA-AS/SVW-Wagner | 2018-10-18
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
17
THANK
YOU
WHAT DRIVES YOU,
DRIVES US!