by Fridolin Wild (30 October 2020)

1. Learning in the Real World
with Performance Augmentation
FRIDOLIN WILD

2. 2
McKinsey Global Institute (2018):
Skill Shift: Automation and the
Future of the Workforce
Instituting a culture of lifelong
learning and providing
development opportunities for
employees
More agile corporate structures
featuring less hierarchy and
more collaborative team
networks
Mindset Shift
Activities reallocated between
workers with different skill
levels, creating a new set of
“middle skill” positions
Organizational Structures
“New Collar” Jobs
Booming gig economy will lead
to a rise in the use of
independent contractors and
freelancers
Workforce Composition
Senior leadership and key
functions will also need to
adapt, including a change in
CEO mindset and talent
strategies to orchestrate the
changes
C-Suite & HR Changes
https://bit.ly/jobgone
Photo: BBC/Nigel Crook
Shift happens

3. 3
Augmented
Humans
Smart
glasses
Smart
gloves
Smart
textiles
Smart
armbands
… and wearable robots,
exoskeletons, bci, ems,
synesthetic mapping, …

4. 4
Performance
Augmentation
Buchem, Klamma, Wild (2019)

5. 5
Smart Glasses
prism
beam
splitter
laser beam
scanning
wave
guide

6. Photo: WEKITPhoto: WCC, Georgia Tech
6
“Smart Textiles are textiles that are able to
sense stimuli from the environment, to react to
them and adapt to them by integration of
functionality in the textile structure.”
— Van Langenhove & Hertleer (2004)
Smart TextilesCONTEXT AWARE
• Textiles-as-carrier
integrate off-the-shelf electronic
components
• Textiles-as-sensors/actuators
hybrid, replacing some electronics parts
• Smartening up textiles
logic boards and electronic components
replaced by textiles
— Cherenack et al. (2012)
Photo: Levi’s / Google Jacquard

7. Photo: HoloCare
Film: Pearson’s
HoloPatient
7
Reconstruction
Photo: WEKIT

8. Rendering allows these days to not only
use directional light, but to react to
reflections, shadows, shading, etc. with
reverse rendering, light source estimation,
and spherical harmonics.
virtual
8
Light Estimation
CONTEXT AWARE

9. With the advent of affordable depth
cameras or, alternatively, using multiple
cameras / frames, it becomes possible to
do simultaneous localization and mapping
(SLAM) and spatial mapping in real-time.
XR applications can now handle occlusion
properly, but also gain understanding of
the surrounding fromcognitive services.
9
Spatial Computing
CONTEXT AWARE

10. GHOST HANDS
Scavo, Wild, Scott (2014)
10

11. Experience
Capturing &
Sharing
11

12. 12
Ghost Track
Sharma, Klemke, Wild (2019)
Limbu, Vovk, Jarodzka, Klemke, Wild, Specht (2019)

13. 13
build for FLOW
not ASSETS
Support
Practice
Action Info
Task Info
Limbu, Jarodzka, Klemke, Wild, Specht (2018);
Limbu, Fominykh, Klemke, Specht, Wild (2017)

14. The standard for
describing AR-enriched
learning activities.
For real world executable learning flows
linking with their environment description.
https://sagroups.ieee.org/1589/
Augmented Reality
Learning Experience Models
14Girard et
al. (1999)
Scale Upand write-down through sharing
o No specialist tools and skills
o Not tied to a platform
o Run on any device
o Integrate with sensors
o Branching and flow control
o Instructional feedback
o Check for errors
o Automatically validate
o Support, update, modify, reuse
without tool licenses or tool skills
14

15. 15
LMS / VLE
Learning Content Management
(Moodle, Degreed, FutureLearn,
BrightSpace, …)
CAD, CAE
3D models and animations
(AutoCAD cloud, Matterport,
TurboSquid, EF-EVE,
…)
TDOC
Handbooks (DITA, DocBook,
MuMaSy,S1000D)
HCM / TM
HR management
(SAP Success Factors, Monday, …)
SSO
Enterprise Single Sign on
(OpenID, LDAP, …)
AR CLOUD
AR Mapping Data
(Azure Spatial Anchors & maps, OGC,
Cloud Anchors, Open AR cloud, …)
MARKER CLOUD
Image Targets (Vuforia, …)
Application
Eco-system

16. 16
Open Source · IEEE P1589-2020
compliant · Unity3D · (Moodle)
RELEASED
Mirage·XR
Community Edition

17. 17
Can you really spend that much time in it?
Can we create the infinite office (for
smart working)?
What are the vehicles of introduction?
How can we make digitization a success?
AR cloud
What can be done to
prevent Digital Poverty?
How to manage
social interaction
between
’wearers’ and ‘non-
wearers’?
How do we manage competing realities?
Volumetric capture
Repositories
Holographic AIs
WebXR
How to get human factors right (for once)?
Digital Twins
Reality as a
Medium
What contributes to acceptance?
How to build trust
towards tech?
Wearable interaction
Cognitive Services
Linked Data
John Tenniel, Illustration for Lewis
Carroll’s ‘Through the Looking Glass’

18. Prof Dr Fridolin Wild
wild@open.ac.uk