Bohemia Interactive Simulations Academic Liaison Andy Fawkes gave a presentation on the "The Human Components of Autonomous Systems" at the Modelling and Simulation for Autonomous Systems conference in Prague on April 29, 2015.

1. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
The Human Component of
Autonomous Systems
Andy Fawkes – Academic Liaison
Modelling and Simulation for Autonomous
Systems 2015 (MESAS 15)
Prague – 29 April 2015

2. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
My Background

3. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
Human Factors can be the
“Poor Relation” in
Research & Acquisition
• and yet
• Training can be 20% of a
Defence Budget
• Warfare is (still) essentially a
Human Centric Activity
Wikipedia

4. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
Recent Journey
The Future of Humans and Machines?
The Human Component of Autonomous Systems
Outline

5. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
Recent Journey

6. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
SCI-274

7. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
Finding…
A Valid and Verified Autonomous System must
Include Human(s), and Simulation has a Key
Role in Developing, Testing and Training both
the Autonomous System and Human(s),
Separately and Together

8. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
Human(s)
Simulation
Autonomous
Systems/
Robotics
Mutually Supportive

9. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
Pixabay
• Assistive systems, including robotic agents, to
support indoor journeys and living for the
Visually Impaired
• Uses a gaming environment for extensive
“scenario”-training of assistive technologies
BISim Assistive Technologies Project

10. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
Wikipedia
• UK MoD/Dstl Autonomous Systems Underpinning
Research (ASUR) Programme
• 'What elements of Unmanned System operations can be
delegated to autonomous systems?‘
• Demonstrate how simulation can be used to explore
those elements of UAS operations that can be delegated
to the AS
• The novel aspect is the exploration of a clearly defined
pipeline to gather and process the data required to build
a visual representation of the operational environment
that can be used for simulation, mission planning,
rehearsal and execution.
BISim Autonomous System Research

11. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
The Future of Humans and Machines?

12. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
US Navy X-47B Drone
US Navy Media Content Services
August 2014
April 2015

13. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
Who is Driving Technology?
Source:- Aeryon Labs & Amazon

14. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
Google Car
Google Dec 14

15. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
April 2015

16. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
New Procurement Models

17. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
Rift Drone
AR.Drone 2.0 + Oculus Rift + Unity + Xbox 360 Controller
Rift Drone is open source: https://github.com/scopus777/RiftDrone

18. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
Mind Control

19. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
Source - Wired - May 13 and http://youtu.be/baEYCberLUA

20. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
Raytheon's Second-Generation Exoskeleton (XOS 2)
Machine Enhanced Humans

21. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
“Pibot” Robot Pilot (Oct 14)
Source: South Korea’s Advanced Institute of Science and Technology – Oct 14

22. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
Google DeepMind AI (Feb 15)

23. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
Technological Singularity?

24. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
Two Views of Technology
Wikipedia

25. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
Some Basic Hurdles Remain!

26. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
Communication and Trust

27. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
The Human Component of
Autonomous Systems

28. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
What is the Future Role of the Human?
Corbis

29. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
Military of the Future?
• What will they do?
• Who will they be?
• Where will they be?
• How will they train?
• Will we need them?
Credit - Joshua Livingston

30. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.

31. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
How Does a UAS Pilot Feel at the End of
the Day?

32. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
Ethical Dimension

33. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
International Campaigns

34. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
Nothing New in the World
Wikipedia

35. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
Our Challenge
• “How society uses new
technologies is not a foregone
conclusion.
• It depends on political decisions,
cultural norms and economic
choices as much as on the
technologies themselves.”
”Our Work Here is Done. Visions of a Robot Economy” NESTA June 14
http://www.nesta.org.uk/publications/our-work-here-done-visions-robot-economy

36. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
So What?

37. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
Technology is Advancing Fast
Pixabay

38. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
but…Humans are Special
Wikipedia
• Millions of Years of Evolution
• Highly Developed Body, Senses & Mind

39. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
We Have Highly Effective Brains
Robert Minor 1916

40. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
The Optimum Human/Machine Blend
• Humans & Machines should Work in Harmony
Maximising the Strengths of Both

41. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
Autonomous Systems - More than Engineering
Wikipedia
• Psychology
• study of mind and behaviour
• Physiological
• study of normal function in living systems
• Psychiatry
• study, diagnosis, treatment, & prevention of mental
disorders
• Philosophy
• study of reality, existence, knowledge, values, reason,
mind, and language
• Political
• practice and theory of influencing other people

42. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
Conclusion…
The Human Component should be at the Heart of
Autonomous System Capabilities, through-life, &
Simulation has a Key Role in Developing, Testing &
Training both the Autonomous System & Human(s),
Separately & Together

43. Copyright © 2014 Bohemia Interactive Simulations k.s. All other trademarks or copyrights are the property of their respective owners. All Rights Reserved.
Questions?
Wikipedia