Augmented Reality (AR) is replacing user manuals at an increasing rate. This is seen extensively in the automotive and aerospace markets where AR viewed with a smartphone or tablet delivers maintenance information. Projected savings for using AR coupled with wearable
technology is in the billions for the field service industry alone. With the expected growth in AR and our already compatible devices, customers will expect it. This session focuses on the future of AR in the field of technical communications. The topics discussed in this session
are supported by findings from the Huawei AR Think Tank held in 2014. Learn how to get prepared within our technical communication organizations, our companies, and within our industry as a whole.
1. HUAWEI TECHNOLOGIES CO., LTD.
FUTUREWEI TECHNOLOGIES, INC.
#STC2015 6/24/15
#STC Summit 2015
Columbus, OH
PREPARING FOR AUGMENTED
REALITY IN TECHNICAL
COMMUNICATIONS
RHONDA TRUITT
SALLY MARTIR
2. HUAWEI TECHNOLOGIES CO., LTD.
Introduction
Introducing Rhonda Truitt
► Director of the Technical
Communication Innovation and Best
Practices Center, and
► Global Chief Information Architect at
Huawei,
► Founder of the Huawei AR Think Tank,
► Convener and co-Chairperson for the
OASIS Augmented Reality in Information
Products Technical Committee (ARIP
TC), and
► Multitasking extraordinaire, mother of
three busy teenagers,
@RhondaTruitt
www.linkedin.co
m/in/rhondatruitt
3. HUAWEI TECHNOLOGIES CO., LTD.
Introduction
I am Sally Martir.
► Huawei Documentation Project Manager,
► Participate in innovative Huawei technical
communications projects,
► Helped plan and host the Huawei 2014 AR Think
Tank,
► Member of the OASIS Augmented Reality in
Information Products Technical Committee (ARIP
TC), and
► Favorite quote: “When you see a lady running
down the street, she’s not running away from
home. She’s just exercising.”
- Siri Martir 5 years old, 2003
@SallyMartir
www.linkedin.co
m/in/sallymartir
4. HUAWEI TECHNOLOGIES CO., LTD.
Huawei is a global leader of Information and Communications
Technology (ICT) solutions. We
► Do business in 170 countries and regions for telecom carriers,
enterprises, and consumers.
► Have 170K employees.
► Reached annual sales revenue of $46.5B in 2014
► Rank 285th on the Global Fortune 500.
Huawei documentation is dedicated to innovation in content
development, usability, and best practices.
Introduction
6. HUAWEI TECHNOLOGIES CO., LTD.
Definitions – Augmented Reality
A technology that superimposes or
overlays a computer-generated
image on a user’s view of the real
world, thus providing a composite
view.
10. HUAWEI TECHNOLOGIES CO., LTD.
Definitions – Virtual Reality
A computer-generated simulation (or in
other words, a completely fake
computer world)of a three-dimensional
image or environment that can be
interacted with in a seemingly real or
physical way by a person using special
electronic equipment, such as a helmet
with a screen inside or gloves fitted with
sensors.
13. HUAWEI TECHNOLOGIES CO., LTD.
The Reality-Virtuality Continuum
The area between the completely virtual and the completely real. Consists
of both augmented reality, where the virtual augments the real, and
augmented virtuality, where the real augments the virtual.
Real Environment Augmented Reality Augmented Virtuality Virtual Environment
Mixed Reality
Milgram (1994 )
14. HUAWEI TECHNOLOGIES CO., LTD.
Benefits of AR
Columbia University- Dr. Steven Feiner’s AR study findings
► Faster procedural task performances are possible in AR with fewer errors.
DAQRI-
► Studies have shown a 94% reduction in quality errors when using a tablet
with AR instructions vs. a traditional desktop with typical documentation
instructions.
► Contextual instructions at point of use.
► Increases productivity.
► Locate and identify remote expert support.
► Reduce personal risk to engineers working in difficult environments.
► Identify any asset and instantly receive maintenance instructions.
► Mobile and hands-free experience.
15. HUAWEI TECHNOLOGIES CO., LTD.
Iowa State University & Boeing Study
First Time Quality
The ability for a novice trainee
with little or no experience to
perform an operation the first
time with no errors.
The results show AR has the
potential to improve first time
quality on assembly tasks.
Tablet AR had significantly
lower errors.
Error by Mode
Inter-service/Industry Training, Simulation, and Education Conference (I/ITSEC) 2014
16. HUAWEI TECHNOLOGIES CO., LTD.
Iowa State University & Boeing Study
Fastest Time
The amount of time to
complete a task as well as
the learning curve.
The results indicate that
most AR participants
completed the assembly
task faster the first time
than with other modes.
Time by Mode
Inter-service/Industry Training, Simulation, and Education Conference (I/ITSEC) 2014
17. HUAWEI TECHNOLOGIES CO., LTD.
Iowa State University & Boeing Study
Inter-service/Industry Training, Simulation, and Education Conference (I/ITSEC) 2014
Worker Efficiency
The first and second trials using
the Tablet AR mode recorded
significantly fewer average
number of tablet looks.
The fewer number of looks
meant that participants were
not "bouncing" back and forth
between the instructions and
the physical task. They were
able to focus on the actual
assembly steps, as they
understood the instructions
more quickly.
Average # of Tablet Looks
19. HUAWEI TECHNOLOGIES CO., LTD.
What she noticed…
Volkswagen Databrowser
Mobile Service Information
enhanced with Mobile Augmented
Reality Technical Assistance System
…was that many
of the AR
examples she saw
were also
technical
communication.
20. HUAWEI TECHNOLOGIES CO., LTD.
What she noticed…
Audi eKurzinfo
Augmented Reality
Application
…was that many
of the AR
examples she saw
were also
technical
communication.
21. HUAWEI TECHNOLOGIES CO., LTD.
What she noticed…
SAP and Vuzix AR Installation
Instructions and Part Diagram
…was that many
of the AR
examples she saw
were also
technical
communication.
http://youtu.be/UlpGDrSmg38
www.youtube.com/watch?v=9
Wv9k_ssLcI
22. HUAWEI TECHNOLOGIES CO., LTD.
AR examples and use cases…
The interior of a switch cabinet is super imposed on the
exterior using an AR mobile app.
23. HUAWEI TECHNOLOGIES CO., LTD.
Procedure steps displayed on vehicle
Original
Place of Task
(Screw)
Augmented
Place of Task
ELSA
Metaio and Volkswagen
24. HUAWEI TECHNOLOGIES CO., LTD.
…are instructions and procedures to aid in task
completion. This is technical communication.
HVAC
Maintenance
Many AR examples and use cases…
26. HUAWEI TECHNOLOGIES CO., LTD.
What I noticed…AR Think Tank
She learned more.
Then she held an
AR Think Tank.
She also touched
on wearable
technology.
27. HUAWEI TECHNOLOGIES CO., LTD.
What I noticed…Networked
She networked
and met lots of AR
people who taught
her a lot more
about AR.
28. HUAWEI TECHNOLOGIES CO., LTD.
What I noticed…And, she came to the conclusion that…
The AR World doesn’t know we
are here!
They don’t know what we do!
They don’t know that we already
have a lot of what they need in place!
No matter how cool the AR, if we don’t create quality
task-based content that meets the user requirements,
the user will not be satisfied.
TECH
COMM
29. HUAWEI TECHNOLOGIES CO., LTD.
What I noticed…“Hey, here we are!”
Content came up, but still, no one mentioned technical
communication, or technical writers,…although a high
percentage of AR use cases provide just that - technical
instructions. This is the skill set of the technical
communicator!
We need to let
the AR world
know-
30. HUAWEI TECHNOLOGIES CO., LTD.
What I noticed…We need to let the AR world know-
The technical communicator brings skills and benefits to an AR project:
► Knowledge of the user & how he or she interacts with a product,
► User task analysis,
► User requirements collection,
► Persona development,
► Relationship with design (a bridge between SME and customer
needs, language/jargon and understanding),
► Minimalistic writing,
► Information architecture,
► Content re-use,
► Modular content development,
► Content management,
► Editing,
► Usability testing, and
► Testing for quality and accuracy.
31. HUAWEI TECHNOLOGIES CO., LTD.
AR in Information Products best practices, guidelines, standards &
specifications do not exist for the technical writer.
Yet, AR and wearable technology are expected to have
phenomenal growth in the next few years.
► 864M phones were AR enabled in 2014 (Semico Research Corporation)
► By the end of 2016, AR will have revenue of $600B (Semico Research
Corporation)
► Wearable technology revenue will hit $19B by 2018. (Juniper
Research)
► 103M cars AR enabled by 2020 (Gov2020)
Meanwhile, Technical Communication departments must prepare.
Technical Communicators have needs…
32. HUAWEI TECHNOLOGIES CO., LTD.
“Man who waits for roast
duck to fly into mouth
must wait very, very long
time.” ~ Chinese proverb
34. HUAWEI TECHNOLOGIES CO., LTD.
Technical Communication departments can prepare.
For example:
► What planning metrics should be used to estimate a projects
resource requirements?
► What are the dependencies in an AR technical
communication project?
► What process, workflow and timeline changes are required?
► What types of content are good candidates for AR
enhancement? What is the business case?
► Where in the company do 3D models come from? How do we
gain agreement to get them?
► What hardware will the users need (smart glasses? Android or
ios devices? Smartphone? Tablet?)
► What recognition and tracking methods will be used?
► What delivery and connectivity is necessary?
► Will existing content be used? Is video required? Which topics
are suitable for AR?
► What AR development software to choose?
Technical Communication key considerations
35. HUAWEI TECHNOLOGIES CO., LTD.
We selected a product that we had in our local lab, that we could acquire 3D CAD drawings
of internally, and we used an existing parts replacement procedure. We used a Video
camera to record the AR experience as seen through the eyes of the operator.
Huawei AR proof of concept
Huawei Android
tablet with DAQRI
App
DAQRI marker
on lab equipment
40. HUAWEI TECHNOLOGIES CO., LTD.
A Need for Standards:
AR in Information Products-
Preparing as an Industry
41. HUAWEI TECHNOLOGIES CO., LTD.
Augmented Reality in Information Products
Technical Committee
ARIP TC is a new Technical Committee
► submitted through OASIS to define the introduction and implementation of AR into
information products by developing standards, specifications, and guidelines for
technical communicators to use when developing and delivering AR-enriched
procedures and concepts.
The TC’s goals are
► to define the introduction and implementation of AR into information products by
developing standards, specifications, and guidelines for technical communicators to
use when developing and delivering procedures and concepts through AR.
► to promote the adoption of AR-enabled (or supplemented) information products.
► to provide expertise and resources to educate the marketplace on the value of
integrating AR into traditional information products.
► to increase the demand for, and availability of, AR-conforming products and services.
This will result in a greater choice of tools and platforms, and an expanded AR
community of users, suppliers, and consultants.
42. HUAWEI TECHNOLOGIES CO., LTD.
TC Launch Timeline (Completed)
Draft
Charter
Call for
Charter
Convener
Call
Comment
Log & Final
Charter
Call for
Participation
1st TC
Meeting
•Statement of work, scope, and other requirements defined in TC Process
•Submitted by Convener to TC Admin 23 March 2015
•14-day review by OASIS membership at-large
•Issued by TC Admin 24 March, ended 06 April
•Convener, TC Proposers review member comments, finalize charter
•Holding 07 April
•Due to TC Admin no later than 20 April
•Convener may request a single, 10-day extension
•Minimum 30-day join before first meeting (teleconference)
•Latest possible date 23 April
•Official TC launch, elections for chair/co-chairs
•Conference call scheduled for 22 May.
43. HUAWEI TECHNOLOGIES CO., LTD.
A new OASIS Technical Committee is born…
OASIS ARIP TC Roster
► Rhonda Truitt, Huawei Technologies Ltd
► Charles Cooper, The Rockley Group
► Christine Perey, Perey Research and
Consulting
► Farhad Patel, Huawei Technologies Ltd
► Scott Simmons, OGC
► Scott Hudson, Comtech Services, Inc.
► Paul Davies, The Boeing Company
► Greg Babb, Textlogic
► Dr. JoAnn Hackos, Comtech Services
► Matt Kammerait, DAQRI
► Ray Gallon, STC; Transformation Society
► Sally Martir, Huawei Technologies Ltd
► Kristen Eberlein, Eberlein Consulting
► Stephen Prideaux-Ghee, PTC
► Michael Hlibchuk, SAP
44. HUAWEI TECHNOLOGIES CO., LTD.
OASIS Background
Not-for-profit consortium, founded 1993
to advance document standards
Global community
5,000+ participants
600+ orgs & individuals in 100+ countries
Member-driven
Home of 70+ Technical Committees
Source of 100+ ratified Standards:
OpenDocument (ODF), DITA, DocBook, CMIS, ebXML, UBL, XLIFF, WebCGM,
AMQP, SAML, WS-Security, BPEL, XACML, EDXL-CAP, KMIP, XSPA, SPML, UDDI, SOA-
RM, UOML…
North
America
51%
Europe
35%
Asia
14%
45. Contact join@oasis-open.org
44
If your employer is already
an OASIS Member
www.oasis-open.org/member-roster
Create OASIS user account online
www.oasis-open.org/kmembership_info/
person_signup
Join ARIP TC
www.oasis-open.org/committees/join.php
If your employer is not
an OASIS Member yet
Choose membership category
www.oasis-open.org/join/categories-dues
Submit Membership Agreement
www.oasis-open.org/join/membership-
agreement.pdf
No additional dues
Senior Director:
Carol Geyer
carol.geyer@oasis-open.org
How to get involved in ARIP
46. HUAWEI TECHNOLOGIES CO., LTD.
Resources
http://www.volkswagen-media-services.com
http://owni.eu/tag/augmented-reality/
http://www.augmentedrealitytrends.com/augmented-reality/trend-in-car-augmented-reality.html
http://techwhirl.com/what-is-technical-communications/
http://techwhirl.com/what-is-technical-writing/
Definition of Augmented Reality (taken from the AR Glossary http://www.perey.com/ARStandards/ar-glossary-v-2-2/)
http://stc.org/
https://www.oasis-open.org/
www.metaio.com Press Release, “Metaio & Audi AG Release Interactive Augmented Reality Manual for Audi A3” Munich & San
Francisco, 12 August 2013.
www.metaio.com Press Release, “ Metaio and Volkswagen announce MARTA augmented reality service support for new XL1
concept car Augmented reality makes its way into service centers” Munich & Wolfsburg, 30 September 2013.
http://www.computerworld.com/article/2603680/sap-to-release-ar-apps-on-android-wear-for-smart-glasses-in-the-workplace.html
http://www.cnet.com/news/wearable-tech-revenue-to-hit-19b-by-2018 Juniper Research
http://www.semico.com/content/augmented-reality-envision-more-intelligent-world
http://government-2020.dupress.com/wp-content/uploads/2014/11/Transportation-+-Sources-11-10-14_Ramani-proofread.pdf
SAP with Vuzix video http://youtu.be/UlpGDrSmg38
SAP with Vuzix video www.youtube.com/watch?v=9Wv9k_ssLcI
Herrema, Jordan Scott, Iowa University Graduate Thesis 2013 Evaluation of graphical user interface for the augmented reality based
manual assembly support
Huawei Augmented Reality Think Tank: Augmenting the Designer , October 21– Tilanka Chandrasekera
Huawei Augmented Reality Think Tank: DAQRI, October 20- Andy Lowery