2. AGENDA
•What is augmented reality???
•Components and technologies used….
•How does it work
•Applications
•Recent innovations
•Future innovations
•Benefits of AR
•Educational Benefits of AR
•As per the update on March 8th
,2013
•Conclusion
3. WHAT IS AUGMENTED
REALITY???
•Augmented reality (AR) is a live, direct or
indirect, view of a physical, real-world environment
whose elements are augmented by
computer-generated sensory input such as sound,
video, graphics or GPS data.
• It is related to a more general concept called
mediated reality, in which a view of reality is
modified (possibly even diminished rather than
augmented) by a computer. As a result, the
technology functions by enhancing one’s current
perception of reality . By contrast, virtual reality
replaces the real world with a simulated one
•With the help of advanced AR technology (e.g.
adding computer vision and object recognition) the
information about the surrounding real world of the
user becomes interactive and digitally manipulable.
Artificial information about the environment and its
objects can be overlaid on the real world.
4. COMPONENTS AND TECHNOLOGIES USED…..
Hardware
Hardware components for augmented reality are: processor, displayon, sensors and
input devices. Modern mobile computing devices like smartphonesand
tablet computers contain these elements which often include a camera and MEMS
sensors such as accelerometer, GPS, and solid state compass, making them suitable
AR platforms
Display
Includes optical projection systems, monitors,handheld devices and display systems
worn on one’s person.
Head-mounted
A head-mounted display (HMD) is a display device paired to a headset such as a
harness or helmet. HMDs place images of both the physical world and virtual objects
over the user's field of view. Modern HMDs often employ sensors for six
degrees of freedom monitoring that allow the system to align virtual information to the
physical world and adjust accordingly with the user's head movements.[9][10][11]
HMDs
can provide users immersive, mobile and collaborative AR experiences.
Eyeglasses
Versions include eye wear that employ cameras to intercept the real world view and re-
display its augmented view through the eye pieces[13]
and devices in which the AR
imagery is projected through or reflected off the surfaces of the eye wear lens pieces.
[14][15][16]
Virtual retinal display
A virtual retinal display (VRD) is a personal display device under development at the
University of Washington's Human Interface Technology Laboratory. With this
technology, a display is scanned directly onto the retina of a viewer's eye. The viewer
sees what appears to be a conventional display floating in space in front of them
5. EyeTap
The EyeTap (also known as Generation-2 Glass) captures rays of light that would otherwise pass through the
center of a lens of an eye of the wearer, and substituted each ray of light for synthetic computer-controlled
light. The Generation-4 Glass (Laser EyeTap) is similar to the VRD
Handheld
Handheld displays employ a small display that fits in a user's hand. All handheld AR solutions to date opt for
video see-through. Initially handheld AR employed fiduciary markers, and laterGPS units and MEMS sensors
such as digital compasses and six degrees of freedom accelerometer–gyroscope. Today SLAM markerless
trackers such as PTAM are starting to come into use.
Tracking
Modern mobile augmented reality systems use one or more of the following tracking technologies:
digital cameras and/or other optical sensors, accelerometers, GPS, gyroscopes, solid state compasses, RFID
and wireless sensors
Input devices
Techniques include speech recognition systems that translate a user's spoken words into computer
instructions and gesture recognition systems that can interpret a user's body movements by visual detection
or from sensors embedded in a peripheral device such as a wand, stylus, pointer, glove or other body wear
Computer
The computer analyzes the sensed visual and other data to synthesize and position augmentations.
Software and algorithms
A key measure of AR systems is how realistically they integrate augmentations with the real world. The
software must derive real world coordinates, independent from the camera, from camera images. That
process is called image registration which uses different methods of computer vision, mostly related to
video tracking. Many computer vision methods of augmented reality are inherited from visual odometry.
Usually those methods consist of two parts.
First detect interest points, or fiduciary markers, or optical flow in the camera images. First stage can use
feature detection methods like corner detection, blob detection, edge detection orthresholding and/or
other image processing methods. The second stage restores a real world coordinate system from the data
obtained in the first stage.
6. How Does It
Work?
The computer software recognizes the AR
markers (black squares) that contain certain
patterns, measures each side and does some
complex calculations to determine the position
and rotation of the marker in 3D space. This
information allows the computer to render photo-
realistic 3D objects over the marker and display
the result in both the handheld visor and on a
large computer screen. The pattern within the
marker dictates which 3D object will be
displayed, and can also trigger narration and
sound effects. Markers can be a variety of sizes
and attached to almost any flat surface, which
means they can be used in many interesting and
effective ways.
7. Main classes of applications:
Medical
Manufacturing and repair
Annotation and visualization
Robot path planning
Sports and Entertainment
Military aircraft
Archaeology
Architecture
Art
Commerce
Education
Military
Navigation
Tourism and sightseeing
Translation
There are several miscellaneous
applications.
Applications
8. Augmented view of River Wear inAugmented view of River Wear in
Sunderland, Newcastle (U.K.) withSunderland, Newcastle (U.K.) with
a planned footbridgea planned footbridge
Virtual fetus inside womb of pregnant
patient. (Courtesy UNC Chapel
Hill Dept. of Computer Science.)
Mockup of breast tumor biopsy. 3-D graphics
guide needle insertion.
(Courtesy UNC Chapel Hill Dept. of Computer
Science.)
VR HUDset used in the wire shopVR HUDset used in the wire shop
to connect the wires by showingto connect the wires by showing
an image of the circuit andan image of the circuit and
information about type of wire toinformation about type of wire to
be usedbe used
(Boeing, US)(Boeing, US)
9. Virtual lines help display geometry of shuttle bay asVirtual lines help display geometry of shuttle bay as
seen in orbitseen in orbit
(U. Toronto, Canada)(U. Toronto, Canada)
Engine model part labels appearEngine model part labels appear
as user points at themas user points at them
(ECRC)(ECRC)
Virtual lines show planned motion of a robot armVirtual lines show planned motion of a robot arm
(U. Toronto, Canada)(U. Toronto, Canada)
10. Nightvision system in the 2000 Cadillac DeVilleNightvision system in the 2000 Cadillac DeVille
(Cadillac.com.)(Cadillac.com.)
Head Up Guidance System (HGS)Head Up Guidance System (HGS)
(Flight Dynamics Inc.)(Flight Dynamics Inc.)
Boeing 737 cockpit with Head-upBoeing 737 cockpit with Head-up
Display (HUD)Display (HUD)
(Flight Dynamics Inc.)(Flight Dynamics Inc.)
Real-time facial expression recognitionReal-time facial expression recognition
and animation of the clone’s faceand animation of the clone’s face
(MIRALab, University of Geneva)(MIRALab, University of Geneva)
11. AR can clearly demonstrate:
oSpatial concepts
oTemporal concepts
oContextual relationships
between both real and
virtual objects
These factors make
AR a powerful
educational tool.
12. • Grabs interest and increases
motivation.
• Engages kinaesthetic learning:
oObject manipulation:
Turning pages.
Moving objects.
Moving users head.
oFurther interaction:
Combining objects.
Re-arranging objects.
Animating objects.
• Can use various learning techniques:
oConstructivism.
oKnowledge Exploration.
oGuided-practice.
EDUCATIONAL BENEFITS OF AR
13. RECENT INNOVATIONS IN
AUGMENTED REALITY:
1. Qualcomm – Sesame Prototype Play set
2. Balance Studios – Rocks in my socks, children story
book
3. AR Lab
4. Keytree Ltd – CEO Vision
5. E-axis Inc – Transporter app
6. Interface3
7. iSee – War of the Worlds
8. App Shaker - National Geographic
9. String - Nike Boxpark
10. Pimento Vision – Vodafone Foundation
11. Somo – Audi Le Mans
FUTURE INNOVATIONS IN AUGMENTED
REALITY:
1 .AR glasses
2 .Free and Paid AR apps
3 .AR education and trade googles
4. Brain wave AR
5. Second stage AR headsets and pods
14. AS PER THE UPDATE ON MARCH 8PDATE ON MARCH 8THTH
,2013,2013
•Field Trip is an information assistant that takes local
discovery and makes it even better with augmented
reality. It runs in the background until you are near
something interesting (or something it recognizes) and
then notifies you and tells you all about that particular
locale with ‘field cards’.
•Field Trip also works like a recommendation engine,
suggesting the best places you can visit nearby. The
app sources all its information from hyper local sites
like Thril list, Food Network, Zagat, and Run Riot for
the best places to eat and drink; Sunset, Cool Hunting,
We Heart, Inhabitat, and Remodelista for the latest
unique stores and products; Songkick and Flavor pill
for local music; and Atlas Obscura and Daily Secret for
yet undiscovered facets of the place you’re visiting.
15. CONCLUSION
AR is a relatively new field (since 1993) and is far behind VR in
maturity.
Several vendors sell complete, turnkey VR systems.
No commercial vendor currently sells an HMD-based AR system.
First deployed HMD-based AR system will probably be in the
application of aircraft manufacturing (Boeing is currently exploring
this technology extensively).
A breakthrough is required in real-time HMD tracking in the
outdoors at the accuracy required by AR for this technology to
move ahead rapidly.
AR has a great future as it promises better navigation and
interaction with real and virtual world in ways which has
previously been unimaginable.