3. INTRODUCTION
๏ Sixth sense is a wearable gesture interface that
aguments physical world around us with digital world.
๏ It lets us use natural hand gestures to interact with
digital world.
๏ It comprises pocket projector ,a mirror and camera .
The hardware components are coupled independent
like mobile wearable device.
4. HISTORY
๏ถSixth Sense is a gesture based wearable computer system
developed at MIT Media Lab by Steve Mann in 1994 and 1997
(head worn gestural interface), and 1998 (neck worn version).
๏ถFurther developed by Pranav Mistry (also at MIT Media Lab),
in 2009, both of whom developed both hardware and software
for both head worn and neck worn versions of it.
6. CAMERA
๏ Captures an object in view and
tracks the users hand gestures.
๏ It sends data to smart phone.
๏ It acts as digital eye
,connecting you to the world of
digital information
PROJECTOR
๏ The projector projects visual
information enabling surfaces
and physical objects to be used
as interfaces.
๏ A tiny LED project displays
data sent from the smart phone
on the any surface in view-
object, wall or any person.
7. Mirror
๏ The usage of mirror is
significant as the project
dangles pointing downwards
from the neck.
Mobile
๏ A web enabled smart phone
in users pocket processes the
vedio data.
๏ Other software searches the
web and interprets the hand
gestures
8. Colour markers
๏ It is at the tip of the userโs fingers.
๏ Marking the userโs fingers with red, yellow, green, blue tape
help the web cam recognize the gestures
๏ The movement and arrangement of these makers are
interpreted into gestures that act as interaction instructions for
the projected application interfaces
9. Working
โขThe hardware that makes Sixth Sense work is a pendant like mobile
wearable interface.
โขIt has a camera, a mirror and a projector and is connected wirelessly to
a Bluetooth or 3G or wi-fi smart phone that can slip comfortably into
oneโs pocket.
โข The camera recognizes individuals, images, pictures, gestures one
makes with their hands.
10. โขInformation is sent to the Smartphone for processing.
โขThe downward-facing projector projects the output
image on to the mirror.
โขMirror reflects image on to the desired surface.
โขThus, digital information is freed from its confines
and placed in the physical world.
12. Applications
TAKE PICTURES
๏ถIf you fashion your index fingers and
thumbs into a square ( โframingโ
gesture) we can take a snap.
๏ถAfter taking the photos, we can
project them onto a surface, and use
gestures to sort through the photos, and
organize and resize them.
13. ZOOMING FEATURES
๏ถWe can arrange those pictures. The user
can zoom in or zoom out by just using
hand movements
ABOUT BOOK INFORMATION
๏ถMaes says Sixth Sense uses image
recognition or marker technology to recognize
products you pick up , then feeds you
information on books. The system can project
Amazon ratings on that book, as well as
reviews and other relevant information.
14. MAKE A CALL
๏ถYou can use sixth sense to project a
keypad onto your hand, then use the that
key pad to make a call
CREATES MULTIMEDIA
READING EXPERIENCES
๏ถSixth sense can be programmed to
project related videos onto news paper
articles you are reading.
15. FEED INFORMATION ON PEOPLE
๏ถThe system will project some relevant
information about a person such what
he/she does, where they work, and so
on.
GET FLIGHT UPDATES
๏ถThe system will recognize your
boarding pass and you know whether
your flight is on time and if the gate
has changed
16. DRAWING APPLICATION
๏ถThe drawing application lets the user
draw on any surface by tracking the
fingertip movements of the userโs index
finger
CHECK THE TIME
๏ถ Draw a circle on your wrist to get
virtual watch that gives you the correct
time
17. GETS PRODUCT
INFORMATION
๏ถSixth sense uses image recognition or
marker technology to recognize products
we pick up and feed us information on
those products
๏ถ The sixth sense also implements
map which lets the user display the
map on any physical surface and find
his destination and he can use his
thumbs and index fingers to navigate
the map
CALL UP A MAP
18. Advantages
๏ Portable.
๏ Support multi touch and multi user interaction.
๏ Cost effective($330).
๏ Data access directly from machines in real time.
๏ Open source software
19. Disadvantages
๏ Hardware limitation of the devices ,that we are currently
carry around us.
๏ For example many phones will not allow the external
camera feed to be manipulated in real time.
๏ Post processing can occur however.
20. Conclusion
๏ Sixth sense recognizes the object around us, displaying the
information automatically and letting us to access it in any way
we need.
๏ The sixth sense prototype implements several applications that
demonstrate the usefulness , viability and flexibility of the
system.
๏ The potential of becoming the ultimate โtransparentโ user
interface for accessing information about everything around us.
๏ Allowing us to interact with this information via natural hand
gestures.