1. Electronic Hand Glove for
Speech Impaired and
Paralyzed patients
by
NAZISH PERVAIZ

2. Outline of the presentation
 Objective.
 Block diagram
 Data Acquisition Methods
 Flex sensors
 Main Program’s Flow chart
 Advantages of gesture based control.
 Other applications of gesture control
system

3. Objective
 How often do we come across a disabled person, say a
visually or speech challenged individual in mainstream
life? The truth is that there is often little room for the
disabled in the real world.
 With our project, we have tried to make a small effort
which can be the first step to providing the disabled an
aid to establish an independent and sustainable lifestyle.
 The basic objective of our project is to develop a
portable device for the people who suffer from speech
impairment, providing them an aid to communicate
easily.

4. Continued….
 This project is useful for the people who suffer
from speech impairment and use sign language as
a means of communication, which is understood
only by a few[4]. Similarly it can provide aid to
the patients with half of their bodies paralyzed and
who are not able to speak but are able move their
fingers.
 But the sign language vary from region to region
and learning it is not an easy task.

5. Motivation
 The motivation is American Sign Language
(ASL). ASL uses hand shape, position and
movement. Body movements, gestures,
facial expressions, and other visual cues to
form its words[14,15].

6. Block diagram
Main components used in the project
 Flex sensors
 PIC microcontroller with built in ADC.
 LCD display.

7. Analog to Digital
Converter Microcontroller
“GIVE ME
WATER”
“A”
“B”

8. American Sign Language (ASL)

9. Data Acquisition:
 EMG
 MMG
 Conductive fibers
 Deterioration of optical fiber
 Strain gauge tactile sensor
 Flex sensors

10. EMG
EMG patterns are different for different individuals
•Vary due to location of electrodes
•User fatigue
•Sweat on skin

11. EMG
EMG patterns are different for different individuals
•Vary due to location of electrodes
•User fatigue
•Sweat on skin

12. Coupled microphone accelerometer
sensor pair
•MMG measurement of muscular vibration
•Electrode impedance variation due to sweating
•Signals larger than EMG
•Less sensitive to precise placement
•Special filtering is required

13. Wearable conductive fiber
•Change resistance as length of fiber is changed
•Placed on flexible fabric
•Uncomfortable to wear continuously

14. Deterioration of optical fiber
•Depends on amount of light reached
•Difficult to deteriorate evenly
•Weakens the optical fiber

15. Flex sensors
 Flex sensors are the sensors that change in
resistance depending on the mount of bend
on the sensor. They convert the change in
bend to electrical resistance - the more the
bend, the more the resistance value [18,19].
 They are usually in the form of a thin strip
from 1"-5" long
 Inside the flex sensor are carbon resistive
elements within a thin flexible substrate.
 With a typical flex sensor, a flex of 0
degrees will give 10K resistance will a flex
of 90 will give 80-100K ohms.
 The Bend Sensor lists resistance of 30-250
K ohms.

16. Electrical characteristics
Size approx 0.28" wide and 1"/3"/5" long
Resistance Range1.5-40K ohms depending on sensor.
Flex point claims a 0-250 resistance range.
Lifetime Lifetime Greater than 1 million life cycles
(rugged)
Temperature Range -35 to +80 degrees Celsius
Hysteresis 7%
Voltage 5 to 12 V

17. As used in the project
Vout = V*Rbend / Rbend+Rm

18. Advantages
 Economical
 Thin, flexible, robust
 Simple one piece construction
 Operates in a large temperature range
 Provides greater accuracy than tradition
potentiometer
 Able to withstand exposure to moisture in
harsh environment

19. Limitations
 Major drawback using this sensor is that it is very
sensitive to small bends, due to which its output
deviates slightly even when the hand is steady.
 So to over come this problem we have used it in
voltage divider configuration and moreover
stitched pockets on the glove so the sensors do not
change their position, and defined voltage ranges
in out program.
 The result of this arrangement is that the output
voltage increases with increasing deflection

20. Look up Table
D14 D7 B9 F16 B1
a 3.4-3.8 1.9-2.3 1.4-1.7 1.2-1.4 1.7-2.5
b 2.8-3.2 1.3-1.7 1.1-1.3 0.9-1 2-2.3
c 3.1-3.9 1.5-1.9 1.2-1.3 0.9-1.1 2-2.3
d 2.9-3.4 1.8-2 1.3-1.4 1-1.1 1.8-1.9
e 3.4-4.5 1.9-2 1.3-1.5 1.1 2.3-2.6
f 3.3-4.1 1.5-1.6 1.1-1.3 0.9-1 1.7-1.9
g 2.9-3.5 2.1-2.4 1.5-1.7 1.2-1.4 1.7-1.8
h 2.8-3.3 1.4-1.6 1.6-2.1 1.2-1.5 2-2.2
i 3.2-3.7 2.1-2.3 1.6-1.9 0.9-1 2-2.1
j 3.4-4.1 2.1-2.4 1.3-1.8 0.8-0.9 1.9-2.1
k 3.0-3.3 1.4-1.6 1.5-1.9 1.2-1.5 1.7-2
l 3.1-3.3 2.3-2.6 1.6-1.8 1.2-1.5 1.7-1.8

21. m 3.6-3.9 1.9-2.5 1.4-1.7 1.3-1.8 2.1-2.7
n 3.4-3.8 1.8-2.0 1.8-2 1.2-1.6 2.2-2.4
o 3.2-3.8 1.8-2 1.4-1.5 1-1.2 1.8-2
p 2.8-3.3 1.9-2.2 1.5-2 1.4-1.6 1.7-2.2
q 2.9-3.2 2.1-2.3 1.6-1.8 1.1-1.5 1.6-1.9
r 2.9-3.2 1.4-1.7 1.8-2 1.2-1.5 1.9-2.1
s 3.7-4.2 2.2-2.3 1.7-1.9 1.2-1.5 1.8-2.2
t 3.1-3.6 2.2-2.4 1.6-1.8 1.3-1.4 2-2.1
u 3-3.4 1.5-1.6 1.9-2 1.1-1.5 2
v 3-3.8 1.5-1.7 1.5-2 1.2-1.5 2-2.3
w 2.9-3.3 1.5-1.6 1.1-1.3 1-1.2 2-2.3
x 3.4-3.6 2.2-2.6 1.6-2 1.3-1.5 1.9-2.2
y 3.7-3.9 2.2-2.4 1.6-1.7 1-1.1 2-3.6
z 3-3.4 2.3-2.6 1.7-1.9 1.1-1.5 2.0-2.4
Continued…

22. Define a two dimensional
array and create a look
up table in ROM
Read data from ADC port
Iterate from A to Z
Compare input data with
data in look up table
Print the alphabet
on LCD Display
true
Increment to next
alphabet
False
Flow chart

23. Advantages of Gesture Based Control.
Applications & Future
Recommendations

24. Advantages of gesture based
control
 Does not need Key board, mouse, speech recognition,
touch screen etc.
 Does not require expensive and sophisticated Devices
 Does not need the attendant or Doctor to understand sign
language as well.
 The subject need not learn complex gestures of different
words in ASL.
 The prototype can be enhanced to perform various tasks or
turn on/off home appliances/equipments automatically.
 With the glove on and device worn as a wrist watch, only
power cable with battery adapter is required to plug in.
 With a text to speech converter the person suffering from
speech impairment can actually talk to every one!

25. Applications
 In house hold & Security Systems.
 In industries.
 In biomedicine.
 In virtual reality.

26. In house hold & Security Systems.

27. MMG Based Control of a free
standing Prosthetic hand:

28. Gesture Based Control of
Electronic Wheel Chair

29. In Industries
 At high temperatures.
 Where Human hands
cannot reach.
 A robotic hand that can
work like a human
hand.

32. THANK YOU 