Communication for and translation device for deaf-blind person. The glove translates hand-touched alphabet "Lorm", a common form of communication used by people with both hearing and sight impairment , into text and vice versa. A mobile lorm glove which enables deaf-blind person to compose message and even browsing internet , and e-book reading. Lorm glove is made up of a capacitive touch sensor which when pressed the corresponding alphabet is generated and in reception the vibrators are used
2. 2
1.1 Introduction and motivation
Communication is the powerful tool for every individual to share their ideas. We continually
absorb information from the surroundings by our senses – sight, hearing, smell, taste and
touch. But mostly the information is shared via the sense of sight and audioception. Thus it is
difficult for deaf-blind people to connect with the outside world due to the lack of these
senses. Unfortunately, millions of deaf-blind people are excluded from several forms of
communication done by visual or audio, thus they rely on haptics.
There are 30-40 million of blind and 1.5 million of deaf in world & 20 millions of blind and
70 million of deaf in our country. these people cannot communicate normally as we normal
people do so for make their communication simpler and make their life easier we designed a
glove known as mobile lorm glove for their communication.
Deaf blindness is a dual sensory-impairment with a combined loss of hearing and sight. The
cause of the impairment can be congenital or caused by illness, or accidents. This makes them
difficult to communicate with outside world. There has been several researches and
prototypes that have been carried out to provide an assistive technology for deaf-blind people
which would help them in education as well as normal communication purposes. Mechanical
hands for automated finger-spelling or different glove system have been developed over the
last decades which uses the different sign language techniques adopted by the deaf-blind
people. Some of them have been discontinued.
Here in this system we are using an important language for communication purpose i.e.
“LORM” in which the alphabet is suitable on the gloves in a perfectly aligned manner which
when pressed to generate a letter with the help of touch sensors. The alphabets A-Z and
alphanumeric character are suitable on glove at different places. The question arises is that
what is Lorm and how it is used for communication.
3. 3
1.2 Existing System
There have been several research projects have been carried out to provide assistive
technologies for the deaf-blind community. A method was devised in the year 2007 and was
called Tele Braille III. It enables a deaf blind person and a person using a TDD
(Telecommunications Device for the Deaf) to communicate by telephone [1]. This technology
enables face-to-face communications between a deaf blind person and a sighted person. Tele
Braille is used in 2-way communications, it combines a modified Ultra Tec Supercom TDD
with a modified 20-cell, 6-dot braille display as shown in figure 1. Typed information is
translated and displayed via refreshable braille cells. The Supercom TDD unit allows
telephone communication. Packaged with custom firmware and an added braille keyboard,
these units’ function together as Tele Braille III.
The braille display is then used for reading and either the braille or standard keyboard can be
used for writing. By separating the two units, face-to-face conversation is easy. The sighted
partner uses the Supercom TDD device by typing on a typewriter keyboard and seeing the
messages on a visual display. The deaf blind partner keys in messages on the braille keyboard
and reads messages on the braille display.
A system called "Electronics Voice Assistance for Deaf People". This system uses American
Sign Language(ASL), which is the predominant sign language of deaf communities in the
United States and English-speaking parts of Canada. ASL originated in the 19th century in the
American school for the deaf (ASD) in Hartford, Connecticut, from a situation of language
contact. It is the most well document and most widely used language in the world. American
Sign Language is a complex visual-spatial language that is used by the deaf community in the
Unites States and English-speaking parts of Canada. It is a linguistically complete, natural
language it is the native language of many deaf men and woman, as well as some hearing
children born into deaf families. ASL shares no grammatical similarities to English and
should not be considered in any way to be a broken, mimed, or gestural form of English.
A similar advanced glove system, the DB-HAND, implements the Malossi alphabet. Tactile
switches on the surface of the palm need to be pressed and pinched where the Lorm alphabet
uses continuous gestures. Malossi uses a set of discrete symbols that allows a less complex
design because sensors and actuators do not require to be read or fired in clusters. While the
4. 4
pressure sensors of the DB-HAND stick out, the Mobile Lorm Glove uses flat fabric sensors
to not constraint smooth gestures.
After consultation with deaf-blind partners they decided to render the alphabet on the back of
the hand instead of the palm, in order not to obstruct the deaf-blind too much in their daily
life. Further-more the Mobile Lorm Glove provide vibrotactile feedback to confirm the user
input. The Lormer is the only known previous attempt to address the issue of remote Lorm
communication. It is not a mobile device and only supports text to Lorm. It renders Lorm
using a mechanical stylus that traces lines to a hand resting on a metal grid similar to a
kitchen sieve.
1.3 Problem Statement/Definition
1. While communicating with telebrailleIII the deaf & blind person and the normal person
must know the brail language.
2. The system was bulky to be portable. & the user(deaf blind) has to carry with them for
communicating themselves.
3.Electronic Voice Assistance system is a one way communication from deaf towards the
normal people.
1.4 Objectives
Our objective is to make the communication possible for both deaf as well blind with normal
people. The communication is bidirectional. The system uses lorm language for
communication & it is not necessary for the normal people to be aware of the lorm language.
The device made must be easily portable. Low power consume & easy to use. it can also be
use for controlling other appliances using home automation.
5. 5
1.5 Scope
It will enable deaf-Blind user to communicate with the normal people using lorm to text
conversion and vice-versa. it will also help the blind people to read electronic documents,
may help them to control the home appliances wirelessly.
1.6 Proposed system
Our proposed system will be using the microcontroller as the heart of the entire system which
is interfaced with touch sensors, motors and Bluetooth module. Using touch sensor the
deafblind people will be able to type the message and these generated alphabets will be send
to the other person via the Bluetooth module to the handheld device. When the message is to
be received by the lormer the microcontroller decodes the message received by the Bluetooth
module and the vibration motors starts vibrating.
7. 7
There have been several research projects focusing on filling the gap in assistive technologies
for deaf-blind communication. Mechanical hands for automated finger spelling or different
glove systems have been developed over the last decades implementing a variety of alphabets
[5]. Some of them are discontinued. There are only a few focusing on wearable mobile
devices and consequently a human-centered design approach.
Dipietro, L.; Sabatini, A.; Dario, P [2] have suggested some glove-based systems to obtain
hand movement data. They have also obtained results for characteristics of devices, provided
brief view for evolution of technology and limitations of current technologies. It is an
excellent review of glove-based technology.
Sturman, D.J.; Zeltzer, D., [3] have discussed key hand- tracking technologies and
applications of glove-based inputs. Shin, J.H.; Hong, K.S. [4] describe smart gloves or data
gloves used as input devices presented as alternatives to standard keyboards and mice - both
for desktop and wearable computer. They also introduce a text input device for wearable
computers using gloves to obtain performance parameters.
Gloves with distance sensors, cameras, RFID or special buttons have been used to help the
blind. Peng et al. and Gormer et al. have introduced Mobile Lorm Glove as a communication
device to support the communication of deaf and blind people to make them independent.
This glove translates hand-touch alphabet Lorm into text. With the help of hardware
8. 8
prototype, deaf blind people can generate SMS messages and transmit them to the receiver
side [5,6].
Gloves with speech synthesis have been reported to help people with speech impairment [7].
Ring-type appliances worn on fingers to interact consistently with surrounding have been
devised for appliance control. Nanayakkara, S.; Shilkrot, R.; Maes, P. have suggested a
wearable interface to signal by gestures and touch to access digital information. [8]. Several
systems for medical applications like devices for helping patients with Parkinson‟s disease
have also been developed. They measure biological parameters such as heart rate, skin
resistance etc. [9].
ELECTRONIC VOICE ASSISTANCE FOR DEAF PEOPLE USING AMERICAN SIGN
LANGUAGE was suggested in the year 2014-15 at K.G.C.E under the guidance of proffesor
A.J.Panchal in which communication was made simple & effecient by the use of american
sign language used by deaf people around the world. it introduce an automated system that
understood the hand movements of a deaf person. a sensor glove was used to capture the sign
of american sign language & translated it into audible sentences of english language. this was
a oneway communication, from deaf to normal people.
We have proposed a new system called lorm glove for deaf blind people. in which a glove is
used includes lorm language & lorm alphabate for deaf blind people communication that
consist of different touch sensors & motor vibrators . a phsyical signalling touch required for
communication purpose. it is a two way communication in which deaf blind person can
communicate with normal people & also the normal people can also communicate with them.
also they can communicate among themselves.
10. 10
3.1: Hardware Requirements
3.1.1: MICROCONTROLLER
3.1.1.1: 89S52
A microcontroller is a computer-on-chip. It is a type of microprocessor emphasizing self-
sufficiency and cost effectiveness, in contrast to a general purpose microprocessor. The only
difference between a microcontroller and microprocessor is that a microprocessor has three
parts viz. ALU, Control Unit and registers (like memory), while microcontroller has
additional elements like ROM, RAM etc.
The AT89S52 is a low-power, high-performance CMOS 8-bit microcontroller with 8K bytes
of in-system programmable Flash memory. The device is manufactured using Atmel’s high-
density nonvolatile memory technology and is compatible with the industry standard 80C51
instruction set and pin out. The on-chip Flash allows the program memory to be
reprogrammed in-system or by a conventional nonvolatile memory programmer. By
combining a versatile 8-bit CPU with in-system programmable Flash on a monolithic chip,
the Atmel AT89S52 is a powerful microcontroller which provides a highly-flexible and cost-
effective solution to many embedded control applications. The AT89S52 provides the
following standard features: 8K bytes of Flash, 256 bytes of RAM, 32 I/O lines,
Watchdogtimer, two data pointers, three 16-bit timer/counters, a six-vector two-level interrupt
architecture, a full duplex serial port, on-chip oscillator, and clock circuitry. In addition, the
AT89S52 is designed with static logic for operation down to zero frequency and supports two
software selectable power saving modes. The Idle Mode stops the CPU while allowing the
RAM, timer/counters, serial port, and interrupt system to continue functioning. The Power
down mode saves the RAM con-tents but freezes the oscillator, disabling all other chip
functions until the next interrupt or hardware reset. 8-bit Microcontroller with 8K Bytes In
System Programmable Flash AT89S52.
A89S52 microcontroller is a single integrated circuit, commonly with following features:
• 8K Bytes of In-System Programmable (ISP) Flash Memory – Endurance: 10,000
Write/Erase Cycles • 4.0V to 5.5V Operating Range
• Fully Static Operation: 0 Hz to 33 MHz
• Three-level Program Memory Lock
11. 11
• 256 x 8-bit Internal RAM
• 32 Programmable I/O Lines
• Three 16-bit Timer/Counters
• Eight Interrupt Sources
• Full Duplex UART Serial Channel
• Low-power Idle and Power-down Modes
• Interrupt Recovery from Power-down Mode
• Watchdog Timer
• Power-off Flag
• Fast Programming Time
3.1.2: BLUETOOTH MODULE
HC-05 embedded Bluetooth serial communication module (can be short for module) has two
work modes: order-response work mode and automatic connection work mode. And there are
three work roles (Master, Slave and Loopback) at the automatic connection work mode.
When the module is at the automatic connection work mode, it will follow the default way set
lastly to transmit the data automatically. When the module is at the order-response work
mode, user can send the AT command to the module to set the control parameters and sent
control order. The work mode of module can be switched by controlling the module PIN
(PIO11) input level.
Serial module PINs:
1. PIO8 connects with LED. When the module is power on, LED will flicker. And the flicker
style will indicate which work mode is in using since different mode has different flicker time
interval.
12. 12
2. PIO9 connects with LED. It indicates whether the connection is built or not. When the
Bluetooth serial is paired, the LED will be turned on. It means the connection isbuilt
successfully.
3. PIO11 is the work mode switch. When this PIN port is input high level, the workmode will
become order-response work mode. While this PIN port is input low level orsuspended in air,
the work mode will become automatic connection work mode.
4. The module can be reset if it is re-powered since there is a reset circuit at the module.
fig 3.1 Bluetooth module
3.1.3: TOUCH SENSORS
A pressure sensor measures pressure, typically of gases or liquids. Pressure is an expression
of the force required to stop a fluid from expanding, and is usually stated in terms of force per
unit area. A pressure sensor usually acts as a transducer; it generates a signal as a function of
the pressure imposed. For the purposes of this article, such a signal is electrical.
Pressure sensors are used for control and monitoring in thousands of everyday applications.
Pressure sensors can also be used to indirectly measure other variables such as fluid/gas flow,
speed, water level, and altitude. Pressure sensors can alternatively be called pressure
transducers, pressure transmitters, pressure senders, pressure indicators, piezometers and
manometers, among other names.
13. 13
Pressure sensors can vary drastically in technology, design, performance, application
suitability and cost. A conservative estimate would be that there may be over 50 technologies
and at least 300 companies making pressure sensors worldwide.
Fig. 3.2 Touch sensor
14. 14
3.1.4 :L293D Motor Driver IC
L293D Description
L293D is a typical Motor driver or Motor Driver IC which allows DC motor to drive on either
direction. L293D is a 16-pin IC which can control a set of two DC motors simultaneously in
any direction. It means that you can control two DC motor with a single L293D IC. Dual H-
bridge Motor Driver integrated circuit (IC).
The l293d can drive small and quiet big motors as well, check the Voltage Specification at the
end of this page for more info.
You can Buy L293D IC in any electronic shop very easily and it costs around 70 Rupees
(INR) or around 1 $ Dollar (approx Cost) or even lesser cost.
Fig.3.3 Motor Driver IC
15. 15
Concept
It works on the concept of H-bridge. H-bridge is a circuit which allows the voltage to be
flown in either direction. As you know voltage need to change its direction for being able to
rotate the motor in clockwise or anticlockwise direction, hence H-bridge IC are ideal for
driving a DC motor.
In a single l293d chip there two h-Bridge circuit inside the IC which can rotate two dc motor
independently. Due its size it is very much used in robotic application for controlling DC
motors. Given below is the pin diagram of a L293D motor controller.
There are two Enable pins on l293d. Pin 1 and pin 9, for being able to drive the motor, the pin
1 and 9 need to be high. For driving the motor with left H-bridge you need to enable pin 1 to
high. And for right H-Bridge you need to make the pin 9 to high. If anyone of the either pin1
or pin9 goes low then the motor in the corresponding section will suspend working. It’s like a
switch.
3.1.5: POWER SUPPLY
The performance of the master box depends on the proper functioning of the power supply unit.
The power supply coverts not only A.C into D.C, but also provides o/p voltage of 5V, 1amp.
The essential components of the power supply are:
TRANSFORMER:
As name suggests it transforms the voltage level form one level to another. The transformer used
is a step down transformer to step 230V to 5V.
It provides isolation too from the mains.
RECTIFIER:
The rectifier is used to convert A.C to D.C voltage. The design that we have carried out is of full
wave rectifier, using 1N4001 are use.
The bridge rectifier has advantage over the full wave rectifier like
16. 16
1. The need for the centre-tapper transformer is eliminated.
2. The PIV is one half of the centre-tap circuit.
Fig 3.4 Block Diagram of Power Supply
FILTER :
A filter circuit is a device, which removes ac component of rectified output but allows the dc
component to reach the load. The filter used is a simple capacitor of 100µf/25v.
REGULATOR:
A voltage regulator is a circuit that supplies a constant voltage regardless of changes in load
current. The regulator used in our project is IC7805, which is a three terminal voltage regulator.
A heat sink is used, so that the heat produced by the regulator dissipating power has a larger area
from which to radiate the heat into the air by holding the case temperature to a much lower value
than would result without the heat sink.
IC 7805 has an internal thermal overload protection and the internal short circuit current limiting
device.
3.1.5.1 7805 VOLTAGE REGULATOR
General Description:
The 78xx series of three terminal regulators is available with fixed output voltage making
them use full in wide range of application. One of this is local on call regulation, eliminating
the distortion problem associated with single point regulation. The voltage available allow
this regulator to be used in logic system instrumentation, Hi-Fi and other sold equipment.
The LM 7805 is available in aluminum to -3 packages, which allow over 1.0A load current if
adequate heat sinking is provided current limiting is included to limit peak output current to a
safe value. Safe are protection for the output transistors is provided to limit internal power
17. 17
dissipation. If internal power dissipation becomes too high for the heat sinking provided, the
thermal shut circuit takes place over preventing the IC from overheating.
Considerable efforts were expended to make the LM7805 regulators easy to use and
minimum the number of eternal components. It is not necessary to bypass the output although
this does improve transient response.
FEATURES:
1. Output current is excess of 1A.
2. Internal thermal overload protection
3. No external components required.
4. Internal short circuit current limit.
5. Available in the aluminium T 0-3package.
Fig 3.5 Power supply
18. 18
3.2: Software Requirement
3.2.1:EXPRESS PCB SOFTWARE
PCB is an open source software suite for electronic design automation (EDA) - for printed
circuit boards (PCB) layout.
HISTORY:
CB was first written by Thomas Nau for an Atari ST in 1990 and ported to UNIX and X11 in
1994. Initially PCB was not intended to be a professional layout system but as a tool for
individuals to do small-scale development of hardware. Harry Eaton took over PCB
development beginning with Release 1.5, although he contributed some code beginning with
Release 1.4.3
FEATURES:
Scalable fonts
Layer groups to keep signals together
Add on device drivers
Gerber RS-274X and NC Drill output support
Centroid (X-Y) data output
PostScript and Encapsulated PostScript output
Rats-nest generation from simple net lists
Automatic clearance around pins that pierce a polygon
Flags for pins and vias
Groups of action commands can be undone by a single undo
Simple design rule checker (DRC) - checks for minimum spacing and overlap rules
Drawing directly on the silk layer
Viewable solder-mask layers and editing
Netlist window
Netlist entry by drawing rats
Auto router
Snap to pins and pads
Element files and libraries that can contain whole sub-layouts, metric grids
19. 19
Up to 16 copper layer designs by default
Trace optimizer
Rats nest
Connectivity verification
Can interoperate with free schematic capture tools such as gEDA and XCircuit
GNU autoconf/automake based build system.
Fig 3.6 Schematic Window of Express PCB
3.2.2:KEIL MICRO VISION 3 IDE
The system was designed in Embedded C and implemented in KEIL μVision IDE, The
μVision IDE from Keil combines project management, make facilities, source code editing,
program debugging, and complete simulation in one powerful environment. The μVision
development platform is easy-to-use and helping you quickly create embedded programs that
work. The μVision editor and debugger are integrated in a single application that provides a
seamless embedded project development environment.
When you use the Keil μVision3, the project development cycle is roughly the same as it is
for any other software development project.
1. Create a project, select the target chip from the device database, and configure the tool
settings.
2. Create source files in C or assembly.
3. Build your application with the project manager.
20. 20
4. Correct errors in source files.
5. Test the linked application.
In the μVision3 Debug Mode you verify your program either with a powerful CPU and
peripheral simulator or with theKeil ULINK USB-JTAG Adapter (or other AGDI drivers) that
connect the debugger to the target system. The ULINKallows you also to download your
application into Flash ROM of your target system.
Fig. 3.7 A schematic window of Keil software
Embedded C is a set of language extensions for the C Programming language by the C
Standards committee to address commonality issues that exist between C extensions for
different embedded. Historically, embedded C programming requires nonstandard extensions
to the C language in order to support exotic features such as fixed-point arithmetic, multiple
distinct memory, and basic I/O operations.
21. 21
It includes a number of features not available in normal C, such as, fixed-point arithmetic,
named address spaces, and basic I/O hardware addressing.Embedded C use most of the syntax
and semantics of standard C, e.g., main() function, variable definition, datatype declaration,
conditional statements (if, switch. case), loops (while, for), functions, arrays and strings,
structures and union, bit operations, macros, unions, etc.
22. 22
3.2.3:FLASH MAGIC
Flash Magic is a tool which used to program hex code in EEPROM of micro-controller. it is a
freeware tool. It only supports the micro-controller of Philips and NXP. You can burn a hex
code into that controller which supports ISP (in system programming) feature. To check
whether your micro-controller supports ISP or not take look at its datasheet. So if your device
supports ISP then you can easily burn a hex code into EEPROM of your device.Flash magic
supports several chips like ARM Cortex M0, M3, M4, ARM7 and 8051.
Flash Magic is an application developed by Embedded Systems Academy to allow you to
easily access the features of a microcontroller device. With this program you can erase
individual blocks or the entire Flash memory of the microcontroller.
This application is very useful for those who work in the electronics field. The main window
of the program is composed of five sections where you can find the most common functions
in order to program a microcontroller device. Using the “Communications” section you will
be able to choose the way a specific device connects to your computer. Select the COM port
to be used and the baud rate.It is recommended that you choose a low baud rate first and
increase it afterwards. This way you will determine the highest speed with which your system
works. In order to select which parts of the memory to erase, choose from the items in the
“Erase” section.
The third section is optional. It offers you the possibility to program a HEX file. In the next
section you will be able to find different programming options, such as “verify after
programming”, “gen block checksums”, “execute” and others. When you’re done, click the
Start button that can be found in the “Start” section. The program will start the device, and
you will able to see the progress of the operations at the bottom of the main window.
Using Flash Magic, you are able to perform different operations to a microcontroller device,
operations like erasing, programming and reading the flash memory, modifying the Boot
Vector, performing a blank check on a section of the Flash memory and many others.
25. 25
4.1 Process Model
Fig. 4.1 Functional block diagram
The above diagram is the fundamental block diagram of our project. The hardware
requirements for this project includes Capacitive touch sensors that serves as the input
module, microcontroller that obtains the input from the sensor and stores it, bluetooth module
that allows the instantaneous transmission of text message stored in the microcontroller and
vibrating motors serve as the output module through which the message is received by the
Blind-Deaf person. The hardware used in this device is chosen with the factor of compactness
and fluidity. Sensors are used as the major component and the transmission is done via
microcontroller and Bluetooth.
27. 27
Lorm to Text
The deaf-blind user wears the Mobile Lorm Glove on the left hand and uses the tips of the
fingers of the right hand to lorm onto his or her own left hand to compose text messages. The
left hand is open with its fingers slightly spread. The sampling of input data uses event-
triggered interrupts initialized by the pressure sensors. The received data is then compared
with the entries in a look-up table. Each character is then serial-processed to the handheld of
the user via a bluetooth connection. In traditional Lorm, individual characters are signaled by
touching different touch marks. Some characters require single touch, some a second touch
that follows at the same spot after the first one. In our participatory design sessions we
discovered a significant difference regarding deaf-blind people’s speed of lorming. Due to
this individual speed it is not possible to use a time interval to distinguish between two
different characters using the same touch mark.
Therefore we included a rectangular sensor on the wrist of the glove that must be touched
after the completion of each entered character, in order to confirm it. For ergonomic reasons
this is preferably done with the thumb of the right hand.
Other characters are formed by a stroke from one mark to another. This is achieved by a
continuous movement along the tactile guidance system. Depending on the intended character
two to four pressure sensors are thereby crossed. Each combination generates a unique
character. When a sensor is touched, a vibrotactile feedback is generated by the corresponding
vibrating motor on the back of the glove to confirm the input. To provide appropriate user
comfort we avoided to place motors on the knuckles. This lead to not having exactly as many
actuators as sensors. Due to limitations based on the used sensor system of the glove, arabic
numbers need to be written out. In the traditional Lorm alphabet their outline is written in the
palm of the hand.
A soft hit onto the palm using all fingers of the right hand signals the end of a word in
traditional lorm. Due to our current sensor matrix architecture, multi-sensor combinations are
not intended. We solved this by touching the rectangular sensor twice.
Text to Lorm
Once the wearer of the Mobile Lorm Glove receives a text message, it is forwarded to the
glove from his or her handheld device via bluetooth and translated into the Lorm alphabet.
28. 28
Initiated by the small vibrating motors, tactile feed back patterns allow the wearer to perceive
the incoming messages. Character by character is processed to the control unit and converted
into a sequence of motor addresses and PWM signals to control the motors at the requested
intensity. The PWM signal provides 32 levels of intensities similarly as described in [4]. To
simulate the sensation of a continuous movement with discrete actuators, the human sensory
phenomenon called the “funneling illusion” [2] is applied. The funneling illusion is
implemented as proposed in [3] using linear cross fading from one motor to another by
continuously changing their intensities in opposite ways. The actuators on the glove are
placed in varied distances. In order to provide the same velocity of stimulus the duration of
the stimulus is adjusted in proportion to the distance of two actuators. The user's tactile
sensitivity and the speed of lorming vary. Therefore the maximal applied intensity and the
speed of lorming can be adjusted individually to serve the user's needs.
30. 30
Sending:
Turn on the Power Supply as soon as the Power is turned on the system continuously keeps
monitoring the capacitive touch sensors to see whether any key is touched.
If the key is touched(pressed) the signals are sent to the microcontroller, where the
characteristics are words are identifie.
The microcontroller stores the entire message typed using Lorm Glove. after this the entire
message is sent to the Bluetooth module connected to the microcontroller which in turn sends
it to the nearest mobile that is paired to it.
Receiving:
After turning on the power supply the system not only monitors the Key press continuously
but it monitors for any incoming message on the Bluetooth module.
If any paired sender has send a message to the Bluetooth Module of the Lorm Glove(
deaf/Blind people), the microcontroller saves the entire message from the Bluetooth Module.
The Microcontroller converts this message to vibrations by sending signals to the
corresponding vibrators connectied to the Lorm Glove
32. 32
5.1: TEST APPROACH
Fig. 6.1 Test Approach
Literature Survey
Project Selection and
Problem Definition
Experiments
Component selection
based on problem
definition
Hardware Design
Software Analysisis
Final DraftPrototype
Prototype Scaling Final Project
33. 33
Sequence of Project Work:
The above flowchart illustrates the sequence of steps performed during project
activity.
1. Literature Survey:
A comprehensive study of the existing technologies, research papers, scholarly
papers, presentations, international patents was surveyed. Also the scope for further
improvements was discussed.
2. Project Selection and problem definition:
After due considerations of the problem definition and feasibility checks the project is
selected.
3. Experiments:
Some tests were performed for adding different applications and coding related to
same.
4. Component selection based on problem definition:
Component survey and selection of components is done after detailed study of
various sections.
5. Hardware Design:
Designs of individual sections were undertaken with the aid of design software’s like
Express PCB. Special care was taken to use standardized components as far as possible to
reduce project cost.
6. Software Analysis:
The completed assembly was duly coded and tested in software like Keil,
Basic4android, Flash magic.
34. 34
7. Final draft:
Various modifications in the main design are integrated after the analysis. Thus a
final design draft is prepared.
8. Prototype:
A small scale model or prototype is constructed to test the product in the real
world scenario.
9. Prototype Scaling:
Scaling effect is applied on the prototype before constructing the actual model.
This takes into consideration the actual increase in various parameter on the large scale
model.
10. Final Project:
At long last the product is fully manufactured and is ready for actual use.
5.2: TEST PLAN
5.2.1: Features to be tested
Some features to be tested were: testing of features for BLUETOOTH module, TOUCH
sensors, VIBRATOR motors and Power Supply at different ranges
5.2.2: Features not to be tested
Some features and hardware which do not needed any testing was buzzer, Camera etc., as
they are manufactured and tested ok i.e. ready to use (standardized components)
5.2.3: Testing Tools and Environment
Apart from the regular components in circuitry we also need following tools for testing at
various stages
35. 35
Helping tools - A small vice can also be useful and provides a more rigid mounting for
holding PCB's, connectors etc. while you solder them. Also normally have a magnifying glass
to help see small components, tracks etc.
Pearl Catcher - Useful for the retrieving those screws that inevitably fall into the most
inaccessible corner of a project.
Breadboard - If you want to test a circuit without soldering it together permanently then
these are useful. Just push the wires into holes joined by metal strips to build the circuit. If the
circuit doesn't work, you can easily make changes. Different sizes are available.
Multimeter–Checking current values at various stages of project.
Power Supply - Also very useful for powering circuits that you are testing. One with a
variable voltage up to at least 12V is best. The current rating doesn't need to be that high, 1A
maximum is fine for most jobs. If you can afford it then one with an adjustable current limit is
useful - set right it can prevent damage to an incorrect circuit, rather than frying it instantly!
Oscilloscope Nonetheless a very useful piece of test equipment, especially on audio circuits.
Signal Generator - Useful when testing audio circuits, again not really necessary. Produces
variable frequency waves of several different waveforms (sine, square, triangle)
Other items - Other sizes of screwdriver, 0.5Kg reel of solder, tool roll or box etc.
36. 36
5.3: TEST CASE
5.3.1 Inputs and Expected outputs
The given table illustrates the given input during test cases and their respective obtained
output
SR NO. INPUTS OUTPUTS
1. The alphabets on the lorm acts as a switch
input.
The output goes to the
microcontroller pin P1.0,1.1,1.2
2. Microcontroller sends signal from pins
P0.0, P0.1 to the vibrator motor.
Vibrator Motors receives the input
and the vibrators vibrate in
response.
3. For power supply of 5V is connected to
pin 40 of microcontroller.
Microcontroller provides that
power supply to Bluetooth module
and to other devices if required.
4. P3.0/RXD and P3.1/TXD pins of
microcontroller acts as a input for
Bluetooth module.
The Bluetooth module receives the
signal through TXD and RXD pin
of HC-06.
Table 6.3.1 Inputs and Expected outputs
5.3.2 Test Procedure
Project Name selection
Literature Survey
Problem Definition
Block diagram
Details of individual block
Rough circuit diagram
Availability of parts in market
Purchasing parts
Testing individual Parts
Finalizing circuit diagram
Testing of circuits on breadboard.
37. 37
PCB designing
Soldering of parts
Testing & troubleshooting each block
Complete testing of final circuit
Algorithm development
Flow chart preparation
Writing individual part of software
Testing each code individually for GSM, LCD etc.
Final testing of software
Final testing of hardware & software interfacing.
Mounting of circuit in cabinet
Model development
Finishing final project
43. 43
The lightweight device with its textile interface caused quite a euphoria. It is hard to really put
oneself into the position of a deaf-blind person, therefore it is particularly important to
develop such devices in a participatory design process to provide maximal usability. A main
concern for the future is to decrease the thickness of the glove by replacing the used flexible
wires with e.g. stretchable printed circuits. Our next step will be a study with the aim to verify
the functionality and effectiveness of the system in real life situations. A situated long term
study is needed to reveal how the proposed system will affect user behaviour in everyday life.
We had extended the existing system to provide an interface to access a broader range of
information e.g. from websites, e-books or audio-books. It should also serve as an interface to
compose e-mails or to chat with someone.
46. 46
To decrease the thickness of the glove by replacing the used flexible wires with stretchable
printed circuit.
1. The touch sensors used is relatively expensive, advanced technologies could be
created at reduced cost.
2. It should also serve as an interface to compose e-mails or to chat with someone.
3. It can be made more compatible
49. 49
4.3 Port 0: Port 0 is an 8-bit open drain bidirectional I/O port. As an output port, each pin can
sink eight TTL inputs. When 1s are written to port 0 pins, the pins can be used as high-
impedance inputs. Port 0 can also be configured to be the multiplexed low-order address/data
bus during accesses to external program and data memory. In this mode, P0 has internal pull-
ups. Port 0 also receives the code bytes during Flash programming and outputs the code bytes
during program verification. External pull-ups are required during program verification.
4.4 Port 1: Port 1 is an 8-bit bidirectional I/O port with internal pull-ups. The Port 1 output
buffers can sink/source four TTL inputs. When 1s are written to Port 1 pins, they are pulled
high by the internal pull-ups and can be used as inputs. As inputs, Port 1 pins that are
externally being pulled low will source current (IIL) because of the internal pull-ups. In
addition, P1.0 and P1.1 can be configured to be the timer/counter 2 external count input
(P1.0/T2) and the timer/counter 2 trigger input (P1.1/T2EX), respectively, as shown in the
following table. Port 1 also receives the low-order address bytes during Flash programming
and verification.
4.5 Port 2: Port 2 is an 8-bit bidirectional I/O port with internal pull-ups. The Port 2 output
buffers can sink/source four TTL inputs. When 1s are written to Port 2 pins, they are pulled
high by the internal pull-ups and can be used as inputs. As inputs, Port 2 pins that are
externally being pulled low will source current (IIL) because of the internal pull-ups. Port 2
emits the high-order address byte during fetches from external program memory and during
accesses to external data memory that use 16-bit addresses (MOVX @ DPTR). In this
application, Port 2 uses strong internal pull-ups when emitting 1s. During accesses to external
data memory that use 8-bit addresses (MOVX @ RI), Port 2 emits the contents of the P2
Special Function Register. Port 2 also receives the high-order address bits and some control
signals during Flash programming and verification.
Port Pin Alternate Functions
P1.0 T2 (external count input to Timer/Counter 2),
P1.1 T2EX (Timer/Counter 2 capture/reload trigger and direction control)
P1.5 MOSI (used for In-System Programming)
P1.6 MISO (used for In-System Programming)
50. 50
P1.7 SCK (used for In-System Programming) 1919D–MICRO–6/08
4.6 Port 3: Port 3 is an 8-bit bidirectional I/O port with internal pull-ups. The Port 3 output
buffers can sink/source four TTL inputs. When 1s are written to Port 3 pins, they are pulled
high by the internal pull-ups and can be used as inputs. As inputs, Port 3 pins that are
externally being pulled low will source current (IIL) because of the pull-ups. Port 3 receives
some control signals for Flash programming and verification. Port 3 also serves the functions
of various special features of the AT89S52.
4.7 RST: Reset input. A high on this pin for two machine cycles while the oscillator is
running resets the device. This pin drives high for 98 oscillator periods after the Watchdog
times out. The DISRTO bit in SFR AUXR (address 8EH) can be used to disable this feature.
In the default state of bit DISRTO, the RESET HIGH out feature is enabled.
4.8 ALE/PROG: Address Latch Enable (ALE) is an output pulse for latching the low byte of
the address during accesses to external memory. This pin is also the program pulse input
(PROG) during Flash programming. In normal operation, ALE is emitted at a constant rate of
1/6 the oscillator frequency and may be used for external timing or clocking purposes. Note,
however, that one ALE pulse is skipped during each access to external data memory. If
desired, ALE operation can be disabled by setting bit 0 of SFR location 8EH. With the bit set,
ALE is active only during a MOVX or MOVC instruction. Otherwise, the pin is weakly
pulled high. Setting the ALE-disable bit has no effect if the microcontroller is in external
execution mode.
Port Pin Alternate Functions
P3.0 RXD (serial input port)
P3.1 TXD (serial output port) P3.2 INT0 (external interrupt 0)
P3.3 INT1 (external interrupt 1)
P3.4 T0 (timer 0 external input)
P3.5 T1 (timer 1 external input)
P3.6 WR (external data memory write strobe)
51. 51
P3.7 RD (external data memory read strobe)
Program Store Enable (PSEN) is the read strobe to external program memory. When the
AT89S52 is executing code from external program memory, PSEN is activated twice
eachmachine cycle, except that two PSEN activations are skipped during each access to
external data memory.
EA/VPP :External Access Enable. EA must be strapped to GND in order to enable the device
to fetch code from external program memory locations starting at 0000H up to FFFFH. Note,
however, that if lock bit 1 is programmed, EA will be internally latched on reset. EA should
be trapped to VCC for internal program executions. This pin also receives the 12-volt
programming enable voltage (VPP) during Flash programming.
XTAL1:Input to the inverting oscillator amplifier and input to the internal clock operating
circuit.
XTAL2: Output from the inverting oscillator amplifier.
Special Function Registers: A map of the on-chip memory area called the Special Function
Register (SFR) space. Note that not all of the addresses are occupied, and unoccupied
addresses may not be implemented on the chip. Read accesses to these addresses will in
general return random data, and write accesses will have an indeterminate effect. User
software should not write 1s to these unlisted locations, since they may be used in future
products to invoke new features. In that case, the reset or inactive values of the new bits will
always be 0.
Timer 2 Registers: Control and status bits are contained in registers T2CON (shown in Table
5- 2) and T2MOD (shown in Table 10-2) for Timer 2. The register pair (RCAP2H, RCAP2L)
are the Capture/Reload registers for Timer 2 in 16-bit capture mode or 16-bit auto-reload
mode. Interrupt Registers: The individual interrupt enable bits are in the IE register. Two
priorities can be set for each of the six interrupt sources in the IP register.
Interrupts: The AT89S52 has a total of six interrupt vectors: two external interrupts (INT0
and INT1), three timer interrupts (Timers 0, 1, and 2), and the serial port interrupt. These
interrupts are all shown in Figure 13-1. Each of these interrupt sources can be individually
enabled or disabled by setting or clearing a bit in Special Function Register IE. IE also
52. 52
contains a global disable bit, EA, which disables all interrupts at once. Note that Table 13-1
shows that bit position IE.6 is unimplemented. User software should not write a 1 to this bit
position, since it may be used in future AT89 products. Timer 2 interrupt is generated by the
logical OR of bits TF2 and EXF2 in register T2CON. Neither of these flags is cleared by
hardware when the service routine is vectored to. In fact, the service routine may have to
determine whether it was TF2 or EXF2 that generated the interrupt, and that bit will have to
be cleared in software. The Timer 0 and Timer 1 flags, TF0 and TF1, are set at S5P2 of the
cycle in which the timers overflow. The values are then polled by the circuitry in the next
cycle. However, the Timer 2 flag, TF2, is set at S2P2 and is polled in the same cycle in which
the timer overflows.
54. 54
[1] Hersh, M. A., Johnson, M. A. Assistive Technology for the Hearing- impaired, Deaf and
Deafblind. Springer- Verlag London Limited (2003), 257-273.
[2] A-Z to Deafblindness http://www.deafblind.com.
[3] International Conference on Science Technology Engineering & Management [ICON-
STEM’15] Journal of Chemical and Pharmaceutical Sciences ISSN: 0974-2115
[4] Understanding Palm-Based Imaginary Interfaces: The Role of Visual and Tactile Cues
when Browsing
[5] Perng, J.; Fisher, B.; Hollar, S.; Pister, K. Acceleration sensing glove (ASG). In
Proceedings of the Third International Symposium on Wearable Computers, SanFrancisco,
CA, USA, 18–19 October 1999; pp. 178–180.
[6] International Journal for Research and Development in Engineering (IJRDE) ISSN: 2279-
0500 Special Issue:pp-449-451
[7] ] International Journal of Advance Research In Science And Engineering IJARSE, Vol.
No.3, Issue No.12, December 2014
[8] Tactile-Proprioceptive Communication Aid for Users who are Deafblind by Vinitha
Khambadkar _ Eelke Folmer † Department of Computer Science & Engineering University of
Nevada.
[9] Jeong, Wooseob, Touchable online Braille Generator. ASSETS Poster, ACM
SIGACCESS Conference on Computers and Accessibility (ASSETS ’05).
[10] Sensitive Fingertips.http://www.kobakant.at/DIY/?p=531.
[11] Make: Electronics
55. 55
[12] ATMEL microcontroller datasheet
[13] How to diagnose and fix everything in electronics by Michael Jay
[14] ITead studio HC-05 datasheet.