This project describes a sign language translation glove that uses flex sensors and an accelerometer/gyroscope to detect finger movements and positions. An Arduino microcontroller collects sensor data and sends it over Bluetooth to an Android device running a neural network model to recognize signs and output text. The goal is to translate American Sign Language signs into text in real-time using open source hardware and software components like Arduino, Android ADK, and various sensors.
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Show & Tell.- Introduction
1. Saron Paz Zvika Markfeld
Tomer Daniel Oleg Imanilov
2. An open source software & hardware
Combining:
Arduino
Sensors
Android ADK
Android
3. A glove that translates a predefined
vocabulary of the deaf and mute sign
language into text
4. Lily-Pad Arduino samples sensors
attached to glove
ADK board relays data from the
Lily-Pad to Android
Android uses a back propagation
Neural Network to analyze data
11. GUI
Mini NN
Sensor
Relay Control
ADK library ADK library Serial Serial
12.
13.
14.
15.
16.
17.
18.
19.
20. Saron Zvika Tomer Oleg
Paz Markfeld Daniel Imanilov
is an is a is a is a
experience design software software
designer & freshman architect engineer &
a hopeless and an by day & a a brilliant
idealist aspiring maker by ideas
inventor night generator
