1. Mohamed Ali Khenissi, Yosra Bouzid,
Mohamed Jemni
Research Laboratory of Technologies of Information
and Communication & Electrical Engineering
(LaTICE)
MemoSign Game: A learning
Game for Deaf Learners
The second SignWriting Symposium, LaJolla, USA, 21-14 July, 2015

2. LOGO
INTRODUCTION
RELATED WORKS
LEARNING VERSION OF MEMORY MATCH
GAME FOR DEAF LEARNERS
EXPERIMENTATION
CONCLUSION
CONTENT
2

3. LOGO
INTRODUCTION
According to WFD, there are about 70 million deaf people who
use sign language as their first language or mother tongue.
For deaf and hard hearing people, learning any spoken language is
not a natural or automatic process, it is rather a long and intensive
task.
Around 80% of deaf people worldwide lack education or are
undereducated, are illiterate or semi-literate
Sign language is an integral part and an identifying feature of
membership in the Deaf Culture
3

4. LOGO
INTRODUCTION
Express, share, and record their ideas and thoughts on paper
without translating it all the time.
Learn new things and skills outside of oral communication.
Improve their ability to comprehend and acquire the written
versions of oral language.
•
•
•
The main benefit of having a SL written form is that Deaf signers could :
• ……
Having a means to represent their own language would bring to
these signers the same advantage that writing systems for spoken
languages bring to speakers.
4

5. LOGO
INTRODUCTION
It uses a set of highly iconic symbols that can be combined to
describe any sign
•
• It is conceived to be used in writing sign languages for the same
purposes hearing people commonly use written oral languages.
• It is now used in more than ten countries to aid literacy.
A training to learn to interpret the SignWriting notations is needed
for novice users who are accustomed to the use of their sign
language in a visual-gestural modality
SignWriting is one of the best known writing systems for SL.
5

6. LOGO
CONTRIBUTION
The use of ICT, especially 3D signing avatars, has been identified as a
successful practice that can support the teaching of literacy to students
who are deaf or hard of hearing.
The use of computer games is another interesting alternative to
reinforce learning experience of deaf learners since they can consume
the attention of learners and increase their motivation and engagement
which can then lead to stimulate learning.
In this context, we propose a new learning game which federates the
avatar technology, computer game and the SL writing form SignWriting
to motivate deaf signers to read and write in their mother tongue.
6

7. LOGO
INTRODUCTION
RELATED WORKS
LEARNING VERSION OF MEMORY MATCH
GAME FOR DEAF LEARNERS
EXPERIMENTATION
CONCLUSION
7
CONTENT

8. LOGO
+
+
+
+
+
Teaching English language
Teaching English language
Responding to questions
about the programming
languages
Determining the
precedence relationship
between activities
Teaching introduction to
programming language
8
RELATED WORKS

9. LOGO
INTRODUCTION
RELATED WORKS
LEARNING VERSION OF MEMORY MATCH
GAME FOR DEAF LEARNERS
EXPERIMENTATION
CONCLUSION
9
CONTENT

10. LOGO
LEARNING VERSION OF MEMORY MATCH GAME
FOR DEAF LEARNERS
Is a card game in which all of the cards
are laid face down on a surface. The
objective of the game is to turn over
pairs of matching cards with the least
possible trials.
Memory Match Game
Learning version of Memory Match Game for Deaf Learners
1) 2) 3)
10

11. LOGO
The virtual avatar is driven by an animation software called
tuniSigner. tuniSigner was conceived to automatically interpret the
exact gestures represented within SignWriting notations.
Parsing and processing
the SW notation
Identifying
the explicit linguistic
representation
of the sign
SignWriting notation
Scripting and generating
animations using
XML Sign Modeling
Language, SML
 The avatar-based system tuniSigner
LEARNING VERSION OF MEMORY MATCH GAME
FOR DEAF LEARNERS
11

12. LOGO
INTRODUCTION
RELATED WORKS
LEARNING VERSION OF MEMORY MATCH
GAME FOR DEAF LEARNERS
EXPERIMENTATION
CONCLUSION
12
CONTENT

13. LOGO
INTRODUCTION
RELATED WORKS
LEARNING VERSION OF MEMORY MATCH
GAME FOR DEAF LEARNERS
EXPERIMENTATION
CONCLUSION
13
CONTENT

14. LOGO
A new educational game for deaf learners,
To engage DL and to keep them motivated.
Futures works will study the impact of this learning game on level of
knowledge.
To foster vocabulary acquisition for DL in
both spoken and sign languages.
To render the learning experience with
more fun.
14
CONCLUSION