Presentation done at ICCE 2012, Singapore for the MathMazing game

1. MathMazing
3D gesture recognition exergame
for arithmetic skills
Sameer Sahasrabudhe
Adeet Shah, Mohini Thakkar, Varun Thakkar,
Sridhar Iyer
1

2. Fluency in basic arithmetic
leads to acquiring higher
level maths
2
2

3. Fluency in basic arithmetic
leads to acquiring higher
level maths
Drill and practice
2
2

4. Drill and practice
• Helps in efficient recall [1]
• Improves over a period of time
3 [1] Dehaene 1997, Wong & Evans 2007
3

5. Drill and practice
• Helps in efficient recall [1]
• Improves over a period of time
Children find practice boring!
3 [1] Dehaene 1997, Wong & Evans 2007
3

6. Drill and practice
• Helps in efficient recall [1]
• Improves over a period of time
Children find practice boring!
Computer based drill and
practice games
3 [1] Dehaene 1997, Wong & Evans 2007
3

7. Computer based drill and practice games
• Children prefer over paper-pencil
• Enhances positive attitude towards math [2]
4 [2] Yurdabakan & Uzunkavak 2008, Ke 2008
4

8. Computer based drill and practice games
• Children prefer over paper-pencil
• Enhances positive attitude towards math [2]
Time spent on computer leads to
sedentary lifestyle
4 [2] Yurdabakan & Uzunkavak 2008, Ke 2008
4

9. Computer based drill and practice games
• Children prefer over paper-pencil
• Enhances positive attitude towards math [2]
Time spent on computer leads to
sedentary lifestyle
Exergames
4 [2] Yurdabakan & Uzunkavak 2008, Ke 2008
4

10. Exercise + games = Exergames [3]
• Players perform physical activities to play
• Mind focuses on action, exercise ‘just happens’
5 Dietz and Gortmaker 1993, Bogost 2007
5

11. Exercise + games = Exergames [3]
• Players perform physical activities to play
• Mind focuses on action, exercise ‘just happens’
WII, X Box...
5 Dietz and Gortmaker 1993, Bogost 2007
5

12. Gesture based games
More exciting than conventional
interaction devices like keyboard, mouse
or joystick
Impact children’s learning and enjoyment
in physical activities [4]
Induce children to apply abilities
corresponding to multiple intelligences [5]
6 [4] Alharthi et.al 2012, [5] Gardner 1983
6

13. Application of multiple
intelligences in Exergames
Example: LearnPads [6]
Maths solving: Logic
Body movement: Kinesthetic
7 [6] Karime et al 2011
7

14. Our work:
MathMazing
8
8

15. Our work:
MathMazing
8
8

16. Our work:
MathMazing
8
8

17. Our work:
MathMazing
8
8

18. Our work:
MathMazing
Logic
8
8

19. Our work:
Kinesthetic
MathMazing
Logic
8
8

20. Our work:
Kinesthetic
MathMazing
Logic
Spatial
8
8

21. Video Demo
9
9

22. Multiple intelligences required to
be applied in MathMazing
10
10

23. MathMazing: System design
Input
Gestures Game logic Display
event
11
11

24. MathMazing: System design
Input
Gestures Game logic Display
event
11
11

25. MathMazing: System design
Input
Gestures Game logic Display
event
Kinect
11
11

26. MathMazing: System design
Input
Gestures Game logic Display
event
Kinect FAAST
11
11

27. MathMazing: System design
Input
Gestures Game logic Display
event
Blender Game
Kinect FAAST Engine
11
11

28. MathMazing: System design
Input
Gestures Game logic Display
event
Blender Game Projector/
Kinect FAAST Engine Screen
11
11

29. Implementation details
FAAST: Flexible Action and Articulated Skeleton Toolkit
12
12

30. Implementation details
FAAST: Flexible Action and Articulated Skeleton Toolkit
12
12

31. Usability test: objectives [7]
learnability (degree of ease for the
first time users)
efficiency (after they have interacted
once, how quickly can they perform)
satisfaction (whether the interaction
was pleasant?)
13 [7] Nielsen, 2003, Shneiderman, 1980
13

32. Usability test: Results
Students not only found MathMazing
enjoyable but also showed a marked
preference for its gesture-based interaction
mode
There was a reduction in the time required
by the students to not only calculate the
correct answer but also navigate to it
14
14

33. Results: Efficiency
15

34. Results: Efficiency
15

35. Sample feedback
“Math was one subject I always feared
but the enjoyment of the game helped
him to overcome the fear”.
I liked the interaction (Kinect)
and the game play!
...if the interactions were
using keyboard and mouse
then, I would not have played
the game so long.
16
16

36. Future work
Usability test with a larger sample
Variations in the maze paths
More intuitive gestures for the users
Adaptations for other subjects like english
Ex: Choose and navigate to a correct
spelling or Choose a correct spelling which
can be made from the alphabets given
17
17

37. Thank you
s1000brains@iitb.ac.in
http://www.it.iitb.ac.in/~s1000brains
For other Blender related activities:
http://oscar.iitb.ac.in/blenderactivities.do
18
18