This project focuses on developing a mobile application that integrates Google Cardboard and Myo Armband. The mobile application developed is an educational application that teaches users to write Japanese characters by getting users to trace the characters display on the phone screen. The users will air draw the letters while the Myo Armband will capture the gestures, send the data to the smartphones and display the drawn character on the screen.

1. VIRTUAL INTERACTION USING MYO AND GOOGLE
CARDBOARD
This project focuses on developing a
mobile application that integrates Google
Cardboard and Myo Armband. The mobile
application developed is an educational
application that teaches users to write
Japanese characters by getting users to
trace the characters display on the phone
screen. The users will air draw the letters
while the Myo Armband will capture the
gestures, send the data to the
smartphones and display the drawn
character on the screen.
Chong Wee Nee, Poo Kuan Hoong (Supervisor), Ian K.T. Tan (Co-Supervisor)
2015 / 2016
Overview
1) To develop a Google Cardboard
application and integrate the Myo
Armband into the 3D environment.
2) To enable user to control the 3D
environment using the Myo Armband.
3) To provide an immersive experience of
learning Japanese characters.
Objectives
Recently, there are many companies
venturing into virtual reality technology and
they believed that virtual reality will be the
next big thing. Majority of the companies
focused on Head Mounted Display (HMD)
and a few focused on projector or special
room to provide virtual environment
experience. Some of the well known HMD
devices are Oculus Rift, HTC Vive,
PlayStation VR, Samsung Gear VR and
Google Cardboard. Google Cardboard is
the most affordable HMD compare to the
rest.
Meanwhile, there are a number of
gesture recognition devices that has been
developed and many of the devices are for
games and virtual reality purposes. Those
devices are Xbox Kinect, Play Station
Move, Wii, Leap Motion and Myo Armband.
Myo Armband is the newest gadget among
all the mentioned gadgets. It is the only
gesture control device that uses EMG data
to manipulate other devices.
Using Myo Armband as an additional
input for Google Cardboard is a new
concept. There are very little Google
Cardboard application that integrates Myo.
One of the existing application is PortalVR.
PortalVR enables the player to be
immersed in the game environment using
the power of Google Cardboard, Myo
armband, and the Wii remote.
Background Study
Development Requirements
1) Android Studio 1.0 or higher
2) Google Cardboard SDK
3) Myo Android SDK
4) Unity 5.0
Hardware Requirements
1) Android phone (4.3 & above)
2) Google Cardboard
3) Myo Armband
Requirements
Figure 1: Start page
Figure 2: Select Japanese character
Figure 3: Drawing Screen
Designs
In this project, a prototype
Android application that integrates
Google Cardboard and Myo
Armbands to be used as immersive
learning environment for Japanese
language was successfully
developed. With the usage of this
Android application, user able to use
the Myo Armband to select a new
Japanese character and trace the
character. User will have a new
immersive experience of learning
Japanese characters.
Conclusion
User
Myo
Armband
Phone
Identify
the Pose
Plugin
Identify the
control
assigned to
the gesture
Track
Rotation
and Track
Position
hand
pose
head
movement
raw
EMG
data
gestural
data
gestural
data
gestural
data
manipulated
classroom
phone movement
updated orientation
of VR world
Implementation
1. Thalmic Labs Inc. (2013). Myo: Home.
(Thalmic Labs Inc.) Retrieved 8
September, 2015, from Myo:
https://www.myo.com/
2. Thalmic Labs Inc. (2013). Tech Specs.
(Thalmic Labs Inc.) Retrieved 8
September, 2015, from Myo:
https://www.myo.com/techspecs
3. Bernhardt, P. (2015). Build your own
Mouse Control with Myo. Retrieved from
Myo Developer Blog:
http://developerblog.myo.com/build-your-
own-mouse-control-with-myo/
4. Hacker League. (2015). PortalVR. (Intel
Corporation) Retrieved 8 September,
2015, from Hacker League:
https://www.hackerleague.org/hackathon
s/uofthacks/hacks/portalvr
References