Diese Präsentation wurde erfolgreich gemeldet.
Wir verwenden Ihre LinkedIn Profilangaben und Informationen zu Ihren Aktivitäten, um Anzeigen zu personalisieren und Ihnen relevantere Inhalte anzuzeigen. Sie können Ihre Anzeigeneinstellungen jederzeit ändern.
Separating Gesture Detection and Application Control
Concerns with a Multimodal Architecture
Luís Fernandes et al.
INESC T...
Problem
“Most gestures are neither natural nor easy to learn or
remember. (…) Even the simple headshake is puzzling when
c...
Devices
Leap Motion Kinect 2
InMERSE Multimodal Architecture
InMERSE Multimodal Architecture - Data
Implementation
Reproduce this gesture
to continue
Prototype
Final thoughts
Results are very preliminary
Open issues and topics for reflection:
Access to low-level data
Diverse set of...
Bringing User Experience empirical data to gesture-control
and somatic interaction in virtual reality videogames:
an Explo...
Thank you! Any questions?
Luís Fernandes – INESC TEC & UTAD
lfernandes@utad.pt
Nächste SlideShare
Wird geladen in …5
×

Separating Gesture Detection and Application Control Concerns with a Multimodal Architecture

Gesture-controlled applications are typically tied to specific gestures, and also tied to specific recognition methods and specific gesture-detection devices. We propose a concern-separation architecture, which mediates the following concerns: gesture acquisition; gesture recognition; and gestural control. It enables application developers to respond to gesture-independent commands, recognized using plug-in gesture-recognition modules that process gesture data via both device-dependent and device-independent data formats and callbacks. Its feasibility is demonstrated with a sample implementation.

Ähnliche Bücher

Kostenlos mit einer 30-tägigen Testversion von Scribd

Alle anzeigen

Ähnliche Hörbücher

Kostenlos mit einer 30-tägigen Testversion von Scribd

Alle anzeigen
  • Als Erste(r) kommentieren

Separating Gesture Detection and Application Control Concerns with a Multimodal Architecture

  1. 1. Separating Gesture Detection and Application Control Concerns with a Multimodal Architecture Luís Fernandes et al. INESC TEC & UTAD - PORTUGAL
  2. 2. Problem “Most gestures are neither natural nor easy to learn or remember. (…) Even the simple headshake is puzzling when cultures intermix” D.A. Norman (2010)
  3. 3. Devices Leap Motion Kinect 2
  4. 4. InMERSE Multimodal Architecture
  5. 5. InMERSE Multimodal Architecture - Data
  6. 6. Implementation
  7. 7. Reproduce this gesture to continue Prototype
  8. 8. Final thoughts Results are very preliminary Open issues and topics for reflection: Access to low-level data Diverse set of data formats
  9. 9. Bringing User Experience empirical data to gesture-control and somatic interaction in virtual reality videogames: an Exploratory Study with a multimodal interaction prototype google it in December! Subsequent paper – accepted for publication this November
  10. 10. Thank you! Any questions? Luís Fernandes – INESC TEC & UTAD lfernandes@utad.pt

×