SlideShare ist ein Scribd-Unternehmen logo
1 von 18
Downloaden Sie, um offline zu lesen
Multi(Touch) Gesture Research
      Lecture: Journal Club – spring 2010

                       Florian Weil
   University of Art Linz – Master: Interface Culture
Questions
●   Which differences exist in gesture
    interaction on different screen sizes?

●   How is the research community for gesture
    interaction organized?
    ●   Which conferences exist?
    ●   Who are the key researcher and other important
        researcher?
Different screenformats - Small




     Small Screens


                          Smart Phones
Different screenformats - Medium




     Netbooks
                        Tablet PCs
Different screenformats - Large




    MultiTouch Displays   TableTop Displays
Different screenformats – extra large




                      Touch Walls
Researcher & People
●   Explored
    ●   Keynote and Opening Speakers
    ●   Reviewer Lists
    ●   Papers


●   Could not find key roles

●   Good balance of academic (University) and
    economic driven research (Microsoft etc.)
Conferences & Community
●   Computer Human Interaction (CHI)


●   Interactive Tapletop and Surfaces (ITS)


●   Tangible, Embedded, and Embodied Interaction (TEI)


●   Gesture Workshop (GW)
Computer Human Interaction (CHI)
●   Big and general conference about Human and Computer Interaction
●   Special Session about surfaces and tabletop Interaction → with
    gesture interaction


●   Organizer
    ●   Georgia Institute of Technology
    ●   Brigham Young University
    ●   Microsoft Research / University of Washington
●   Place
    ●   Mainly USA and Canada, sometimes Europe
    ●   Atlanta, Boston, Florence, San Jose, Montreal...
Tangible, Embedded, and
Embodied Interaction (TEI)
●   Medium big conference on Tangible, Embedded, and Embodied
    Interaction.
●   Very good for gesture research for tangible devices.


●   Sponsors:
    ●   Nokia, Microsoft Research, Philips, Fraunhofer, ACM, SIGCHI


●   Place:
    ●   Europe and North America
    ●   Portugal, USA, UK, Germany, ...
Interactive Tapletop and Surfaces
●   Medium and pretty young conference (started 2006) with focus on
    interaction design in connection with surfaces and tabletop systems,
    like reactable
●   Very good for research in (multiTouch) gesture interaction


●   Organizer:
    ●   Sriram Subramanian, University of Bristol, UK
    ●   Antonio Krüger (DFKI GmbH)
    ●   And other...
●   Place:
    ●   Very often in Europe
    ●   Saarbrücken, Banff, Amsterdam, Newport
Gesture Workshop
●   Small conference / workshop with focus on gesture interaction
    in general


●   Mostly focus on free form and auditive gestures


●   Organizer
    ●   University Bielefeld, Adetti, University of South Brittany, …


●   Place
    ●   Only in Europe
    ●   Bielefeld, Lisbon, Ile de Berder, Genova, London, ...
Researched Papers
Anne Roudaut, Eric Lecolinet and Yves Guiard, “MicroRolls: expanding touch-screen input vocabulary by
distinguishing rolls vs. slides of the thumb”, Proceedings of CHI 2009, Boston, MA, USA, 2009, pp. 927-
936.

.



Tom Moscovich and John F. Hughes, “Indirect mappings of multi-touch input using one and two hands”,
Proceedings of CHI 2008, Florence, Italy, 2008, pp. 1275-1284.

Chi Tai Dang, Martin Straub, Elisabeth André, “Hand distinction for multi-touch tabletop interaction”,
Proceedings of ITS 2009, Banff, Alberta, Canada, 2009, pp. 101-108.

Mathias Frisch, Jens Heydekorn, Raimund Dachselt, “Investigating multi-touch and pen gestures for
diagram editing on interactive surfaces”, Proceedings of ITS 2009, Banff, Alberta, Canada, 2009, pp. 149-
156




Alexander Schick, Florian van de Camp, Joris Ijsselmuiden and Rainer Stiefelhagen, “Extending touch:
towards interaction with large-scale surfaces”, Proceedings of ITS 2009, Banff, Alberta, Canada, 2009, pp.
117-124.
Small Screen Gesture with Thumb
●   http://www.youtube.com/watch?v=bfH0-OqgbLw
●   Context: during movement, one hand interaction
●   Categories: Drag, Swipe, Rubbing, MicroRolls


●   Testings (10 people, Aged 23-28)
    ●   MicroRoll 2x faster than contex menu UI
    ●
        MicroRoll same as fast as easy Toolbar, faster than difficult toolbar
●   MicroRoll Gesture itself:
    ●   Robust and easy to learn
    ●   Good perfomance (influenced by the position of the gesture)
    ●   Good combination with TapTap, TapRoll, RollMark gestures
Medium screen: uni or bimanual gesture
●
    Context: TableTop systems and Medium Screens
●
    Motivation: investigate perfomance and the right task for uni and
    bimanual gestures
●   Approach: Testing the commands align, positioning, rotation, scaling
    of digital objects.
●   Result:
    ●   Unimanual interaction for visual rotation, transporting, rotating,
        and stretching
    ●   Bimanual interaction for control of two individual (control) points
        (example tasks: window manipulation, image croping etc.)
    ●   Perfomance differences are small, so the designer can safely
        interchange between the two methods
TableTop Screen: Hand Distinction
●
    Context: TableTop systems and Large Screens
●
    Motivation: Distinguish one-hand and two-hand gestures
    improves gesture systems
    ●   more stable and accurated gesture recognition
    ●   avoiding of conflicts in multi-user systems
●   Approach: use the anatomy information of the user hand and
    combine them with touch point and finger orientation data.
●   Result:
    ●   Average: 96% successfully hand recognition
    ●   Thumb need a more detail observation
    ●   Heuristic formular works fine, but constant values needs
        improvements
TableTop Screen: Hand Distinction




            Source: Chi Tai Dang, Martin Straub, Elisabeth André, “Hand distinction for multi-touch tabletop interaction”,
            Proceedings of ITS 2009, Banff, Alberta, Canada, 2009, pp. 101-108.
Large Screen Gesture via Pointing
●   http://www.youtube.com/watch?v=cV60gwiM5HM
●   Context: Big static screen, some objects are not reachable
●   Categories: Pointing and Touch gestures


●   Seamlessly direct object manipulation with pointing and touch


●
    User test results:
    ●   User think it is a very useful extension
    ●   Very intuitiv and easy learning interaction
    ●   Objects are easier to reach and less exhausting compared to
        touch-only systems
    ●   User did not really use these two interactions for the same task

Weitere ähnliche Inhalte

Ähnlich wie Multi(Touch) Gesture Research

PhD defense presentation
PhD defense presentationPhD defense presentation
PhD defense presentationJorge Cardoso
 
Musstanser Avanzament 4 (Final No Animation)
Musstanser   Avanzament 4 (Final   No Animation)Musstanser   Avanzament 4 (Final   No Animation)
Musstanser Avanzament 4 (Final No Animation)Musstanser Tinauli
 
Accessibility & Universal Design
Accessibility & Universal DesignAccessibility & Universal Design
Accessibility & Universal DesignSrutiVijaykumar
 
Designing Gestural Interaction: Challenges and Pitfalls
Designing Gestural Interaction: Challenges and PitfallsDesigning Gestural Interaction: Challenges and Pitfalls
Designing Gestural Interaction: Challenges and PitfallsJean Vanderdonckt
 
The artificiality of natural user interfaces alessio malizia
The artificiality of natural user interfaces   alessio maliziaThe artificiality of natural user interfaces   alessio malizia
The artificiality of natural user interfaces alessio maliziaMarco Ajovalasit
 
When User Interface Patterns Become Mobile
When User Interface Patterns Become MobileWhen User Interface Patterns Become Mobile
When User Interface Patterns Become MobileJean Vanderdonckt
 
2015-11-25 research seminar
2015-11-25 research seminar2015-11-25 research seminar
2015-11-25 research seminarifi8106tlu
 
A comparative user evaluation of tablets and tools for consecutive interpreters
A comparative user evaluation of tablets and tools for consecutive interpretersA comparative user evaluation of tablets and tools for consecutive interpreters
A comparative user evaluation of tablets and tools for consecutive interpretersJosh Goldsmith
 
Introduction - fundamentals of CHI
Introduction - fundamentals of CHI Introduction - fundamentals of CHI
Introduction - fundamentals of CHI Joris Klerkx
 
Pervasive Advertising - Chancen und Herausforderungen kontext-sensitiver Werb...
Pervasive Advertising - Chancen und Herausforderungen kontext-sensitiver Werb...Pervasive Advertising - Chancen und Herausforderungen kontext-sensitiver Werb...
Pervasive Advertising - Chancen und Herausforderungen kontext-sensitiver Werb...Vorname Nachname
 
What Is Interaction Design
What Is Interaction DesignWhat Is Interaction Design
What Is Interaction DesignGraeme Smith
 
Importance of UX-UI in Android/iOS Development- Stackon
Importance of UX-UI in Android/iOS Development- StackonImportance of UX-UI in Android/iOS Development- Stackon
Importance of UX-UI in Android/iOS Development- Stackonnajam gs
 
Introduction to HCI (UCC)
Introduction to HCI (UCC)Introduction to HCI (UCC)
Introduction to HCI (UCC)apppsych
 
Being human (Human Computer Interaction)
Being human (Human Computer Interaction)Being human (Human Computer Interaction)
Being human (Human Computer Interaction)Rahul Singh
 
Experience-Interface-Interaction.pdf
Experience-Interface-Interaction.pdfExperience-Interface-Interaction.pdf
Experience-Interface-Interaction.pdfHasseyWijetunge
 
RBI paper, CHI 2008
RBI paper, CHI 2008RBI paper, CHI 2008
RBI paper, CHI 2008guest0dd2a1
 

Ähnlich wie Multi(Touch) Gesture Research (20)

PhD defense presentation
PhD defense presentationPhD defense presentation
PhD defense presentation
 
ICS3211 Lecture 07
ICS3211 Lecture 07 ICS3211 Lecture 07
ICS3211 Lecture 07
 
Musstanser Avanzament 4 (Final No Animation)
Musstanser   Avanzament 4 (Final   No Animation)Musstanser   Avanzament 4 (Final   No Animation)
Musstanser Avanzament 4 (Final No Animation)
 
Accessibility & Universal Design
Accessibility & Universal DesignAccessibility & Universal Design
Accessibility & Universal Design
 
Designing Gestural Interaction: Challenges and Pitfalls
Designing Gestural Interaction: Challenges and PitfallsDesigning Gestural Interaction: Challenges and Pitfalls
Designing Gestural Interaction: Challenges and Pitfalls
 
The artificiality of natural user interfaces alessio malizia
The artificiality of natural user interfaces   alessio maliziaThe artificiality of natural user interfaces   alessio malizia
The artificiality of natural user interfaces alessio malizia
 
When User Interface Patterns Become Mobile
When User Interface Patterns Become MobileWhen User Interface Patterns Become Mobile
When User Interface Patterns Become Mobile
 
2015-11-25 research seminar
2015-11-25 research seminar2015-11-25 research seminar
2015-11-25 research seminar
 
A comparative user evaluation of tablets and tools for consecutive interpreters
A comparative user evaluation of tablets and tools for consecutive interpretersA comparative user evaluation of tablets and tools for consecutive interpreters
A comparative user evaluation of tablets and tools for consecutive interpreters
 
Introduction - fundamentals of CHI
Introduction - fundamentals of CHI Introduction - fundamentals of CHI
Introduction - fundamentals of CHI
 
ICS3211 lecture 07
ICS3211 lecture 07ICS3211 lecture 07
ICS3211 lecture 07
 
Pervasive Advertising - Chancen und Herausforderungen kontext-sensitiver Werb...
Pervasive Advertising - Chancen und Herausforderungen kontext-sensitiver Werb...Pervasive Advertising - Chancen und Herausforderungen kontext-sensitiver Werb...
Pervasive Advertising - Chancen und Herausforderungen kontext-sensitiver Werb...
 
What Is Interaction Design
What Is Interaction DesignWhat Is Interaction Design
What Is Interaction Design
 
Importance of UX-UI in Android/iOS Development- Stackon
Importance of UX-UI in Android/iOS Development- StackonImportance of UX-UI in Android/iOS Development- Stackon
Importance of UX-UI in Android/iOS Development- Stackon
 
Introduction to HCI (UCC)
Introduction to HCI (UCC)Introduction to HCI (UCC)
Introduction to HCI (UCC)
 
Lecture1.ppt
Lecture1.pptLecture1.ppt
Lecture1.ppt
 
UX 101
UX 101UX 101
UX 101
 
Being human (Human Computer Interaction)
Being human (Human Computer Interaction)Being human (Human Computer Interaction)
Being human (Human Computer Interaction)
 
Experience-Interface-Interaction.pdf
Experience-Interface-Interaction.pdfExperience-Interface-Interaction.pdf
Experience-Interface-Interaction.pdf
 
RBI paper, CHI 2008
RBI paper, CHI 2008RBI paper, CHI 2008
RBI paper, CHI 2008
 

Mehr von Florian Weil

Artistic Research on Human Plant Interfaces by Florian Weil
Artistic Research on Human Plant Interfaces by Florian WeilArtistic Research on Human Plant Interfaces by Florian Weil
Artistic Research on Human Plant Interfaces by Florian WeilFlorian Weil
 
Human Plant Interfaces - Lecture
Human Plant Interfaces - LectureHuman Plant Interfaces - Lecture
Human Plant Interfaces - LectureFlorian Weil
 
Hermits in our digital Age
Hermits in our digital AgeHermits in our digital Age
Hermits in our digital AgeFlorian Weil
 
Sense Ware Examples from Germany and Switzerland
Sense Ware Examples from Germany and SwitzerlandSense Ware Examples from Germany and Switzerland
Sense Ware Examples from Germany and SwitzerlandFlorian Weil
 
Senseware in the Germany Culture
Senseware in the Germany CultureSenseware in the Germany Culture
Senseware in the Germany CultureFlorian Weil
 
What did derhess.de before Liip
What did derhess.de before LiipWhat did derhess.de before Liip
What did derhess.de before LiipFlorian Weil
 
Liip Techtalk Flash Lite
Liip Techtalk Flash LiteLiip Techtalk Flash Lite
Liip Techtalk Flash LiteFlorian Weil
 
Liip Techtalk Ars Electronica 2008
Liip Techtalk Ars Electronica 2008Liip Techtalk Ars Electronica 2008
Liip Techtalk Ars Electronica 2008Florian Weil
 
Moving from AS3 to Flex - advantages, hazards, traps
Moving from AS3 to Flex - advantages, hazards, trapsMoving from AS3 to Flex - advantages, hazards, traps
Moving from AS3 to Flex - advantages, hazards, trapsFlorian Weil
 

Mehr von Florian Weil (9)

Artistic Research on Human Plant Interfaces by Florian Weil
Artistic Research on Human Plant Interfaces by Florian WeilArtistic Research on Human Plant Interfaces by Florian Weil
Artistic Research on Human Plant Interfaces by Florian Weil
 
Human Plant Interfaces - Lecture
Human Plant Interfaces - LectureHuman Plant Interfaces - Lecture
Human Plant Interfaces - Lecture
 
Hermits in our digital Age
Hermits in our digital AgeHermits in our digital Age
Hermits in our digital Age
 
Sense Ware Examples from Germany and Switzerland
Sense Ware Examples from Germany and SwitzerlandSense Ware Examples from Germany and Switzerland
Sense Ware Examples from Germany and Switzerland
 
Senseware in the Germany Culture
Senseware in the Germany CultureSenseware in the Germany Culture
Senseware in the Germany Culture
 
What did derhess.de before Liip
What did derhess.de before LiipWhat did derhess.de before Liip
What did derhess.de before Liip
 
Liip Techtalk Flash Lite
Liip Techtalk Flash LiteLiip Techtalk Flash Lite
Liip Techtalk Flash Lite
 
Liip Techtalk Ars Electronica 2008
Liip Techtalk Ars Electronica 2008Liip Techtalk Ars Electronica 2008
Liip Techtalk Ars Electronica 2008
 
Moving from AS3 to Flex - advantages, hazards, traps
Moving from AS3 to Flex - advantages, hazards, trapsMoving from AS3 to Flex - advantages, hazards, traps
Moving from AS3 to Flex - advantages, hazards, traps
 

Kürzlich hochgeladen

How to use Ai for UX UI Design | ChatGPT
How to use Ai for UX UI Design | ChatGPTHow to use Ai for UX UI Design | ChatGPT
How to use Ai for UX UI Design | ChatGPTThink 360 Studio
 
Math Group 3 Presentation OLOLOLOLILOOLLOLOL
Math Group 3 Presentation OLOLOLOLILOOLLOLOLMath Group 3 Presentation OLOLOLOLILOOLLOLOL
Math Group 3 Presentation OLOLOLOLILOOLLOLOLkenzukiri
 
Mike Tyson Sign The Contract Big Boy Shirt
Mike Tyson Sign The Contract Big Boy ShirtMike Tyson Sign The Contract Big Boy Shirt
Mike Tyson Sign The Contract Big Boy ShirtTeeFusion
 
Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024
Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024
Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024Ted Drake
 
Embroidery design from embroidery magazine
Embroidery design from embroidery magazineEmbroidery design from embroidery magazine
Embroidery design from embroidery magazineRivanEleraki
 
Create Funeral Invites Online @ feedvu.com
Create Funeral Invites Online @ feedvu.comCreate Funeral Invites Online @ feedvu.com
Create Funeral Invites Online @ feedvu.comjakyjhon00
 
Best-NO1 Pakistani Amil Baba Real Amil baba In Pakistan Najoomi Baba in Pakis...
Best-NO1 Pakistani Amil Baba Real Amil baba In Pakistan Najoomi Baba in Pakis...Best-NO1 Pakistani Amil Baba Real Amil baba In Pakistan Najoomi Baba in Pakis...
Best-NO1 Pakistani Amil Baba Real Amil baba In Pakistan Najoomi Baba in Pakis...Amil baba
 
Design mental models for managing large-scale dbt projects. March 21, 2024 in...
Design mental models for managing large-scale dbt projects. March 21, 2024 in...Design mental models for managing large-scale dbt projects. March 21, 2024 in...
Design mental models for managing large-scale dbt projects. March 21, 2024 in...Ed Orozco
 
Designing for privacy: 3 essential UX habits for product teams
Designing for privacy: 3 essential UX habits for product teamsDesigning for privacy: 3 essential UX habits for product teams
Designing for privacy: 3 essential UX habits for product teamsBlock Party
 
Building+your+Data+Project+on+AWS+-+Luke+Anderson.pdf
Building+your+Data+Project+on+AWS+-+Luke+Anderson.pdfBuilding+your+Data+Project+on+AWS+-+Luke+Anderson.pdf
Building+your+Data+Project+on+AWS+-+Luke+Anderson.pdfsaidbilgen
 
Khushi sharma undergraduate portfolio...
Khushi sharma undergraduate portfolio...Khushi sharma undergraduate portfolio...
Khushi sharma undergraduate portfolio...khushisharma298853
 
UX Conference on UX Research Trends in 2024
UX Conference on UX Research Trends in 2024UX Conference on UX Research Trends in 2024
UX Conference on UX Research Trends in 2024mikailaoh
 
Production of Erythromycin microbiology.pptx
Production of Erythromycin microbiology.pptxProduction of Erythromycin microbiology.pptx
Production of Erythromycin microbiology.pptxb2kshani34
 
WCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptx
WCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptxWCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptx
WCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptxHasan S
 
Cold War Tensions Increase - 1945-1952.pptx
Cold War Tensions Increase - 1945-1952.pptxCold War Tensions Increase - 1945-1952.pptx
Cold War Tensions Increase - 1945-1952.pptxSamKuruvilla5
 
LRFD Bridge Design Specifications-AASHTO (2014).pdf
LRFD Bridge Design Specifications-AASHTO (2014).pdfLRFD Bridge Design Specifications-AASHTO (2014).pdf
LRFD Bridge Design Specifications-AASHTO (2014).pdfHctorFranciscoSnchez1
 
Construction Documents Checklist before Construction
Construction Documents Checklist before ConstructionConstruction Documents Checklist before Construction
Construction Documents Checklist before ConstructionResDraft
 
High-Quality Faux Embroidery Services | Cre8iveSkill
High-Quality Faux Embroidery Services | Cre8iveSkillHigh-Quality Faux Embroidery Services | Cre8iveSkill
High-Quality Faux Embroidery Services | Cre8iveSkillCre8iveskill
 
The future of UX design support tools - talk Paris March 2024
The future of UX design support tools - talk Paris March 2024The future of UX design support tools - talk Paris March 2024
The future of UX design support tools - talk Paris March 2024Alan Dix
 

Kürzlich hochgeladen (19)

How to use Ai for UX UI Design | ChatGPT
How to use Ai for UX UI Design | ChatGPTHow to use Ai for UX UI Design | ChatGPT
How to use Ai for UX UI Design | ChatGPT
 
Math Group 3 Presentation OLOLOLOLILOOLLOLOL
Math Group 3 Presentation OLOLOLOLILOOLLOLOLMath Group 3 Presentation OLOLOLOLILOOLLOLOL
Math Group 3 Presentation OLOLOLOLILOOLLOLOL
 
Mike Tyson Sign The Contract Big Boy Shirt
Mike Tyson Sign The Contract Big Boy ShirtMike Tyson Sign The Contract Big Boy Shirt
Mike Tyson Sign The Contract Big Boy Shirt
 
Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024
Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024
Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024
 
Embroidery design from embroidery magazine
Embroidery design from embroidery magazineEmbroidery design from embroidery magazine
Embroidery design from embroidery magazine
 
Create Funeral Invites Online @ feedvu.com
Create Funeral Invites Online @ feedvu.comCreate Funeral Invites Online @ feedvu.com
Create Funeral Invites Online @ feedvu.com
 
Best-NO1 Pakistani Amil Baba Real Amil baba In Pakistan Najoomi Baba in Pakis...
Best-NO1 Pakistani Amil Baba Real Amil baba In Pakistan Najoomi Baba in Pakis...Best-NO1 Pakistani Amil Baba Real Amil baba In Pakistan Najoomi Baba in Pakis...
Best-NO1 Pakistani Amil Baba Real Amil baba In Pakistan Najoomi Baba in Pakis...
 
Design mental models for managing large-scale dbt projects. March 21, 2024 in...
Design mental models for managing large-scale dbt projects. March 21, 2024 in...Design mental models for managing large-scale dbt projects. March 21, 2024 in...
Design mental models for managing large-scale dbt projects. March 21, 2024 in...
 
Designing for privacy: 3 essential UX habits for product teams
Designing for privacy: 3 essential UX habits for product teamsDesigning for privacy: 3 essential UX habits for product teams
Designing for privacy: 3 essential UX habits for product teams
 
Building+your+Data+Project+on+AWS+-+Luke+Anderson.pdf
Building+your+Data+Project+on+AWS+-+Luke+Anderson.pdfBuilding+your+Data+Project+on+AWS+-+Luke+Anderson.pdf
Building+your+Data+Project+on+AWS+-+Luke+Anderson.pdf
 
Khushi sharma undergraduate portfolio...
Khushi sharma undergraduate portfolio...Khushi sharma undergraduate portfolio...
Khushi sharma undergraduate portfolio...
 
UX Conference on UX Research Trends in 2024
UX Conference on UX Research Trends in 2024UX Conference on UX Research Trends in 2024
UX Conference on UX Research Trends in 2024
 
Production of Erythromycin microbiology.pptx
Production of Erythromycin microbiology.pptxProduction of Erythromycin microbiology.pptx
Production of Erythromycin microbiology.pptx
 
WCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptx
WCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptxWCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptx
WCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptx
 
Cold War Tensions Increase - 1945-1952.pptx
Cold War Tensions Increase - 1945-1952.pptxCold War Tensions Increase - 1945-1952.pptx
Cold War Tensions Increase - 1945-1952.pptx
 
LRFD Bridge Design Specifications-AASHTO (2014).pdf
LRFD Bridge Design Specifications-AASHTO (2014).pdfLRFD Bridge Design Specifications-AASHTO (2014).pdf
LRFD Bridge Design Specifications-AASHTO (2014).pdf
 
Construction Documents Checklist before Construction
Construction Documents Checklist before ConstructionConstruction Documents Checklist before Construction
Construction Documents Checklist before Construction
 
High-Quality Faux Embroidery Services | Cre8iveSkill
High-Quality Faux Embroidery Services | Cre8iveSkillHigh-Quality Faux Embroidery Services | Cre8iveSkill
High-Quality Faux Embroidery Services | Cre8iveSkill
 
The future of UX design support tools - talk Paris March 2024
The future of UX design support tools - talk Paris March 2024The future of UX design support tools - talk Paris March 2024
The future of UX design support tools - talk Paris March 2024
 

Multi(Touch) Gesture Research

  • 1. Multi(Touch) Gesture Research Lecture: Journal Club – spring 2010 Florian Weil University of Art Linz – Master: Interface Culture
  • 2. Questions ● Which differences exist in gesture interaction on different screen sizes? ● How is the research community for gesture interaction organized? ● Which conferences exist? ● Who are the key researcher and other important researcher?
  • 3. Different screenformats - Small Small Screens Smart Phones
  • 4. Different screenformats - Medium Netbooks Tablet PCs
  • 5. Different screenformats - Large MultiTouch Displays TableTop Displays
  • 6. Different screenformats – extra large Touch Walls
  • 7. Researcher & People ● Explored ● Keynote and Opening Speakers ● Reviewer Lists ● Papers ● Could not find key roles ● Good balance of academic (University) and economic driven research (Microsoft etc.)
  • 8. Conferences & Community ● Computer Human Interaction (CHI) ● Interactive Tapletop and Surfaces (ITS) ● Tangible, Embedded, and Embodied Interaction (TEI) ● Gesture Workshop (GW)
  • 9. Computer Human Interaction (CHI) ● Big and general conference about Human and Computer Interaction ● Special Session about surfaces and tabletop Interaction → with gesture interaction ● Organizer ● Georgia Institute of Technology ● Brigham Young University ● Microsoft Research / University of Washington ● Place ● Mainly USA and Canada, sometimes Europe ● Atlanta, Boston, Florence, San Jose, Montreal...
  • 10. Tangible, Embedded, and Embodied Interaction (TEI) ● Medium big conference on Tangible, Embedded, and Embodied Interaction. ● Very good for gesture research for tangible devices. ● Sponsors: ● Nokia, Microsoft Research, Philips, Fraunhofer, ACM, SIGCHI ● Place: ● Europe and North America ● Portugal, USA, UK, Germany, ...
  • 11. Interactive Tapletop and Surfaces ● Medium and pretty young conference (started 2006) with focus on interaction design in connection with surfaces and tabletop systems, like reactable ● Very good for research in (multiTouch) gesture interaction ● Organizer: ● Sriram Subramanian, University of Bristol, UK ● Antonio Krüger (DFKI GmbH) ● And other... ● Place: ● Very often in Europe ● Saarbrücken, Banff, Amsterdam, Newport
  • 12. Gesture Workshop ● Small conference / workshop with focus on gesture interaction in general ● Mostly focus on free form and auditive gestures ● Organizer ● University Bielefeld, Adetti, University of South Brittany, … ● Place ● Only in Europe ● Bielefeld, Lisbon, Ile de Berder, Genova, London, ...
  • 13. Researched Papers Anne Roudaut, Eric Lecolinet and Yves Guiard, “MicroRolls: expanding touch-screen input vocabulary by distinguishing rolls vs. slides of the thumb”, Proceedings of CHI 2009, Boston, MA, USA, 2009, pp. 927- 936. . Tom Moscovich and John F. Hughes, “Indirect mappings of multi-touch input using one and two hands”, Proceedings of CHI 2008, Florence, Italy, 2008, pp. 1275-1284. Chi Tai Dang, Martin Straub, Elisabeth André, “Hand distinction for multi-touch tabletop interaction”, Proceedings of ITS 2009, Banff, Alberta, Canada, 2009, pp. 101-108. Mathias Frisch, Jens Heydekorn, Raimund Dachselt, “Investigating multi-touch and pen gestures for diagram editing on interactive surfaces”, Proceedings of ITS 2009, Banff, Alberta, Canada, 2009, pp. 149- 156 Alexander Schick, Florian van de Camp, Joris Ijsselmuiden and Rainer Stiefelhagen, “Extending touch: towards interaction with large-scale surfaces”, Proceedings of ITS 2009, Banff, Alberta, Canada, 2009, pp. 117-124.
  • 14. Small Screen Gesture with Thumb ● http://www.youtube.com/watch?v=bfH0-OqgbLw ● Context: during movement, one hand interaction ● Categories: Drag, Swipe, Rubbing, MicroRolls ● Testings (10 people, Aged 23-28) ● MicroRoll 2x faster than contex menu UI ● MicroRoll same as fast as easy Toolbar, faster than difficult toolbar ● MicroRoll Gesture itself: ● Robust and easy to learn ● Good perfomance (influenced by the position of the gesture) ● Good combination with TapTap, TapRoll, RollMark gestures
  • 15. Medium screen: uni or bimanual gesture ● Context: TableTop systems and Medium Screens ● Motivation: investigate perfomance and the right task for uni and bimanual gestures ● Approach: Testing the commands align, positioning, rotation, scaling of digital objects. ● Result: ● Unimanual interaction for visual rotation, transporting, rotating, and stretching ● Bimanual interaction for control of two individual (control) points (example tasks: window manipulation, image croping etc.) ● Perfomance differences are small, so the designer can safely interchange between the two methods
  • 16. TableTop Screen: Hand Distinction ● Context: TableTop systems and Large Screens ● Motivation: Distinguish one-hand and two-hand gestures improves gesture systems ● more stable and accurated gesture recognition ● avoiding of conflicts in multi-user systems ● Approach: use the anatomy information of the user hand and combine them with touch point and finger orientation data. ● Result: ● Average: 96% successfully hand recognition ● Thumb need a more detail observation ● Heuristic formular works fine, but constant values needs improvements
  • 17. TableTop Screen: Hand Distinction Source: Chi Tai Dang, Martin Straub, Elisabeth André, “Hand distinction for multi-touch tabletop interaction”, Proceedings of ITS 2009, Banff, Alberta, Canada, 2009, pp. 101-108.
  • 18. Large Screen Gesture via Pointing ● http://www.youtube.com/watch?v=cV60gwiM5HM ● Context: Big static screen, some objects are not reachable ● Categories: Pointing and Touch gestures ● Seamlessly direct object manipulation with pointing and touch ● User test results: ● User think it is a very useful extension ● Very intuitiv and easy learning interaction ● Objects are easier to reach and less exhausting compared to touch-only systems ● User did not really use these two interactions for the same task