ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface

itcampro@ itcamp13# Premium conference on Microsoft technologies
The Engaging User Experience
& The Natural User Interface
Tim Huckaby
InterKnowlogy Chairman/Founder
Actus Interactive Software Founder & CEO
Microsoft® Regional Director – Southern California
Microsoft® MVP – Kinect for Windows
E-mail: TimHuck@InterKnowlogy.com
TimH@Actus-Software.com
Blog:
team.interknowlogy.com/blogs/timhuckaby
FaceBook:
www.facebook.com/Tim.Huckaby.Carlsbad
LinkedIn: www.linkedin.com/in/timhuckaby
Twitter: @TimHuckaby

KeynoteHuge thanks to our sponsors!

Keynote
A little bit about me and why I am here…
The Engaging User Experience & the Natural User Interface

KeynoteAbout Tim, InterKnowlogy & Actus…
InterKnowlogy (www.InterKnowlogy.com)
Tim Huckaby, Founder/Chairman (TimHuck@InterKnowlogy.com)
◦ 13+ year old services firm – Custom Application Development
◦ focused on building NUI solutions
◦ Web, mobile, and desktop
◦ Windows 7/8, PixelSense, WP7/8, Azure, Kinect, XAML stack
- Largest Client: Microsoft
Actus Interactive Software (www.Actus-Software.com)
Tim Huckaby, Founder/CEO (TimHuck@Actus-Software.com)
◦ Software Product Company
◦ Interactive Kiosk and Active Digital Signage
◦ Multi-Touch, Gesture, and Voice Driven Solutions

NUI enabled applications improve the communication, education and
user experience across the software continuum.
Objectives And Agenda
There are a number of tenants of an engaging user interface that will
last the test of time
The 4 Manifestations of NUI: Multi-Touch, Vocal, Gesture, Neural
Where We have Been and Where we are Going
Demos, Demos, Demos….
The Natural User Interface (NUI)

The Tenants of an Engaging UX
Use the Power of Faces
– People love faces; We see faces where they don’t exist
– We have DNA with the sole purpose of recognizing faces
– Take advantage of this by putting faces on your App
• Have the faces to look at important part of your App
• People instinctively follow the eyes of the face.
Use Food, Sex and Danger
– When someone sees something new, they place it into one of four
categories:
1. Can I Eat it?
2. Can it Eat Me?
3. Can I Mate with it?
4. …and everything else.
• If you want your App to be engaged and interesting, put it in one of
the first three categories.

The Tenants of an Engaging UX
Tell a story
– We learn through stories. It’s how we teach our children. It’s the Bible;
It’s what we see in movies.
– Stories are a big part of how information is conveyed to us.
– If you have information to give to the user, put it in story form.
– It doesn’t matter what medium you use (words, pictures, music), but
using a story narrative will help your user understand and retain your
information.
Build commitment over time
– Let the user choose how they want to interact with you (RSS, Twitter,
Facebook)
– Make sure that you don’t take advantage of the trust that is implicit
in that interaction.
Use Natural Interactions of Objects
– Natural Movements
– Fluidity
– Animate / Exaggerate: Slow things down so the eye can follow

January 27, 2010

KeynoteThe “Cancer App” & The “Autocad App”
Tim Huckaby
Founder / Chairman, InterKnowlogy
Founder / CEO, Actus Software
Microsoft RD & MVP

KeynoteEMN8
Tim Huckaby
Microsoft RD & MVP

The “Green Screen”
We have come a long way…

Image Courtesy of Computer History Museum

KeynoteTouch Capable Computing Devices Are Not New
Past
1972: PLATO IV
Touch Screen Terminal
The Samsung SUR40 for
Microsoft PixelSense
Windows 8 - Metro
Apple iPad
Present Future (now)

KeynoteWhat is Relatively New is:
– Inexpensive Touch Capable, Non Proprietary Hardware
– A Operating Systems designed for Multi-Touch
– A Consistent Multi-Touch API for the major Hardware/Software
Platforms
– Developer Productivity in Touch Capable Apps
– The Forecast of Multi-Touch Hardware Capability in Every New
Computing Device in the Short Term

NUI: The Natural User Interface
Multi-Touch Capable
•Common Gestures of Touch
•Physical Object Interaction
•Virtual Object Interaction
Gesture Capable
•Motion Based Interface
•Tracking of full-body movement, facial expression, and voice with precision
Voice Capable
•Multi-array Microphone
•Uniquely Distinguish Audio & Voices
Nueral Capable
•Conscious and non-conscience interfaces
•Non Invasive

KeynoteGrey’s Anatomy
Tim Huckaby
Microsoft RD & MVP

KeynoteGesture Heart
Tim Huckaby
Microsoft RD & MVP

HTML 5 Touch Events, Version 1
W3C Working Draft 24 January 2013
Source: https://dvcs.w3.org/hg/webevents/raw-file/tip/touchevents.html
Defines a set of low-level events that represent one or more points of
contact with a touch-sensitive surface
Changes of those points with respect to the surface and any DOM elements
displayed upon it (e.g. for touch screens) or associated with it (e.g. for
drawing tablets without displays).
Addresses pen-tablet devices, such as drawing tablets, with consideration
toward stylus capabilities.
“This specification is the 24 January 2013 Last Call Working Draft. The
comment period for this Last Call Working Draft ends 14 February 2013.”

Keynote

KeynoteDemocratic National Convention Voting App
Tim Huckaby
Microsoft RD & MVP

Keynote
What is also Relatively New:
User Experience with Naturally Behaving Objects
– Large Form Factors
demand natural behaviors
– The User Experience is
“never done”
– It can always be improved
– Tablet Computing paved
the way
– Software Physics Engines
are readily available in
open source

KeynoteFluid Layout & Pixelsence Craps
Tim Huckaby
Microsoft RD & MVP

“Game-ification” Culture
User Experiences that Enhance Learning
Learning made Fun / Entertaining
Proven as a learning tool beyond just Children
Computer based Games are a significant part of popular culture
Educational Video Game Curriculums
– MIT, UC Irvine, Minnesota, Michigan State, etc.

KeynoteNASA Marsbound
Tim Huckaby
Microsoft RD & MVP

Keynote
Kinect for Windows
World's Fastest-Selling Consumer Electronics Device
… a Future Beyond Gaming
Combination of RGB camera, depth sensor and multi-array microphone
– RGB camera delivers three basic color components
– Depth sensors “sees” in 3-D
– Microphone locates voices by sound and excludes ambient noise
Consumer Priced: $249.99
Tracks full-body movement, facial expression, and voice with precision
Kinect sensor bar scans and monitors 1 million points on the body
Kinect for Windows SDK
– Skeletal Tracking
– Face, Gesture Recognition
– Audio Echo cancellation
– Audio Beam Forming
– Speech Recognition
– Machine Learning

Keynote
Actus Interactive Digital Content System (Kiosk), IK Physical
Therapy, IK Touch-less Operating Room
Tim Huckaby
Microsoft RD & MVP

Keynote3D Modeler
Tim Huckaby
Microsoft RD & MVP

KeynoteKinect for Windows Competitors
Leap Motion
– $70
– https://leapmotion.com
– Not available yet
SoftKinetic
– http://www.softkinetic.com
– $249
– Distance and Near Mode
– Multiple Products
– In the space for over a decade
Panasonic
– Works outside in broad daylight
– $2,600

Keynote
Neural Interfaces:
Conscious and Non-Conscious
High fidelity EG acquisition device
No conductive gel, etc.
Non-invasive
Use Case Examples:
• Conscious: mind manipulation of objects
• Non-Conscious: Ranking music
• First target market: gaming
• $300!!!

KeynoteEmotiv
Tim Huckaby
Microsoft RD & MVP

Keynote
We are within a decade of building the Holodeck
“The Ultimate NUI Application”

Keynote
HoloDesk - Direct 3D Interactions with a
Situated See-Through Display
Tim Huckaby
Microsoft RD & MVP

Summary
We are at the cusp of a revolution in software & hardware
Using Natural User Interface (NUI) technologies improve the User
Experience
The hardware, tools, plumbing and platforms for NUI computing are
powerful and available now.…and will just continue to get better, cheaper, powerful and
more available
Within a realistic time frame NUI computing will be the norm
The concepts of NUI change the way we design and build software
There are a number of design tenants that can enhance User Experience

More info on InterKnowlogy:
www.InterKnowlogy.com
www.vimeo.com/InterKnowlogy
More info on Actus Software:
◦www.Actus-Software.com
About Tim Huckaby…
◦Founder/Chairman, InterKnowlogy
◦Founder/Chairman, Actus Software
◦Microsoft® Regional Director – Southern
California
◦Microsoft® .NET Partner Advisory Council
Founder / Member
◦Microsoft® MVP – Kinect for Windows
◦INETA Speaker – International .NET Users Group
Association
◦Board Member: Association for Competitive
Technology
◦Board Member: Microsoft Healthcare Partner
Advisory Board
◦Author / Speaker
Contact me:
E-mail:
TimHuck@InterKnowlogy.com
TimH@Actus-Software.com
Phone:
• Office: 760-444-8640
• Mobile:: 619 990 9200
Blog:
http://team.interknowlogy.com/blogs/timhuckaby
FaceBook:
http://www.facebook.com/Tim.Huckaby.Carlsbad
LinkedIn:
http://www.linkedin.com/in/timhuckaby
Twitter: @TimHuckaby
Tim Huckaby

Q & A

ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

Andere mochten auch

Andere mochten auch (20)

Ähnlich wie ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface

Ähnlich wie ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface (20)

Mehr von ITCamp

Mehr von ITCamp (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface