1. User System Ergonomic Research IBM Almaden Research Center, Stanford University Physical, Graphical, & Cognitive Human Computer Interface MIT Media Lab Context Aware Group 1999 - 2008 CMU Silicon Valley Business mentoring The Generator Fund TED SELKER ALU Reg D M T L B
13. Context Aware Computing group Ted Selker, Associate Professor MIT Media lab Using Sensors and Virtual sensors To understand and respect human intention
14.
15.
16.
17.
18.
19.
20.
21. Attending visually (Yarbus 1967). 1) Free examination. Before subsequent recordings, the subject was asked to: 2) estimate the material circumstances of the family; 3) give the ages of the people; 4) surmise what the family had been doing before the arrival of the "unexpected visitor;" 5) remember the clothes worn by the people; 6) remember the position of the people and -objects in the room; 7) estimate how long the "unexpected visitor" had been away from the family Learning by watching
35. Postal Truck Business : GPS/ 802.11Delivering Everything Targeted marketing Enlist for traffic control Location & time sensitive services Safety Cameras Surround vehicle Sonic, vibration and LED indicators Lear anti Whiplash seat Automatic emergency break …
This next project is about shooting home video or personal video. The idea is that people shoot a lot of video and often end up with hours of footage to go through and edit which is a laborious process, so we wanted to try to do something to augment and assist this editing process by doing something to automatically index interesting parts of the video. So we wired up the camera operator (me) with some sensors to see if we could tell what video sequences might be interesting later. So, we decided that laughter might be a good indicator of interest and built a laughter recognition system that the camera operator wore around while shooting. We also used the galvactivator to record skin conductivity, and were taking video of the user’s facial expressions.
A low level layer includes implicit low granularity information such as key-strokes and mouse movement activity. An intermediate layer includes the activities and information to which some of the low granularity data can be extracted and summarized, such as reading, walking, between tasks, paying attention, etc. And a top layer or knowledge layer includes the information or concepts related to the user goals. A disruption manager based on this three-layer architecture will monitor the user state (current activity), concepts surrounding the user’s goals: history of recently accessed documents, web pages and search queries, the interrupting message relevancy to these concepts, and concept priority and importance. The manager will then identify interrupting messages that should be allowed to interrupt the user or delayed to an appropriate time within task execution.