SlideShare a Scribd company logo
1 of 46
mine rescue ROBOT UI DESIGN TEAM Andrew Lee Nisha Kurani Ward Penney Tim Andrianoff Justine Yang
NEW ZEALAND mine explosion 11/19/2010 -2 Escaped -29 Missing
Two Robots Sent In Mine conditions too dangerous for rescuers Both were controlled by lengthy and delicate tethers  Mine rescue robot
But it was too late Second Explosion on November 24 Authorities concluded that  no one could have survived
Cave Crawler Robotics Institute Sponsor 	Red Whittaker Chuck Whittaker 	Aaron Morris Uland Wong “Advanced Reconnaissance Scout” Gas readings, structural map and images Semi-Autonomous Wireless
Our task: Design the user interface for the robot. ,[object Object]
Gas Readings
Map Generation
Still images
Robot Status
Structural Damage
AudioHCI Team Scalable for future sensors...
Our process: Gathering Data Evaluate Design ,[object Object]
1 Interview
1 Mine Visit
1 Mining 101 class
Numerous weekly meetings
3 Think Aloud    with 7 tasks ,[object Object],[object Object]
Foci Understand how a remote operator tracks, monitors, and directs a semi-autonomous robot to accomplish a task. Understand what information a mine rescuer needs from the mine and its priority. Understand the physical and environmental limitations placed on a mine rescuer’s ability to use an electronic device.
Foci 1) Robot ControlUnderstand how a remote operator tracks, monitors, and directs a semi-autonomous robot to accomplish a task. 2) Sensory Information and Decision MakingUnderstand what information a mine rescuer needs from the mine and its priority. 3) EnvironmentUnderstand the physical and environmental limitations placed on a mine rescuer’s ability to use an electronic device.
Contextual Inquiries
Mine Safety and Health Administration (MSHA)Bruceton Research Mine ,[object Object]
Information about robot sensory data
Interaction between robotics team and command center,[object Object]
Controlling robot and displaying information,[object Object]
Learned about rescue from both rescue team and command center perspectives
Mine rescue structure and procedure,[object Object]
Modeling
Consolidation Problem: Tested on different users on every CI 	- Artifact  	- Sequence Success: Affinity Diagramming was effective 	- Got all team members on same page 	- Enabled team with walk data with client
Visioning Problem: limited knowledge of technical limitations -1st session (within team):  get ideas out and get familiar with the process  - 2nd session (with client): get their ideas and implications for technical constraint
The Design
The Interface
Form Factor Tablet With Stylus* 	- Fits on desk 	- Operable with gloves / mask 	-	 Viewable over-the-shoulder Manual Controller** 	- Consolidated functionality required to drive *[MSHA, Mine Comp] **[MSHA, Mine Comp, Redzone]
One Map Breakdowns Solved ,[object Object]
Different numbering systems are dangerous **Design shared electronic map, displaying robot data automatically * [Mine Comp, MSHA] * [Mine Comp]
Driving Uncharted Territory ,[object Object],* [Mine Comp, MSHA] * [Mine Comp]
Robot Status Consolidated Information ,[object Object]
Connection strength for wireless* [RedZone, MSHA]
Gas Readings Gas Placard ,[object Object]
Common annotation for mine rescue map**
Red coloring for explosive gas mix.*** [Mine Comp, MSHA]
Images Critical to a Robot ,[object Object]
Displayed on map
Directional arrowsTechnical limitation ,[object Object]
Solved with two icons displayed to userUndownloaded Downloaded * [MSHA]
Prototyping and Evaluation

More Related Content

Similar to Final pres mine_rescue

Office service robot/majorprojectjiit2013-14
Office service robot/majorprojectjiit2013-14Office service robot/majorprojectjiit2013-14
Office service robot/majorprojectjiit2013-14Disha Singh
 
A Review On AI Vision Robotic Arm Using Raspberry Pi
A Review On AI Vision Robotic Arm Using Raspberry PiA Review On AI Vision Robotic Arm Using Raspberry Pi
A Review On AI Vision Robotic Arm Using Raspberry PiAngela Shin
 
Systems & Software, Etc - Laser Focus World Article
Systems & Software, Etc - Laser Focus World ArticleSystems & Software, Etc - Laser Focus World Article
Systems & Software, Etc - Laser Focus World ArticleDana Lee Church
 
Cse space-mouse-report
Cse space-mouse-reportCse space-mouse-report
Cse space-mouse-reportImkarthikreddy
 
CrowdMap: Accurate Reconstruction of Indoor Floor Plan from Crowdsourced Sens...
CrowdMap: Accurate Reconstruction of Indoor Floor Plan from Crowdsourced Sens...CrowdMap: Accurate Reconstruction of Indoor Floor Plan from Crowdsourced Sens...
CrowdMap: Accurate Reconstruction of Indoor Floor Plan from Crowdsourced Sens...Si Chen
 
Final_Semester_Project _Report
Final_Semester_Project _ReportFinal_Semester_Project _Report
Final_Semester_Project _ReportSriram Raghavan
 
High-Speed Neural Network Controller for Autonomous Robot Navigation using FPGA
High-Speed Neural Network Controller for Autonomous Robot Navigation using FPGAHigh-Speed Neural Network Controller for Autonomous Robot Navigation using FPGA
High-Speed Neural Network Controller for Autonomous Robot Navigation using FPGAiosrjce
 
Robotic Vehicle Movement with Webcam Operated by Cell Phone
Robotic Vehicle Movement with Webcam Operated by Cell PhoneRobotic Vehicle Movement with Webcam Operated by Cell Phone
Robotic Vehicle Movement with Webcam Operated by Cell PhoneIRJET Journal
 
Applying Drools in Assistive Technology
Applying Drools in Assistive TechnologyApplying Drools in Assistive Technology
Applying Drools in Assistive Technologytsurdilovic
 
Using Spatial Conditions for Mobile Applications
Using Spatial Conditions for Mobile ApplicationsUsing Spatial Conditions for Mobile Applications
Using Spatial Conditions for Mobile ApplicationsDominique Guinard
 
Presentation fractal robots .pptx
Presentation  fractal robots .pptxPresentation  fractal robots .pptx
Presentation fractal robots .pptxEcAlwinjolly
 
Computer network - Space Mouse
Computer  network - Space MouseComputer  network - Space Mouse
Computer network - Space Mousekarthikam27
 
10 06-03 uva boone-technical report
10 06-03 uva boone-technical report10 06-03 uva boone-technical report
10 06-03 uva boone-technical reportSean Casey, USRA
 
Final ppt
Final pptFinal ppt
Final pptpramada
 
Resereach thebenz snsjbnsjsjjssjsjsjsjsjjs
Resereach thebenz snsjbnsjsjjssjsjsjsjsjjsResereach thebenz snsjbnsjsjjssjsjsjsjsjjs
Resereach thebenz snsjbnsjsjjssjsjsjsjsjjsNIKHILAS12
 
JCN Electronics The Servant Project Report
JCN Electronics The Servant Project ReportJCN Electronics The Servant Project Report
JCN Electronics The Servant Project ReportCem Recai Çırak
 

Similar to Final pres mine_rescue (20)

Office service robot/majorprojectjiit2013-14
Office service robot/majorprojectjiit2013-14Office service robot/majorprojectjiit2013-14
Office service robot/majorprojectjiit2013-14
 
RoboticsNotes1.pdf
RoboticsNotes1.pdfRoboticsNotes1.pdf
RoboticsNotes1.pdf
 
A Review On AI Vision Robotic Arm Using Raspberry Pi
A Review On AI Vision Robotic Arm Using Raspberry PiA Review On AI Vision Robotic Arm Using Raspberry Pi
A Review On AI Vision Robotic Arm Using Raspberry Pi
 
Systems & Software, Etc - Laser Focus World Article
Systems & Software, Etc - Laser Focus World ArticleSystems & Software, Etc - Laser Focus World Article
Systems & Software, Etc - Laser Focus World Article
 
Cse space-mouse-report
Cse space-mouse-reportCse space-mouse-report
Cse space-mouse-report
 
H011114758
H011114758H011114758
H011114758
 
CrowdMap: Accurate Reconstruction of Indoor Floor Plan from Crowdsourced Sens...
CrowdMap: Accurate Reconstruction of Indoor Floor Plan from Crowdsourced Sens...CrowdMap: Accurate Reconstruction of Indoor Floor Plan from Crowdsourced Sens...
CrowdMap: Accurate Reconstruction of Indoor Floor Plan from Crowdsourced Sens...
 
Final_Semester_Project _Report
Final_Semester_Project _ReportFinal_Semester_Project _Report
Final_Semester_Project _Report
 
High-Speed Neural Network Controller for Autonomous Robot Navigation using FPGA
High-Speed Neural Network Controller for Autonomous Robot Navigation using FPGAHigh-Speed Neural Network Controller for Autonomous Robot Navigation using FPGA
High-Speed Neural Network Controller for Autonomous Robot Navigation using FPGA
 
MONITORING FIXTURES OF CNC MACHINE
MONITORING FIXTURES OF CNC MACHINEMONITORING FIXTURES OF CNC MACHINE
MONITORING FIXTURES OF CNC MACHINE
 
Robotic Vehicle Movement with Webcam Operated by Cell Phone
Robotic Vehicle Movement with Webcam Operated by Cell PhoneRobotic Vehicle Movement with Webcam Operated by Cell Phone
Robotic Vehicle Movement with Webcam Operated by Cell Phone
 
Applying Drools in Assistive Technology
Applying Drools in Assistive TechnologyApplying Drools in Assistive Technology
Applying Drools in Assistive Technology
 
Using Spatial Conditions for Mobile Applications
Using Spatial Conditions for Mobile ApplicationsUsing Spatial Conditions for Mobile Applications
Using Spatial Conditions for Mobile Applications
 
Presentation fractal robots .pptx
Presentation  fractal robots .pptxPresentation  fractal robots .pptx
Presentation fractal robots .pptx
 
Computer network - Space Mouse
Computer  network - Space MouseComputer  network - Space Mouse
Computer network - Space Mouse
 
10 06-03 uva boone-technical report
10 06-03 uva boone-technical report10 06-03 uva boone-technical report
10 06-03 uva boone-technical report
 
Final ppt
Final pptFinal ppt
Final ppt
 
Resereach thebenz snsjbnsjsjjssjsjsjsjsjjs
Resereach thebenz snsjbnsjsjjssjsjsjsjsjjsResereach thebenz snsjbnsjsjjssjsjsjsjsjjs
Resereach thebenz snsjbnsjsjjssjsjsjsjsjjs
 
Clei Tutorial 2010 - Texto
Clei Tutorial 2010 - TextoClei Tutorial 2010 - Texto
Clei Tutorial 2010 - Texto
 
JCN Electronics The Servant Project Report
JCN Electronics The Servant Project ReportJCN Electronics The Servant Project Report
JCN Electronics The Servant Project Report
 

More from Justine Yang

Justine Presentation
Justine PresentationJustine Presentation
Justine PresentationJustine Yang
 
Justine Directed Study Presentation
Justine Directed Study PresentationJustine Directed Study Presentation
Justine Directed Study PresentationJustine Yang
 
Justine DS Presentation
Justine DS PresentationJustine DS Presentation
Justine DS PresentationJustine Yang
 
Justine Presentation
Justine PresentationJustine Presentation
Justine PresentationJustine Yang
 
Directed Study Presentation
Directed Study PresentationDirected Study Presentation
Directed Study PresentationJustine Yang
 
Directed Study Presentation
Directed Study PresentationDirected Study Presentation
Directed Study PresentationJustine Yang
 
Pissarro Presentation
Pissarro PresentationPissarro Presentation
Pissarro PresentationJustine Yang
 

More from Justine Yang (8)

Justine Presentation
Justine PresentationJustine Presentation
Justine Presentation
 
Justine Directed Study Presentation
Justine Directed Study PresentationJustine Directed Study Presentation
Justine Directed Study Presentation
 
Justine DS Presentation
Justine DS PresentationJustine DS Presentation
Justine DS Presentation
 
Justine Presentation
Justine PresentationJustine Presentation
Justine Presentation
 
Presentation
PresentationPresentation
Presentation
 
Directed Study Presentation
Directed Study PresentationDirected Study Presentation
Directed Study Presentation
 
Directed Study Presentation
Directed Study PresentationDirected Study Presentation
Directed Study Presentation
 
Pissarro Presentation
Pissarro PresentationPissarro Presentation
Pissarro Presentation
 

Final pres mine_rescue

Editor's Notes

  1. Our story begins anew
  2. Our story begins anew
  3. Our story begins anew
  4. Our story begins anew
  5. Our story begins anew
  6. The only cultural implications we say were related to the mechanics and abilities of the robot, which was out of our hands. So, we decided not to model any of our CI’s with the Cultural Model.NOTE TO PRESENTER: DO NOT waste time reading them the contents of this table. Just talk about why we didn’t do cultural, and why we didn’t model Danny or Bruceton.
  7. Our story begins anew
  8. One high-level screenshot of our interface. I will now describe some of the main points in detail.
  9. We chose a tablet with stylus for several reasons: BO station always there, worker may have gloves / mask, and almost always more than one person viewing it.The manual controller contains functions from our consolidated models.
  10. MSHA – Robot Operator asked to perform 3 jobs: Driving, taking notes, relaying notes to command.Mine Comp – Different numbering system between the BO and Command led to a team “blowing up” the mine by moving explosive gas over a glowing battery. A map breakdown led to this.Robot Driver and Command
  11. When interviewing and consolidating, we were searching for what information is important when operating a robot.
  12. Gas Readings are extremely important to mine rescuers. We wanted to make this as clear, easy and understandable as possible. Automatically placed on map. Placard symbol used at the competition.Red coloring for explosive gas mix.
  13. Gas Readings are extremely important to mine rescuers. We wanted to make this as clear, easy and understandable as possible. Automatically placed on map. Placard symbol used at the competition.Red coloring for explosive gas mix.
  14. Our story begins anew
  15. Our story begins anew
  16. Our story begins anew
  17. Our story begins anew