SlideShare ist ein Scribd-Unternehmen logo
1 von 11
Do Mechanical Turks Dream of Square Pie Charts? Robert Kosara and Caroline Ziemkiewicz
University vs. Online Studies ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Caroline Ziemkiewicz
Mechanical Turk ,[object Object],[object Object],[object Object],[object Object],[object Object],Caroline Ziemkiewicz
Our experiences Turking studies ,[object Object],[object Object],[object Object],[object Object],[object Object],Caroline Ziemkiewicz
Participants ,[object Object],[object Object],[object Object],[object Object],Caroline Ziemkiewicz
Participants ,[object Object],[object Object],[object Object],Caroline Ziemkiewicz
Designing studies ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Caroline Ziemkiewicz
Running studies ,[object Object],[object Object],Caroline Ziemkiewicz
Running Studies ,[object Object],[object Object],[object Object],[object Object],[object Object],Caroline Ziemkiewicz
To Turk or not to Turk ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Caroline Ziemkiewicz
Thanks! Let’s discuss!

Weitere ähnliche Inhalte

Mehr von BELIV Workshop

Mehr von BELIV Workshop (17)

Many Roads Lead to Rome. Mapping Users’ Problem Solving Strategies.
Many Roads Lead to Rome. Mapping Users’ Problem Solving Strategies.Many Roads Lead to Rome. Mapping Users’ Problem Solving Strategies.
Many Roads Lead to Rome. Mapping Users’ Problem Solving Strategies.
 
Proposed Working Memory Measures for Evaluating Information Visualization Tools.
Proposed Working Memory Measures for Evaluating Information Visualization Tools.Proposed Working Memory Measures for Evaluating Information Visualization Tools.
Proposed Working Memory Measures for Evaluating Information Visualization Tools.
 
How is a graphic like pumpkin pie? A framework for analysis and critique of v...
How is a graphic like pumpkin pie? A framework for analysis and critique of v...How is a graphic like pumpkin pie? A framework for analysis and critique of v...
How is a graphic like pumpkin pie? A framework for analysis and critique of v...
 
Implications of Individual Differences on Evaluating Information Visualizatio...
Implications of Individual Differences on Evaluating Information Visualizatio...Implications of Individual Differences on Evaluating Information Visualizatio...
Implications of Individual Differences on Evaluating Information Visualizatio...
 
Towards Information-Theoretic Visualization Evaluation Measure: A Practical e...
Towards Information-Theoretic Visualization Evaluation Measure: A Practical e...Towards Information-Theoretic Visualization Evaluation Measure: A Practical e...
Towards Information-Theoretic Visualization Evaluation Measure: A Practical e...
 
Is Your User Hunting or Gathering Insights? Identifying Insight Drivers Acros...
Is Your User Hunting or Gathering Insights? Identifying Insight Drivers Acros...Is Your User Hunting or Gathering Insights? Identifying Insight Drivers Acros...
Is Your User Hunting or Gathering Insights? Identifying Insight Drivers Acros...
 
A Descriptive Model of Visual Scanning.
A Descriptive Model of Visual Scanning.A Descriptive Model of Visual Scanning.
A Descriptive Model of Visual Scanning.
 
Generating a synthetic video dataset
Generating a synthetic video datasetGenerating a synthetic video dataset
Generating a synthetic video dataset
 
Beyond system logging: human logging for evaluating information visualization.
Beyond system logging: human logging for evaluating information visualization.Beyond system logging: human logging for evaluating information visualization.
Beyond system logging: human logging for evaluating information visualization.
 
Scanning Between Graph Visualizations: An Eye Tracking Evaluation.
Scanning Between Graph Visualizations: An Eye Tracking Evaluation.Scanning Between Graph Visualizations: An Eye Tracking Evaluation.
Scanning Between Graph Visualizations: An Eye Tracking Evaluation.
 
Focus Groups for Functional InfoVis Prototype Evaluation: A Case Study.
Focus Groups for Functional InfoVis Prototype Evaluation: A Case Study.Focus Groups for Functional InfoVis Prototype Evaluation: A Case Study.
Focus Groups for Functional InfoVis Prototype Evaluation: A Case Study.
 
Learning-Based Evaluation of Visual Analytic Systems.
Learning-Based Evaluation of Visual Analytic Systems.Learning-Based Evaluation of Visual Analytic Systems.
Learning-Based Evaluation of Visual Analytic Systems.
 
Visualization Evaluation of the Masses, by the Masses, and for the Masses.
Visualization Evaluation of the Masses, by the Masses, and for the Masses.Visualization Evaluation of the Masses, by the Masses, and for the Masses.
Visualization Evaluation of the Masses, by the Masses, and for the Masses.
 
Evaluating Information Visualization in Large Companies: Challenges, Experien...
Evaluating Information Visualization in Large Companies: Challenges, Experien...Evaluating Information Visualization in Large Companies: Challenges, Experien...
Evaluating Information Visualization in Large Companies: Challenges, Experien...
 
Pragmatic Challenges in the Evaluation of Interactive Visualization Systems.
Pragmatic Challenges in the Evaluation of Interactive Visualization Systems.Pragmatic Challenges in the Evaluation of Interactive Visualization Systems.
Pragmatic Challenges in the Evaluation of Interactive Visualization Systems.
 
Comparative Evaluation of Two Interface Tools in Performing Visual Analytics ...
Comparative Evaluation of Two Interface Tools in Performing Visual Analytics ...Comparative Evaluation of Two Interface Tools in Performing Visual Analytics ...
Comparative Evaluation of Two Interface Tools in Performing Visual Analytics ...
 
BELIV'10 Keynote: Conceptual and Practical Challenges in InfoViz Evaluations
BELIV'10 Keynote: Conceptual and Practical Challenges in InfoViz EvaluationsBELIV'10 Keynote: Conceptual and Practical Challenges in InfoViz Evaluations
BELIV'10 Keynote: Conceptual and Practical Challenges in InfoViz Evaluations
 

Do Mechanical Turks Dream of Square Pie Charts?