SlideShare ist ein Scribd-Unternehmen logo
1 von 18
Is Your User Hunting or Gathering Insights?  Identifying Insight Drivers Across Domains   Michael  Smuc, Eva Mayr, Hanna Risku
Motivation ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Solutions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Our approach ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Specific knowledge of domain experts
Common ground of domain experts  in our case „temporal data explorers“
 
Insight Study ,[object Object],[object Object],[object Object],[object Object]
=> Across domain testing works! Effect of domain expertise on insights t = -0.29, df = 24,  p > .05
Different kinds of insights in a catering business dataset ,[object Object],[object Object]
Type 1 Type 2
Typology ,[object Object],[object Object],[object Object],[object Object],[object Object]
[object Object],[object Object],[object Object],[object Object]
Discussion ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Questions ? what is expertise? across domain testing shallow insights Relational Insight Organizer RIO what is a domain? insight hunting insight gathering experimental setting story about the data sampling what makes an expert? prior knowledge compensation by experts common ground applicability future research generalizability
additional
t = 0.16, df = 14, p > .05 t = -3.80,  df = 7,  p < .01 t = -4.87,  df = 14,  p < .001
Definition of insights “…  the understanding gained by an individual using a visualization tool (or parts thereof) for the purpose of data analysis, which is a gradual process toward s  discovering new knowledge “

Weitere ähnliche Inhalte

Ähnlich wie Is Your User Hunting or Gathering Insights? Identifying Insight Drivers Across Domains.

Awareness Support for Knowledge Workers in Research Networks - Very brief PhD...
Awareness Support for Knowledge Workers in Research Networks - Very brief PhD...Awareness Support for Knowledge Workers in Research Networks - Very brief PhD...
Awareness Support for Knowledge Workers in Research Networks - Very brief PhD...Wolfgang Reinhardt
 
Data Science in Industry - Applying Machine Learning to Real-world Challenges
Data Science in Industry - Applying Machine Learning to Real-world ChallengesData Science in Industry - Applying Machine Learning to Real-world Challenges
Data Science in Industry - Applying Machine Learning to Real-world ChallengesYuchen Zhao
 
Visualization Best Practices Webinar
Visualization Best Practices WebinarVisualization Best Practices Webinar
Visualization Best Practices WebinarUnilytics
 
II-PIC 2017: Artificial Intelligence, Machine Learning, And Deep Neural Netwo...
II-PIC 2017: Artificial Intelligence, Machine Learning, And Deep Neural Netwo...II-PIC 2017: Artificial Intelligence, Machine Learning, And Deep Neural Netwo...
II-PIC 2017: Artificial Intelligence, Machine Learning, And Deep Neural Netwo...Dr. Haxel Consult
 
Advances in Exploratory Data Analysis, Visualisation and Quality for Data Cen...
Advances in Exploratory Data Analysis, Visualisation and Quality for Data Cen...Advances in Exploratory Data Analysis, Visualisation and Quality for Data Cen...
Advances in Exploratory Data Analysis, Visualisation and Quality for Data Cen...Hima Patel
 
Barga Data Science lecture 2
Barga Data Science lecture 2Barga Data Science lecture 2
Barga Data Science lecture 2Roger Barga
 
Code mashadvancedtopicsworkshop
Code mashadvancedtopicsworkshopCode mashadvancedtopicsworkshop
Code mashadvancedtopicsworkshoplisacrispin
 
Intelligently Automating Machine Learning, Artificial Intelligence, and Data ...
Intelligently Automating Machine Learning, Artificial Intelligence, and Data ...Intelligently Automating Machine Learning, Artificial Intelligence, and Data ...
Intelligently Automating Machine Learning, Artificial Intelligence, and Data ...Ali Alkan
 
Taxonomy Validation
Taxonomy ValidationTaxonomy Validation
Taxonomy ValidationDave Cooksey
 
Card Sorting: designing usable categories
Card Sorting: designing usable categoriesCard Sorting: designing usable categories
Card Sorting: designing usable categoriesRafael Marinho
 
Data Science Highlights
Data Science Highlights Data Science Highlights
Data Science Highlights Joe Lamantia
 
Artificial Intelligence and The Complexity
Artificial Intelligence and The ComplexityArtificial Intelligence and The Complexity
Artificial Intelligence and The ComplexityHendri Karisma
 
Understanding Users Through Ethnography and Modeling - STC Summit 2010
Understanding Users Through Ethnography and Modeling - STC Summit 2010Understanding Users Through Ethnography and Modeling - STC Summit 2010
Understanding Users Through Ethnography and Modeling - STC Summit 2010Jim Jarrett
 
Concept Sorting in Knowledge Elicitation
Concept Sorting in Knowledge ElicitationConcept Sorting in Knowledge Elicitation
Concept Sorting in Knowledge ElicitationAdarshaDhakal
 
Comu346 lecture 7 - user evaluation
Comu346   lecture 7 - user evaluationComu346   lecture 7 - user evaluation
Comu346 lecture 7 - user evaluationDavid Farrell
 
Filar seymour oreilly_bot_story_
Filar seymour oreilly_bot_story_Filar seymour oreilly_bot_story_
Filar seymour oreilly_bot_story_EndgameInc
 

Ähnlich wie Is Your User Hunting or Gathering Insights? Identifying Insight Drivers Across Domains. (20)

Awareness Support for Knowledge Workers in Research Networks - Very brief PhD...
Awareness Support for Knowledge Workers in Research Networks - Very brief PhD...Awareness Support for Knowledge Workers in Research Networks - Very brief PhD...
Awareness Support for Knowledge Workers in Research Networks - Very brief PhD...
 
Data Science in Industry - Applying Machine Learning to Real-world Challenges
Data Science in Industry - Applying Machine Learning to Real-world ChallengesData Science in Industry - Applying Machine Learning to Real-world Challenges
Data Science in Industry - Applying Machine Learning to Real-world Challenges
 
Visualization Best Practices Webinar
Visualization Best Practices WebinarVisualization Best Practices Webinar
Visualization Best Practices Webinar
 
II-PIC 2017: Artificial Intelligence, Machine Learning, And Deep Neural Netwo...
II-PIC 2017: Artificial Intelligence, Machine Learning, And Deep Neural Netwo...II-PIC 2017: Artificial Intelligence, Machine Learning, And Deep Neural Netwo...
II-PIC 2017: Artificial Intelligence, Machine Learning, And Deep Neural Netwo...
 
Advances in Exploratory Data Analysis, Visualisation and Quality for Data Cen...
Advances in Exploratory Data Analysis, Visualisation and Quality for Data Cen...Advances in Exploratory Data Analysis, Visualisation and Quality for Data Cen...
Advances in Exploratory Data Analysis, Visualisation and Quality for Data Cen...
 
Barga Data Science lecture 2
Barga Data Science lecture 2Barga Data Science lecture 2
Barga Data Science lecture 2
 
Code mashadvancedtopicsworkshop
Code mashadvancedtopicsworkshopCode mashadvancedtopicsworkshop
Code mashadvancedtopicsworkshop
 
Intelligently Automating Machine Learning, Artificial Intelligence, and Data ...
Intelligently Automating Machine Learning, Artificial Intelligence, and Data ...Intelligently Automating Machine Learning, Artificial Intelligence, and Data ...
Intelligently Automating Machine Learning, Artificial Intelligence, and Data ...
 
Choosing the Right UX Method
Choosing the Right UX MethodChoosing the Right UX Method
Choosing the Right UX Method
 
Taxonomy Validation
Taxonomy ValidationTaxonomy Validation
Taxonomy Validation
 
Card Sorting: designing usable categories
Card Sorting: designing usable categoriesCard Sorting: designing usable categories
Card Sorting: designing usable categories
 
Data Science Highlights
Data Science Highlights Data Science Highlights
Data Science Highlights
 
Artificial Intelligence and The Complexity
Artificial Intelligence and The ComplexityArtificial Intelligence and The Complexity
Artificial Intelligence and The Complexity
 
Unit 2.pptx
Unit 2.pptxUnit 2.pptx
Unit 2.pptx
 
Understanding Users Through Ethnography and Modeling - STC Summit 2010
Understanding Users Through Ethnography and Modeling - STC Summit 2010Understanding Users Through Ethnography and Modeling - STC Summit 2010
Understanding Users Through Ethnography and Modeling - STC Summit 2010
 
Concept Sorting in Knowledge Elicitation
Concept Sorting in Knowledge ElicitationConcept Sorting in Knowledge Elicitation
Concept Sorting in Knowledge Elicitation
 
Comu346 lecture 7 - user evaluation
Comu346   lecture 7 - user evaluationComu346   lecture 7 - user evaluation
Comu346 lecture 7 - user evaluation
 
Filar seymour oreilly_bot_story_
Filar seymour oreilly_bot_story_Filar seymour oreilly_bot_story_
Filar seymour oreilly_bot_story_
 
data analysis.ppt
data analysis.pptdata analysis.ppt
data analysis.ppt
 
data analysis.pptx
data analysis.pptxdata analysis.pptx
data analysis.pptx
 

Mehr von BELIV Workshop

Look Before You Link: Eye Tracking in Multiple Coordinated View Visualization.
Look Before You Link: Eye Tracking in Multiple Coordinated View Visualization.Look Before You Link: Eye Tracking in Multiple Coordinated View Visualization.
Look Before You Link: Eye Tracking in Multiple Coordinated View Visualization.BELIV Workshop
 
Many Roads Lead to Rome. Mapping Users’ Problem Solving Strategies.
Many Roads Lead to Rome. Mapping Users’ Problem Solving Strategies.Many Roads Lead to Rome. Mapping Users’ Problem Solving Strategies.
Many Roads Lead to Rome. Mapping Users’ Problem Solving Strategies.BELIV Workshop
 
Proposed Working Memory Measures for Evaluating Information Visualization Tools.
Proposed Working Memory Measures for Evaluating Information Visualization Tools.Proposed Working Memory Measures for Evaluating Information Visualization Tools.
Proposed Working Memory Measures for Evaluating Information Visualization Tools.BELIV Workshop
 
How is a graphic like pumpkin pie? A framework for analysis and critique of v...
How is a graphic like pumpkin pie? A framework for analysis and critique of v...How is a graphic like pumpkin pie? A framework for analysis and critique of v...
How is a graphic like pumpkin pie? A framework for analysis and critique of v...BELIV Workshop
 
Implications of Individual Differences on Evaluating Information Visualizatio...
Implications of Individual Differences on Evaluating Information Visualizatio...Implications of Individual Differences on Evaluating Information Visualizatio...
Implications of Individual Differences on Evaluating Information Visualizatio...BELIV Workshop
 
Towards Information-Theoretic Visualization Evaluation Measure: A Practical e...
Towards Information-Theoretic Visualization Evaluation Measure: A Practical e...Towards Information-Theoretic Visualization Evaluation Measure: A Practical e...
Towards Information-Theoretic Visualization Evaluation Measure: A Practical e...BELIV Workshop
 
A Descriptive Model of Visual Scanning.
A Descriptive Model of Visual Scanning.A Descriptive Model of Visual Scanning.
A Descriptive Model of Visual Scanning.BELIV Workshop
 
Generating a synthetic video dataset
Generating a synthetic video datasetGenerating a synthetic video dataset
Generating a synthetic video datasetBELIV Workshop
 
Beyond system logging: human logging for evaluating information visualization.
Beyond system logging: human logging for evaluating information visualization.Beyond system logging: human logging for evaluating information visualization.
Beyond system logging: human logging for evaluating information visualization.BELIV Workshop
 
Scanning Between Graph Visualizations: An Eye Tracking Evaluation.
Scanning Between Graph Visualizations: An Eye Tracking Evaluation.Scanning Between Graph Visualizations: An Eye Tracking Evaluation.
Scanning Between Graph Visualizations: An Eye Tracking Evaluation.BELIV Workshop
 
Focus Groups for Functional InfoVis Prototype Evaluation: A Case Study.
Focus Groups for Functional InfoVis Prototype Evaluation: A Case Study.Focus Groups for Functional InfoVis Prototype Evaluation: A Case Study.
Focus Groups for Functional InfoVis Prototype Evaluation: A Case Study.BELIV Workshop
 
Learning-Based Evaluation of Visual Analytic Systems.
Learning-Based Evaluation of Visual Analytic Systems.Learning-Based Evaluation of Visual Analytic Systems.
Learning-Based Evaluation of Visual Analytic Systems.BELIV Workshop
 
Visualization Evaluation of the Masses, by the Masses, and for the Masses.
Visualization Evaluation of the Masses, by the Masses, and for the Masses.Visualization Evaluation of the Masses, by the Masses, and for the Masses.
Visualization Evaluation of the Masses, by the Masses, and for the Masses.BELIV Workshop
 
Evaluating Information Visualization in Large Companies: Challenges, Experien...
Evaluating Information Visualization in Large Companies: Challenges, Experien...Evaluating Information Visualization in Large Companies: Challenges, Experien...
Evaluating Information Visualization in Large Companies: Challenges, Experien...BELIV Workshop
 
Pragmatic Challenges in the Evaluation of Interactive Visualization Systems.
Pragmatic Challenges in the Evaluation of Interactive Visualization Systems.Pragmatic Challenges in the Evaluation of Interactive Visualization Systems.
Pragmatic Challenges in the Evaluation of Interactive Visualization Systems.BELIV Workshop
 
Comparative Evaluation of Two Interface Tools in Performing Visual Analytics ...
Comparative Evaluation of Two Interface Tools in Performing Visual Analytics ...Comparative Evaluation of Two Interface Tools in Performing Visual Analytics ...
Comparative Evaluation of Two Interface Tools in Performing Visual Analytics ...BELIV Workshop
 
BELIV'10 Keynote: Conceptual and Practical Challenges in InfoViz Evaluations
BELIV'10 Keynote: Conceptual and Practical Challenges in InfoViz EvaluationsBELIV'10 Keynote: Conceptual and Practical Challenges in InfoViz Evaluations
BELIV'10 Keynote: Conceptual and Practical Challenges in InfoViz EvaluationsBELIV Workshop
 

Mehr von BELIV Workshop (17)

Look Before You Link: Eye Tracking in Multiple Coordinated View Visualization.
Look Before You Link: Eye Tracking in Multiple Coordinated View Visualization.Look Before You Link: Eye Tracking in Multiple Coordinated View Visualization.
Look Before You Link: Eye Tracking in Multiple Coordinated View Visualization.
 
Many Roads Lead to Rome. Mapping Users’ Problem Solving Strategies.
Many Roads Lead to Rome. Mapping Users’ Problem Solving Strategies.Many Roads Lead to Rome. Mapping Users’ Problem Solving Strategies.
Many Roads Lead to Rome. Mapping Users’ Problem Solving Strategies.
 
Proposed Working Memory Measures for Evaluating Information Visualization Tools.
Proposed Working Memory Measures for Evaluating Information Visualization Tools.Proposed Working Memory Measures for Evaluating Information Visualization Tools.
Proposed Working Memory Measures for Evaluating Information Visualization Tools.
 
How is a graphic like pumpkin pie? A framework for analysis and critique of v...
How is a graphic like pumpkin pie? A framework for analysis and critique of v...How is a graphic like pumpkin pie? A framework for analysis and critique of v...
How is a graphic like pumpkin pie? A framework for analysis and critique of v...
 
Implications of Individual Differences on Evaluating Information Visualizatio...
Implications of Individual Differences on Evaluating Information Visualizatio...Implications of Individual Differences on Evaluating Information Visualizatio...
Implications of Individual Differences on Evaluating Information Visualizatio...
 
Towards Information-Theoretic Visualization Evaluation Measure: A Practical e...
Towards Information-Theoretic Visualization Evaluation Measure: A Practical e...Towards Information-Theoretic Visualization Evaluation Measure: A Practical e...
Towards Information-Theoretic Visualization Evaluation Measure: A Practical e...
 
A Descriptive Model of Visual Scanning.
A Descriptive Model of Visual Scanning.A Descriptive Model of Visual Scanning.
A Descriptive Model of Visual Scanning.
 
Generating a synthetic video dataset
Generating a synthetic video datasetGenerating a synthetic video dataset
Generating a synthetic video dataset
 
Beyond system logging: human logging for evaluating information visualization.
Beyond system logging: human logging for evaluating information visualization.Beyond system logging: human logging for evaluating information visualization.
Beyond system logging: human logging for evaluating information visualization.
 
Scanning Between Graph Visualizations: An Eye Tracking Evaluation.
Scanning Between Graph Visualizations: An Eye Tracking Evaluation.Scanning Between Graph Visualizations: An Eye Tracking Evaluation.
Scanning Between Graph Visualizations: An Eye Tracking Evaluation.
 
Focus Groups for Functional InfoVis Prototype Evaluation: A Case Study.
Focus Groups for Functional InfoVis Prototype Evaluation: A Case Study.Focus Groups for Functional InfoVis Prototype Evaluation: A Case Study.
Focus Groups for Functional InfoVis Prototype Evaluation: A Case Study.
 
Learning-Based Evaluation of Visual Analytic Systems.
Learning-Based Evaluation of Visual Analytic Systems.Learning-Based Evaluation of Visual Analytic Systems.
Learning-Based Evaluation of Visual Analytic Systems.
 
Visualization Evaluation of the Masses, by the Masses, and for the Masses.
Visualization Evaluation of the Masses, by the Masses, and for the Masses.Visualization Evaluation of the Masses, by the Masses, and for the Masses.
Visualization Evaluation of the Masses, by the Masses, and for the Masses.
 
Evaluating Information Visualization in Large Companies: Challenges, Experien...
Evaluating Information Visualization in Large Companies: Challenges, Experien...Evaluating Information Visualization in Large Companies: Challenges, Experien...
Evaluating Information Visualization in Large Companies: Challenges, Experien...
 
Pragmatic Challenges in the Evaluation of Interactive Visualization Systems.
Pragmatic Challenges in the Evaluation of Interactive Visualization Systems.Pragmatic Challenges in the Evaluation of Interactive Visualization Systems.
Pragmatic Challenges in the Evaluation of Interactive Visualization Systems.
 
Comparative Evaluation of Two Interface Tools in Performing Visual Analytics ...
Comparative Evaluation of Two Interface Tools in Performing Visual Analytics ...Comparative Evaluation of Two Interface Tools in Performing Visual Analytics ...
Comparative Evaluation of Two Interface Tools in Performing Visual Analytics ...
 
BELIV'10 Keynote: Conceptual and Practical Challenges in InfoViz Evaluations
BELIV'10 Keynote: Conceptual and Practical Challenges in InfoViz EvaluationsBELIV'10 Keynote: Conceptual and Practical Challenges in InfoViz Evaluations
BELIV'10 Keynote: Conceptual and Practical Challenges in InfoViz Evaluations
 

Is Your User Hunting or Gathering Insights? Identifying Insight Drivers Across Domains.

  • 1. Is Your User Hunting or Gathering Insights? Identifying Insight Drivers Across Domains Michael Smuc, Eva Mayr, Hanna Risku
  • 2.
  • 3.
  • 4.
  • 5. Specific knowledge of domain experts
  • 6. Common ground of domain experts in our case „temporal data explorers“
  • 7.  
  • 8.
  • 9. => Across domain testing works! Effect of domain expertise on insights t = -0.29, df = 24, p > .05
  • 10.
  • 12.
  • 13.
  • 14.
  • 15. Questions ? what is expertise? across domain testing shallow insights Relational Insight Organizer RIO what is a domain? insight hunting insight gathering experimental setting story about the data sampling what makes an expert? prior knowledge compensation by experts common ground applicability future research generalizability
  • 17. t = 0.16, df = 14, p > .05 t = -3.80, df = 7, p < .01 t = -4.87, df = 14, p < .001
  • 18. Definition of insights “… the understanding gained by an individual using a visualization tool (or parts thereof) for the purpose of data analysis, which is a gradual process toward s discovering new knowledge “