SlideShare ist ein Scribd-Unternehmen logo
1 von 37
Downloaden Sie, um offline zu lesen
User intentions in
multimedia or “The other
end of the camera …”

Mathias Lux
Klagenfurt University
mlux@itec.uni-klu.ac.at
Research Areas &
Connections        http://www.uni-klu.ac.at




                                         2
More & More Questions …
                                             http://www.uni-klu.ac.at




All my previous work led into one single direction:
● What does the user actually want and how to
  support the user in her/his work with the
  computer?




                                                                   3
User centered computing
                          http://www.uni-klu.ac.at




                                                4
Context-Awareness
                                                                            http://www.uni-klu.ac.at




[…] context-aware software adapts according to
  the location of use, the collection of nearby
  people, hosts, and accessible devices, as well
  as to changes to such things over time […]


Src. B. Schilit, N. Adams, and R. Want. (1994). "Context-aware computing applications"
    (PDF). IEEE Workshop on Mobile Computing Systems and Applications
    (WMCSA'94), Santa Cruz, CA, US. pp. 89-101.




                                                                                                  5
Context …
                                     http://www.uni-klu.ac.at




● Is a broad concept
● Can be defined in different ways
  o depending on domain
  o depending on application



Idea: pick out most promising piece of the
  „context“ and take a look at it!


                                                           6
User Intentions
                                            http://www.uni-klu.ac.at




● Users have certain intentions
  o … doing something intentional …



Hypothesis: If I know the intention of a user
  beforehand, I can better support her/his actions.




                                                                  7
User Intentions: Example
                                                    http://www.uni-klu.ac.at




A user wants to buy a car, but there is no pressing
  need.
● The users intention is “buy a car”
● The actions resulting from the intention might not
  be directed and planned
  o “Oh, there is a car I like …”
  o “I’ve heard you’re going to sell your Prius…”




                                                                          8
User Intentions
                                                    http://www.uni-klu.ac.at




● Intentions are fuzzy and vague
  o Hard to measure …


● Concept of “user goals”
  o .. state of affair that a user wants to achieve …
  o Can be measured: (not or partially) achieved




                                                                          9
User Goals: Example
                                                    http://www.uni-klu.ac.at




A user wants to buy a car, but there is no pressing
  need.
● The users intention is “buy a car”
● Possible goal “find car that fits the users needs”
   o Task: Searching for a car with specific characteristics
   o End of the task: Car found


=> Goals are very specific


                                                                       10
Agenda
                                             http://www.uni-klu.ac.at




●   Motivation & Introduction
●   User goals in text retrieval
●   User goals in digital photo retrieval
●   User goals & intentions in media production
●   Outlook




                                                                11
A Taxonomy of Web Search
                                                              http://www.uni-klu.ac.at




● Navigational
    o The immediate intent is to reach a particular site
● Informational
    o The intent is to acquire some information assumed to
      be present on one or more web pages
● Transactional
    o The intent is to perform some web-mediated activity

Src. A. Broder, A Taxonomy of Web Search, ACM SIGIR Forum Vol 36, Issue
   2, Fall 2002


                                                                                 12
Revised Taxonomy
                                                                   http://www.uni-klu.ac.at




● Navigational
● Informational
    o Directed, Undirected, Advice, Locate, List
● Resource
    o Download, Entertain, Interact, Obtain




Src. Rose, D., Levinson, D., Understanding user goals in web search, Proc.
   WWW 2004, New York, USA (2004).


                                                                                      13
User Goals in Web Search
                                                                   http://www.uni-klu.ac.at




Src. Rose, D., Levinson, D., Understanding user goals in web search, Proc.
   WWW 2004, New York, USA (2004).


                                                                                      14
How do users express
goals?                 http://www.uni-klu.ac.at




                                          15
Degrees of Explicitness in
Intentional Artifacts                                                                                    http://www.uni-klu.ac.at




● How can we find explicit goals of users?
● How can search queries be classified as explicit
  intentional queries?
● Explicit goals vs. implicit goals

Example: car, car Miami, car Miami dealer, buy a car in
  Miami, buy a used car in Miami, get loan to buy a used
  car in Miami

Src. Strohmaier, Prettenhofer & Lux, Different Degrees of Explicitness in Intentional Artifacts: Studying User Goals in a
     Large Search Query Log, SKGOI'08 @ IUI'08, Canary Islands, Spain, 2008




                                                                                                                            16
Degrees of Explicitness in
Intentional Artifacts                   http://www.uni-klu.ac.at




● Experimental classification
  o Part of speech tagging on queries
  o Naïve Bayes classifier on
     • 98 instances
       (59 pos. & 39 neg.)




                                                           17
Classifier results …
                       http://www.uni-klu.ac.at




                                          18
Website Shares in
Condensed Data Set   http://www.uni-klu.ac.at




                                        19
ehow.com
                                                        http://www.uni-klu.ac.at




Powered by demand media:
● Mining questions from queries
● Pay people for answers
   o 20$ per video,
   o 2 ½ $ copy-edit,
   o 1$ fact-check …

see also http://www.wired.com/magazine/2009/10/ff_demandmedia/




                                                                           20
Agenda
                                             http://www.uni-klu.ac.at




●   Motivation & Introduction
●   User goals in text retrieval
●   User goals in digital photo retrieval
●   User goals & intentions in media production
●   Outlook




                                                                21
How do users express their
goals on … say Flickr ;)                       http://www.uni-klu.ac.at




● Queries for photo search are short
  o “dog dachshund bark” rather than
  o “image showing a small dog, preferably a dachshund,
    barking for use in a brochure”
● Hypothesis: User goals affect the search and
  browsing behavior of users
  o Click-through rate, session time,
    medium click interval, etc.




                                                                  22
Methodology
                                                        http://www.uni-klu.ac.at




Exploratory study on user goal classification
● Definition of tasks reflecting different types of
  goals
   o Interviews with experts using image search
   o Note: Verification of relevance of tasks needed
● Presentation of goals to users in a study
   o Recording of search behavior
   o Analysis of possible features for classification



                                                                           23
Study setup
                                                    http://www.uni-klu.ac.at




● Taxonomy of Broder / Rose & Levinson
● 10 tasks from different classes
  o   Find picture expressing joy
  o   Find picture of the Eiffel Tower
  o   Find picture taken with a Canon IXUS 980 IS
  o   Find out how to tie a tie
  o   …




                                                                       24
Findings
                                                 http://www.uni-klu.ac.at




● Revised taxonomy needed
● Classification difficult …
  o where do session start and end?
  o fuzzy transition between goals?
  o Dependencies between goals, subgoals etc.?
● Classification prototype
  o Rule based
  o Adapting results view



                                                                    25
Taxonomy development
                                         http://www.uni-klu.ac.at




● Several additional studies
   o Expert & non expert users
● Revised taxonomy
● Feature selection for classification




                                                            26
Agenda
                                             http://www.uni-klu.ac.at




●   Motivation & Introduction
●   User goals in text retrieval
●   User goals in digital photo retrieval
●   User goals & intentions in media production
●   Outlook




                                                                27
Intentions in Media
Production                                         http://www.uni-klu.ac.at




● Annotation tool for digital photos
   o done by two amateur photographers
● Two different roles
   o Creator
   o Consumer
● Study:
   1. How do users get along with the UI
   2. How do users get along with intentions for
      annotation


                                                                      28
iPan: Intention-based
Photo Annotation        http://www.uni-klu.ac.at




                                           29
iPan preliminary Results
                                                   http://www.uni-klu.ac.at




● Tool tested in photographers user group
  o 2 extreme types: intentional photos and non-
    intentional photos
  o Maybe artists, who want to hide intentions?
● Interviews have been rather discouraging
  o Mainly no intention to use such a tool
  o No understanding for “intentional photography”
  o One possible user => more like storytelling



                                                                      30
Ongoing work …
                                          http://www.uni-klu.ac.at




● Annotation tool based on intentions
● Taxonomy of goals in media production
● Investigation for other media




                                                             31
Agenda
                                             http://www.uni-klu.ac.at




●   Motivation & Introduction
●   User goals in text retrieval
●   User goals in digital photo retrieval
●   User goals & intentions in media production
●   Outlook




                                                                32
Users in a “near time” MMIS
                                                             http://www.uni-klu.ac.at




● Assume there is a big “Ironman” event
  o sequence of
     • 3.86 km of swimming,
     • 180.2 km of biking and
     • 42.195 km of running
  o like Klagenfurt in 2007:
     •   2,400 participants with support team (3-4 people)
     •   2,000 volunteers
     •   100,000 visitors
     •   6 moderators & DJs / 3 video walls
     •   event lasted end to end about 17 hours

                                                                                33
Users in a “near time” MMIS
                                                   http://www.uni-klu.ac.at




● Users have different roles
  o Participants, support, guards, journalists …
● Users have different intentions
  o I want to track athlete XY
  o I want to track the lead
  o I want to follow events
● User participate in a
  “social MMIS”


                                                                      34
Intentions in a “near time” MMIS
                                                   http://www.uni-klu.ac.at




● User intentions can be made explicit
  o Classification, user feedback, context, etc.
● Intentions & goals can be leveraged to enhance
  retrieval and visualization of content
  o Relevance function (cp. popularity, 80:20)
  o Abstraction & summarization
  o Pro-active distribution




                                                                      35
Summary & Conclusion
                                          http://www.uni-klu.ac.at




User intentions
● … have not yet been explored in MIR & MMIS
● … may help bridging the semantic gap (from the
  other side)
● … may help dealing with the “long tail”




                                                             36
Thanks …
                               http://www.uni-klu.ac.at




… for your time

and: I’d be happy to discuss
  the whole thing

Mathias Lux
mlux@itec.uni-klu.ac.at

                                                  37

Weitere ähnliche Inhalte

Ähnlich wie User Intentions or "The other end of the camera ..."

CBMI 2013 Presentation: User Intentions in Multimedia
CBMI 2013 Presentation: User Intentions in MultimediaCBMI 2013 Presentation: User Intentions in Multimedia
CBMI 2013 Presentation: User Intentions in Multimedia
dermotte
 
Methods for Identifying and Modeling Users Needs
Methods for Identifying and Modeling Users NeedsMethods for Identifying and Modeling Users Needs
Methods for Identifying and Modeling Users Needs
Luis Carlos Aceves
 

Ähnlich wie User Intentions or "The other end of the camera ..." (20)

CBMI 2013 Presentation: User Intentions in Multimedia
CBMI 2013 Presentation: User Intentions in MultimediaCBMI 2013 Presentation: User Intentions in Multimedia
CBMI 2013 Presentation: User Intentions in Multimedia
 
Introduction to User Experience Design 02/17/18
Introduction to User Experience Design 02/17/18Introduction to User Experience Design 02/17/18
Introduction to User Experience Design 02/17/18
 
Introduction to User Experience Design 12/07/19
Introduction to User Experience Design 12/07/19Introduction to User Experience Design 12/07/19
Introduction to User Experience Design 12/07/19
 
Basics of Interaction Design & Strategy - 4/9/16
Basics of Interaction Design & Strategy - 4/9/16Basics of Interaction Design & Strategy - 4/9/16
Basics of Interaction Design & Strategy - 4/9/16
 
A Place at the Table
A Place at the TableA Place at the Table
A Place at the Table
 
Introduction to User Experience Design 2/16/19
Introduction to User Experience Design 2/16/19Introduction to User Experience Design 2/16/19
Introduction to User Experience Design 2/16/19
 
Introduction to User Experience Design 10/07/17
Introduction to User Experience Design 10/07/17Introduction to User Experience Design 10/07/17
Introduction to User Experience Design 10/07/17
 
Introduction to mobile usability
Introduction to mobile usabilityIntroduction to mobile usability
Introduction to mobile usability
 
Methods for Identifying and Modeling Users Needs
Methods for Identifying and Modeling Users NeedsMethods for Identifying and Modeling Users Needs
Methods for Identifying and Modeling Users Needs
 
Introduction to User Experience Design 06/22/19
Introduction to User Experience Design 06/22/19Introduction to User Experience Design 06/22/19
Introduction to User Experience Design 06/22/19
 
Invited Talk OAGM Workshop Salzburg, May 2015
Invited Talk OAGM Workshop Salzburg, May 2015Invited Talk OAGM Workshop Salzburg, May 2015
Invited Talk OAGM Workshop Salzburg, May 2015
 
Introduction to User Experience Design 12/08/18
Introduction to User Experience Design 12/08/18Introduction to User Experience Design 12/08/18
Introduction to User Experience Design 12/08/18
 
Introduction to User Experience Design 10/05/19
Introduction to User Experience Design 10/05/19Introduction to User Experience Design 10/05/19
Introduction to User Experience Design 10/05/19
 
See to believe: capturing insights using contextual inquiry
See to believe: capturing insights using contextual inquirySee to believe: capturing insights using contextual inquiry
See to believe: capturing insights using contextual inquiry
 
Building a Solid Foundation: Usability & Information Architecture WIAD Tampa ...
Building a Solid Foundation: Usability & Information Architecture WIAD Tampa ...Building a Solid Foundation: Usability & Information Architecture WIAD Tampa ...
Building a Solid Foundation: Usability & Information Architecture WIAD Tampa ...
 
UXPA 2023: UX Fracking: Using Mixed Methods to Extract Hidden Insights
UXPA 2023: UX Fracking: Using Mixed Methods to Extract Hidden InsightsUXPA 2023: UX Fracking: Using Mixed Methods to Extract Hidden Insights
UXPA 2023: UX Fracking: Using Mixed Methods to Extract Hidden Insights
 
Requirements Engineering for the Humanities
Requirements Engineering for the HumanitiesRequirements Engineering for the Humanities
Requirements Engineering for the Humanities
 
Introduction to User Experience Design 2/15/20
Introduction to User Experience Design 2/15/20Introduction to User Experience Design 2/15/20
Introduction to User Experience Design 2/15/20
 
Prototyping Workshop - Wireframes, Mockups, Prototypes
Prototyping Workshop - Wireframes, Mockups, PrototypesPrototyping Workshop - Wireframes, Mockups, Prototypes
Prototyping Workshop - Wireframes, Mockups, Prototypes
 
User Experience for Software Engineers
User Experience for Software EngineersUser Experience for Software Engineers
User Experience for Software Engineers
 

Mehr von dermotte (9)

LIRE presentation at the ACM Multimedia Open Source Software Competition 2013
LIRE presentation at the ACM Multimedia Open Source Software Competition 2013LIRE presentation at the ACM Multimedia Open Source Software Competition 2013
LIRE presentation at the ACM Multimedia Open Source Software Competition 2013
 
Why did you record this video?
Why did you record this video?Why did you record this video?
Why did you record this video?
 
Content based image retrieval with LIRe
Content based image retrieval with LIReContent based image retrieval with LIRe
Content based image retrieval with LIRe
 
Ohne LIRe keine Bildsuche
Ohne LIRe keine BildsucheOhne LIRe keine Bildsuche
Ohne LIRe keine Bildsuche
 
Callisto: Content Based Tag Recommendation for Images
Callisto: Content Based Tag Recommendation for ImagesCallisto: Content Based Tag Recommendation for Images
Callisto: Content Based Tag Recommendation for Images
 
Visual Information Retrieval
Visual Information RetrievalVisual Information Retrieval
Visual Information Retrieval
 
Using Visual Features to Improve Tag Suggestions in Image Sharing Sites :: pr...
Using Visual Features to Improve Tag Suggestions in Image Sharing Sites :: pr...Using Visual Features to Improve Tag Suggestions in Image Sharing Sites :: pr...
Using Visual Features to Improve Tag Suggestions in Image Sharing Sites :: pr...
 
Power Laws Popularity And Interestingness
Power Laws Popularity And InterestingnessPower Laws Popularity And Interestingness
Power Laws Popularity And Interestingness
 
Aspects of broad folksonomies
Aspects of broad folksonomiesAspects of broad folksonomies
Aspects of broad folksonomies
 

Kürzlich hochgeladen

1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
QucHHunhnh
 

Kürzlich hochgeladen (20)

FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
SOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning PresentationSOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning Presentation
 
Spatium Project Simulation student brief
Spatium Project Simulation student briefSpatium Project Simulation student brief
Spatium Project Simulation student brief
 
Towards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxTowards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptx
 
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptxSKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
 
Fostering Friendships - Enhancing Social Bonds in the Classroom
Fostering Friendships - Enhancing Social Bonds  in the ClassroomFostering Friendships - Enhancing Social Bonds  in the Classroom
Fostering Friendships - Enhancing Social Bonds in the Classroom
 
Graduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - EnglishGraduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - English
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptx
 
Micro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdfMicro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdf
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
Single or Multiple melodic lines structure
Single or Multiple melodic lines structureSingle or Multiple melodic lines structure
Single or Multiple melodic lines structure
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
Unit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptxUnit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptx
 

User Intentions or "The other end of the camera ..."

  • 1. User intentions in multimedia or “The other end of the camera …” Mathias Lux Klagenfurt University mlux@itec.uni-klu.ac.at
  • 2. Research Areas & Connections http://www.uni-klu.ac.at 2
  • 3. More & More Questions … http://www.uni-klu.ac.at All my previous work led into one single direction: ● What does the user actually want and how to support the user in her/his work with the computer? 3
  • 4. User centered computing http://www.uni-klu.ac.at 4
  • 5. Context-Awareness http://www.uni-klu.ac.at […] context-aware software adapts according to the location of use, the collection of nearby people, hosts, and accessible devices, as well as to changes to such things over time […] Src. B. Schilit, N. Adams, and R. Want. (1994). "Context-aware computing applications" (PDF). IEEE Workshop on Mobile Computing Systems and Applications (WMCSA'94), Santa Cruz, CA, US. pp. 89-101. 5
  • 6. Context … http://www.uni-klu.ac.at ● Is a broad concept ● Can be defined in different ways o depending on domain o depending on application Idea: pick out most promising piece of the „context“ and take a look at it! 6
  • 7. User Intentions http://www.uni-klu.ac.at ● Users have certain intentions o … doing something intentional … Hypothesis: If I know the intention of a user beforehand, I can better support her/his actions. 7
  • 8. User Intentions: Example http://www.uni-klu.ac.at A user wants to buy a car, but there is no pressing need. ● The users intention is “buy a car” ● The actions resulting from the intention might not be directed and planned o “Oh, there is a car I like …” o “I’ve heard you’re going to sell your Prius…” 8
  • 9. User Intentions http://www.uni-klu.ac.at ● Intentions are fuzzy and vague o Hard to measure … ● Concept of “user goals” o .. state of affair that a user wants to achieve … o Can be measured: (not or partially) achieved 9
  • 10. User Goals: Example http://www.uni-klu.ac.at A user wants to buy a car, but there is no pressing need. ● The users intention is “buy a car” ● Possible goal “find car that fits the users needs” o Task: Searching for a car with specific characteristics o End of the task: Car found => Goals are very specific 10
  • 11. Agenda http://www.uni-klu.ac.at ● Motivation & Introduction ● User goals in text retrieval ● User goals in digital photo retrieval ● User goals & intentions in media production ● Outlook 11
  • 12. A Taxonomy of Web Search http://www.uni-klu.ac.at ● Navigational o The immediate intent is to reach a particular site ● Informational o The intent is to acquire some information assumed to be present on one or more web pages ● Transactional o The intent is to perform some web-mediated activity Src. A. Broder, A Taxonomy of Web Search, ACM SIGIR Forum Vol 36, Issue 2, Fall 2002 12
  • 13. Revised Taxonomy http://www.uni-klu.ac.at ● Navigational ● Informational o Directed, Undirected, Advice, Locate, List ● Resource o Download, Entertain, Interact, Obtain Src. Rose, D., Levinson, D., Understanding user goals in web search, Proc. WWW 2004, New York, USA (2004). 13
  • 14. User Goals in Web Search http://www.uni-klu.ac.at Src. Rose, D., Levinson, D., Understanding user goals in web search, Proc. WWW 2004, New York, USA (2004). 14
  • 15. How do users express goals? http://www.uni-klu.ac.at 15
  • 16. Degrees of Explicitness in Intentional Artifacts http://www.uni-klu.ac.at ● How can we find explicit goals of users? ● How can search queries be classified as explicit intentional queries? ● Explicit goals vs. implicit goals Example: car, car Miami, car Miami dealer, buy a car in Miami, buy a used car in Miami, get loan to buy a used car in Miami Src. Strohmaier, Prettenhofer & Lux, Different Degrees of Explicitness in Intentional Artifacts: Studying User Goals in a Large Search Query Log, SKGOI'08 @ IUI'08, Canary Islands, Spain, 2008 16
  • 17. Degrees of Explicitness in Intentional Artifacts http://www.uni-klu.ac.at ● Experimental classification o Part of speech tagging on queries o Naïve Bayes classifier on • 98 instances (59 pos. & 39 neg.) 17
  • 18. Classifier results … http://www.uni-klu.ac.at 18
  • 19. Website Shares in Condensed Data Set http://www.uni-klu.ac.at 19
  • 20. ehow.com http://www.uni-klu.ac.at Powered by demand media: ● Mining questions from queries ● Pay people for answers o 20$ per video, o 2 ½ $ copy-edit, o 1$ fact-check … see also http://www.wired.com/magazine/2009/10/ff_demandmedia/ 20
  • 21. Agenda http://www.uni-klu.ac.at ● Motivation & Introduction ● User goals in text retrieval ● User goals in digital photo retrieval ● User goals & intentions in media production ● Outlook 21
  • 22. How do users express their goals on … say Flickr ;) http://www.uni-klu.ac.at ● Queries for photo search are short o “dog dachshund bark” rather than o “image showing a small dog, preferably a dachshund, barking for use in a brochure” ● Hypothesis: User goals affect the search and browsing behavior of users o Click-through rate, session time, medium click interval, etc. 22
  • 23. Methodology http://www.uni-klu.ac.at Exploratory study on user goal classification ● Definition of tasks reflecting different types of goals o Interviews with experts using image search o Note: Verification of relevance of tasks needed ● Presentation of goals to users in a study o Recording of search behavior o Analysis of possible features for classification 23
  • 24. Study setup http://www.uni-klu.ac.at ● Taxonomy of Broder / Rose & Levinson ● 10 tasks from different classes o Find picture expressing joy o Find picture of the Eiffel Tower o Find picture taken with a Canon IXUS 980 IS o Find out how to tie a tie o … 24
  • 25. Findings http://www.uni-klu.ac.at ● Revised taxonomy needed ● Classification difficult … o where do session start and end? o fuzzy transition between goals? o Dependencies between goals, subgoals etc.? ● Classification prototype o Rule based o Adapting results view 25
  • 26. Taxonomy development http://www.uni-klu.ac.at ● Several additional studies o Expert & non expert users ● Revised taxonomy ● Feature selection for classification 26
  • 27. Agenda http://www.uni-klu.ac.at ● Motivation & Introduction ● User goals in text retrieval ● User goals in digital photo retrieval ● User goals & intentions in media production ● Outlook 27
  • 28. Intentions in Media Production http://www.uni-klu.ac.at ● Annotation tool for digital photos o done by two amateur photographers ● Two different roles o Creator o Consumer ● Study: 1. How do users get along with the UI 2. How do users get along with intentions for annotation 28
  • 29. iPan: Intention-based Photo Annotation http://www.uni-klu.ac.at 29
  • 30. iPan preliminary Results http://www.uni-klu.ac.at ● Tool tested in photographers user group o 2 extreme types: intentional photos and non- intentional photos o Maybe artists, who want to hide intentions? ● Interviews have been rather discouraging o Mainly no intention to use such a tool o No understanding for “intentional photography” o One possible user => more like storytelling 30
  • 31. Ongoing work … http://www.uni-klu.ac.at ● Annotation tool based on intentions ● Taxonomy of goals in media production ● Investigation for other media 31
  • 32. Agenda http://www.uni-klu.ac.at ● Motivation & Introduction ● User goals in text retrieval ● User goals in digital photo retrieval ● User goals & intentions in media production ● Outlook 32
  • 33. Users in a “near time” MMIS http://www.uni-klu.ac.at ● Assume there is a big “Ironman” event o sequence of • 3.86 km of swimming, • 180.2 km of biking and • 42.195 km of running o like Klagenfurt in 2007: • 2,400 participants with support team (3-4 people) • 2,000 volunteers • 100,000 visitors • 6 moderators & DJs / 3 video walls • event lasted end to end about 17 hours 33
  • 34. Users in a “near time” MMIS http://www.uni-klu.ac.at ● Users have different roles o Participants, support, guards, journalists … ● Users have different intentions o I want to track athlete XY o I want to track the lead o I want to follow events ● User participate in a “social MMIS” 34
  • 35. Intentions in a “near time” MMIS http://www.uni-klu.ac.at ● User intentions can be made explicit o Classification, user feedback, context, etc. ● Intentions & goals can be leveraged to enhance retrieval and visualization of content o Relevance function (cp. popularity, 80:20) o Abstraction & summarization o Pro-active distribution 35
  • 36. Summary & Conclusion http://www.uni-klu.ac.at User intentions ● … have not yet been explored in MIR & MMIS ● … may help bridging the semantic gap (from the other side) ● … may help dealing with the “long tail” 36
  • 37. Thanks … http://www.uni-klu.ac.at … for your time and: I’d be happy to discuss the whole thing Mathias Lux mlux@itec.uni-klu.ac.at 37