SlideShare a Scribd company logo
1 of 17
1
Werner Bailer, Cathal Gurrin, Jakub Lokoč, Klaus Schoeffmann
 Video search competition (annually at MMM)
 Demonstrates and evaluates state-of-the-art
interactive video retrieval tools
 Participating teams solve retrieval tasks
 Systems are connected to the VBS Server
 Presents tasks in live manner
 Evaluates submitted results of teams (penalty for false submissions)
 HTW: Kai Uwe Barthel, Nico Hezel and Klaus Jung. “Fusing
keyword search and visual exploration for untagged videos“
 ITEC1: Manfred Jürgen Primus, Bernd Münzer, Andreas
Leibetseder and Klaus Schoeffmann. “The ITEC Collaborative
Video Search System at the VBS 2018“
 ITEC2: Andreas Leibetseder, Sabrina Kletz and Klaus
Schoeffmann. “Sketch-based Similarity Search for Collaborative
Feature Maps“
 NECTEC: Sitapa Rujikietgumjorn, Nattachai Watcharapinchai
and Sanparith Marukatat. “Sloth Search System“
 SIRET: Jakub Lokoc, Gregor Kovalcik andTomas Soucek.
“Revisiting SIRETVideo RetrievalTool“
3Video browser showdown 2018, Bangkok
 VERGE: Anastasia Moumtzidou, Stelios Andreadis, Foteini
Markatopoulou, Damianos Galanopoulos, Ilias Gialampoukidis,
StefanosVrochidis,Vasileios Mezaris, Ioannis Kompatsiaris and
Ioannis Patras. “VERGE inVBS 2018“
 VIREO: Phuong Anh Nguyen,Yi-Jie Lu, Hao Zhang, Chong-Wah
Ngo. “Enhanced VIREO KIS atVBS 2018“
 VITRIVR: Luca Rossetto, Ivan Giangreco, Ralph Gasser, Heiko
Schuldt. “Competitive Video Retrieval with vitrivr“
 VNU:Thanh-DatTruong,Vinh-Tiep Nguyen, Minh-Triet Tran,Van-
Tien Do,Trang-VinhTrieu,Thanh Duc Ngo and Duy-Dinh Le.
“Video Search Based On Semantic Extraction And Locally
Regional Object Proposal“
4Video browser showdown 2018, Bangkok
 IACC.3 -TRECVID (2016-2017)
 144 GB
 4593 video files
 Low visual quality
 600 hours of content
 Each ~6-10 minutes
 > 300.000 shots
Single target (20 secs)
“Steve’s cutting a drawing into his block of wood.You can see
his hands, a cutter, and flower symbols.”
Single target (20 secs)
“A person playing guitar outdoors”
8Video browser showdown 2018, Bangkok
Multiple targets (shots)
 Expert Run
 5 textual KIS tasks
 5 visual KIS tasks
 5 AVS tasks
 Novice Run
 5 visual KIS tasks
 5 AVS tasks
9Video browser showdown 2018, Bangkok
Winner gets 100 points
Winner gets 100 points
Winner gets 100 points
Winner gets 100 points
Winner gets 100 points
 Overall score = AVERAGE
10Video browser showdown 2018, Bangkok
Textual KIS
11Video browser showdown 2018, Bangkok
AVS
12Video browser showdown 2018, Bangkok
 VISUAL KIS
 Video scene in the loop –VBS participant knows the known-item
 Problem – photographic memory not realistic
-> THE SCENE GETS BLURRED
 TEXTUAL KIS
 Difficult task - only 3 solved in 2017
-> more text appears in time
 AVSTASKS
 The same settings
13Video browser showdown 2018, Bangkok
previous new
14Video browser showdown 2018, Bangkok
Time
penalty
Wrong
submission
penalty
𝑇𝑃
max(1, |𝑊𝑆| − 1) 𝑇𝑃 − 𝑊𝑆 ∗ 𝑐
Time limit for visual tasks 5 minutes and textual KIS 7 minutes
No wrong submission for free
 Precision/recall based measure, time limit 5 minutes
 Normalization
 Novice RUNS
 Each team can select and train a bit some novice user
 Novice runs only for visual KIS andAVS (existingTRECVid ones)
15Video browser showdown 2018, Bangkok
 Let‘s thank the local organizers of MMM for making this
session happen!
17Video browser showdown 2018, Bangkok

More Related Content

Recently uploaded

The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
heathfieldcps1
 
Spellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseSpellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please Practise
AnaAcapella
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
QucHHunhnh
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
ciinovamais
 

Recently uploaded (20)

The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
 
Spellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseSpellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please Practise
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy Consulting
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan Fellows
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
Sociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning ExhibitSociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning Exhibit
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
Python Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxPython Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docx
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17  How to Extend Models Using Mixin ClassesMixin Classes in Odoo 17  How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.
 
Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
PROCESS RECORDING FORMAT.docx
PROCESS      RECORDING        FORMAT.docxPROCESS      RECORDING        FORMAT.docx
PROCESS RECORDING FORMAT.docx
 

Featured

How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
ThinkNow
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
Kurio // The Social Media Age(ncy)
 

Featured (20)

2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot
 
Everything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTEverything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPT
 
Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsProduct Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage Engineerings
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
 
Skeleton Culture Code
Skeleton Culture CodeSkeleton Culture Code
Skeleton Culture Code
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 

Video Browser Showdown 2018

  • 1. 1 Werner Bailer, Cathal Gurrin, Jakub Lokoč, Klaus Schoeffmann
  • 2.  Video search competition (annually at MMM)  Demonstrates and evaluates state-of-the-art interactive video retrieval tools  Participating teams solve retrieval tasks  Systems are connected to the VBS Server  Presents tasks in live manner  Evaluates submitted results of teams (penalty for false submissions)
  • 3.  HTW: Kai Uwe Barthel, Nico Hezel and Klaus Jung. “Fusing keyword search and visual exploration for untagged videos“  ITEC1: Manfred Jürgen Primus, Bernd Münzer, Andreas Leibetseder and Klaus Schoeffmann. “The ITEC Collaborative Video Search System at the VBS 2018“  ITEC2: Andreas Leibetseder, Sabrina Kletz and Klaus Schoeffmann. “Sketch-based Similarity Search for Collaborative Feature Maps“  NECTEC: Sitapa Rujikietgumjorn, Nattachai Watcharapinchai and Sanparith Marukatat. “Sloth Search System“  SIRET: Jakub Lokoc, Gregor Kovalcik andTomas Soucek. “Revisiting SIRETVideo RetrievalTool“ 3Video browser showdown 2018, Bangkok
  • 4.  VERGE: Anastasia Moumtzidou, Stelios Andreadis, Foteini Markatopoulou, Damianos Galanopoulos, Ilias Gialampoukidis, StefanosVrochidis,Vasileios Mezaris, Ioannis Kompatsiaris and Ioannis Patras. “VERGE inVBS 2018“  VIREO: Phuong Anh Nguyen,Yi-Jie Lu, Hao Zhang, Chong-Wah Ngo. “Enhanced VIREO KIS atVBS 2018“  VITRIVR: Luca Rossetto, Ivan Giangreco, Ralph Gasser, Heiko Schuldt. “Competitive Video Retrieval with vitrivr“  VNU:Thanh-DatTruong,Vinh-Tiep Nguyen, Minh-Triet Tran,Van- Tien Do,Trang-VinhTrieu,Thanh Duc Ngo and Duy-Dinh Le. “Video Search Based On Semantic Extraction And Locally Regional Object Proposal“ 4Video browser showdown 2018, Bangkok
  • 5.  IACC.3 -TRECVID (2016-2017)  144 GB  4593 video files  Low visual quality  600 hours of content  Each ~6-10 minutes  > 300.000 shots
  • 7. “Steve’s cutting a drawing into his block of wood.You can see his hands, a cutter, and flower symbols.” Single target (20 secs)
  • 8. “A person playing guitar outdoors” 8Video browser showdown 2018, Bangkok Multiple targets (shots)
  • 9.  Expert Run  5 textual KIS tasks  5 visual KIS tasks  5 AVS tasks  Novice Run  5 visual KIS tasks  5 AVS tasks 9Video browser showdown 2018, Bangkok Winner gets 100 points Winner gets 100 points Winner gets 100 points Winner gets 100 points Winner gets 100 points  Overall score = AVERAGE
  • 10. 10Video browser showdown 2018, Bangkok Textual KIS
  • 11. 11Video browser showdown 2018, Bangkok AVS
  • 12. 12Video browser showdown 2018, Bangkok
  • 13.  VISUAL KIS  Video scene in the loop –VBS participant knows the known-item  Problem – photographic memory not realistic -> THE SCENE GETS BLURRED  TEXTUAL KIS  Difficult task - only 3 solved in 2017 -> more text appears in time  AVSTASKS  The same settings 13Video browser showdown 2018, Bangkok
  • 14. previous new 14Video browser showdown 2018, Bangkok Time penalty Wrong submission penalty 𝑇𝑃 max(1, |𝑊𝑆| − 1) 𝑇𝑃 − 𝑊𝑆 ∗ 𝑐 Time limit for visual tasks 5 minutes and textual KIS 7 minutes No wrong submission for free
  • 15.  Precision/recall based measure, time limit 5 minutes  Normalization  Novice RUNS  Each team can select and train a bit some novice user  Novice runs only for visual KIS andAVS (existingTRECVid ones) 15Video browser showdown 2018, Bangkok
  • 16.
  • 17.  Let‘s thank the local organizers of MMM for making this session happen! 17Video browser showdown 2018, Bangkok