SlideShare ist ein Scribd-Unternehmen logo

Multimedia Information Retrieval: What is it, and why isn't ...

•Als PPT, PDF herunterladen•
•
W
webhostingguy
1 von 74
Video Search: Opportunities and Challenges Keynote Speech at ACM MIR Workshop ACM Multimedia Conference 2005 Singapore Dr. Ramesh R. Sarukkai Yahoo! Search { [email_address] [email_address] }
About the Presenter ,[object Object],[object Object]
Outline ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Introduction ,[object Object],[object Object],[object Object],[object Object],[object Object]
Outline ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Market Trends ,[object Object],[object Object],[object Object]
Market Trends ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Market Trends ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Market Trends ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Market Trends ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Market Trends ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Market Trends ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Market Trends ,[object Object]
Outline ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Video Search ,[object Object],[object Object],[object Object],[object Object]
Video Search Meta-Content Video Production Unstructured Data Video Consumption /Community Content Features + Meta-Content Structured + Unstructured Data
Video Search ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Video Search ,[object Object],[object Object],[object Object]
Video Search ,[object Object],[object Object],[object Object],[object Object]
Video Search ,[object Object],[object Object],[object Object],[object Object],[object Object]
Video Search: Features 1970 2000 1990 1980 2010 Texture: Autocorrelation; Wavelet transforms; Gabor Filters Shape: Edge Detectors; Moment invariants; Animate Vision Marr; Finite Element Methods; Shape from Motion; Color: Color Moments Color Histograms Color Autocorrelograms Segmentation: Scene segmentation; Scene Segmentation; Shot detection; OCR: Modeling; Successful OCR deployments; Face: Face Detection algorithms; Neural Networks; EigenFaces ASR: Acoustic analysis; HMMS; N-grams; CSR; LVCSR; Domain Specific; NIST Video TREC Starts Media IR systems Web Media Search
Video Search: Features ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Video Search: Features ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Video Search: Video TREC ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Video Search: Video TREC ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Video Search: Browsing ,[object Object],[object Object],[object Object],[object Object],[object Object]
Video Search: ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Video Search ,[object Object]
Video Search ,[object Object],[object Object],[object Object],[object Object],[object Object]
Video Search ,[object Object],[object Object]
Outline ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Opportunities ,[object Object],[object Object],[object Object],[object Object]
Opportunities ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Opportunities ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Opportunities ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Video Search Meta-Content Video Production Unstructured Data Video Consumption /Community Content Features + Meta-Content Structured + Unstructured Data Web Video Search Traditional Media Search
Opportunities ,[object Object],[object Object],[object Object],[object Object],[object Object]
Opportunities ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
 
Opportunities ,[object Object],[object Object],[object Object],[object Object],[object Object]
 
Opportunities ,[object Object],[object Object],[object Object],[object Object],[object Object]
Play Video 1 Play Video 2
Opportunities ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Play Video
Opportunities ,[object Object],[object Object]
Opportunities ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Opportunities 1970 2000 1990 1980 2010 Acoustic Modeling Vocal Tract Modeling Formant Analysis DSP: FFT, MFCC Digit Recognizers Viterbi search; HMMs Sub-phonetic Models FSMs, Grammars, Statistical N-grams Digit Recognition; Small Vocabulary Discrete Medium Vocabulary Continuous Large Vocabulary Continuous LVCSR Telephony/Broadcast
Opportunities 1970 2000 1990 1980 2010 Acoustic Modeling Vocal Tract Modeling Formant Analysis DSP: FFT, MFCC Digit Recognizers Viterbi search; HMMs Sub-phonetic Models FSMs, Grammars, Statistical N-grams Digit Recognition; Small Vocabulary Discrete Medium Vocabulary Continuous Large Vocabulary Continuous LVCSR Telephony/Broadcast Millions of non-audio Text Data Hundreds of Hours of Audio Data Modeling Framework Milestones
Opportunities ,[object Object],[object Object],[object Object],[object Object]
Opportunities ,[object Object],[object Object],[object Object],[object Object]
Opportunities ,[object Object],[object Object],[object Object],[object Object]
Opportunities ,[object Object],[object Object],[object Object],[object Object]
Opportunities ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Opportunities ,[object Object],[object Object],[object Object]
Opportunities ,[object Object],[object Object],[object Object],[object Object]
Opportunities ,[object Object],[object Object],[object Object],[object Object]
Opportunities ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Outline ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Challenges ,[object Object],[object Object]
Challenges ,[object Object],[object Object],[object Object],[object Object]
Challenges ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Challenges ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Challenges ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Challenges ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Challenges ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Challenges ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Outline ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Conclusion ,[object Object],[object Object]
Conclusion ,[object Object],[object Object],[object Object],[object Object],[object Object]
Conclusion ,[object Object],[object Object]
Conclusion ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Conclusion ,[object Object],[object Object]
Appendix: Leveraging Research & Industrial Communities ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Empfohlen

Machine learning and multimedia information retrieval
Machine learning and multimedia information retrievalMachine learning and multimedia information retrieval
Machine learning and multimedia information retrieval
Si Krishan
 
Multimedia content based retrieval slideshare.ppt
Multimedia content based retrieval slideshare.pptMultimedia content based retrieval slideshare.ppt
Multimedia content based retrieval slideshare.ppt
govintech1
 
Content based video retrieval system
Content based video retrieval systemContent based video retrieval system
Content based video retrieval system
eSAT Publishing House
 
A Semantic Multimedia Web (Part 1)
A Semantic Multimedia Web (Part 1)A Semantic Multimedia Web (Part 1)
A Semantic Multimedia Web (Part 1)
Raphael Troncy
 
Video Indexing And Retrieval
Video Indexing And RetrievalVideo Indexing And Retrieval
Video Indexing And Retrieval
Yvonne M
 
Multimedia Semantics: Metadata, Analysis and Interaction
Multimedia Semantics: Metadata, Analysis and InteractionMultimedia Semantics: Metadata, Analysis and Interaction
Multimedia Semantics: Metadata, Analysis and Interaction
Raphael Troncy
 
BUILDING A SCALABLE MULTIMEDIA WEB OBSERVATORY
BUILDING A SCALABLE MULTIMEDIA WEB OBSERVATORYBUILDING A SCALABLE MULTIMEDIA WEB OBSERVATORY
BUILDING A SCALABLE MULTIMEDIA WEB OBSERVATORY
Jonathon Hare
 
Video Indexing and Retrieval
Video Indexing and RetrievalVideo Indexing and Retrieval
Video Indexing and Retrieval
Rachmat Wahid Saleh Insani
 

Empfohlen

Machine learning and multimedia information retrieval
Machine learning and multimedia information retrievalMachine learning and multimedia information retrieval
Machine learning and multimedia information retrieval
Si Krishan
 
Multimedia content based retrieval slideshare.ppt
Multimedia content based retrieval slideshare.pptMultimedia content based retrieval slideshare.ppt
Multimedia content based retrieval slideshare.ppt
govintech1
 
Content based video retrieval system
Content based video retrieval systemContent based video retrieval system
Content based video retrieval system
eSAT Publishing House
 
A Semantic Multimedia Web (Part 1)
A Semantic Multimedia Web (Part 1)A Semantic Multimedia Web (Part 1)
A Semantic Multimedia Web (Part 1)
Raphael Troncy
 
Video Indexing And Retrieval
Video Indexing And RetrievalVideo Indexing And Retrieval
Video Indexing And Retrieval
Yvonne M
 
Multimedia Semantics: Metadata, Analysis and Interaction
Multimedia Semantics: Metadata, Analysis and InteractionMultimedia Semantics: Metadata, Analysis and Interaction
Multimedia Semantics: Metadata, Analysis and Interaction
Raphael Troncy
 
BUILDING A SCALABLE MULTIMEDIA WEB OBSERVATORY
BUILDING A SCALABLE MULTIMEDIA WEB OBSERVATORYBUILDING A SCALABLE MULTIMEDIA WEB OBSERVATORY
BUILDING A SCALABLE MULTIMEDIA WEB OBSERVATORY
Jonathon Hare
 
Video Indexing and Retrieval
Video Indexing and RetrievalVideo Indexing and Retrieval
Video Indexing and Retrieval
Rachmat Wahid Saleh Insani
 
Semantics In Digital Photos A Contenxtual Analysis
Semantics In Digital Photos A Contenxtual AnalysisSemantics In Digital Photos A Contenxtual Analysis
Semantics In Digital Photos A Contenxtual Analysis
AllenWu
 
OpenIMAJ and ImageTerrier: Java Libraries and Tools for Scalable Multimedia A...
OpenIMAJ and ImageTerrier: Java Libraries and Tools for Scalable Multimedia A...OpenIMAJ and ImageTerrier: Java Libraries and Tools for Scalable Multimedia A...
OpenIMAJ and ImageTerrier: Java Libraries and Tools for Scalable Multimedia A...
Jonathon Hare
 
Towards Collaborative Annotation for Video Accessibility
Towards Collaborative Annotation for Video AccessibilityTowards Collaborative Annotation for Video Accessibility
Towards Collaborative Annotation for Video Accessibility
Raphael Troncy
 
Motaz_CV
Motaz_CVMotaz_CV
Motaz_CV
Motaz El-Saban
 
TechnicalBackgroundOverview
TechnicalBackgroundOverviewTechnicalBackgroundOverview
TechnicalBackgroundOverview
Motaz El-Saban
 
Kadir A_20160804_res_tea
Kadir A_20160804_res_teaKadir A_20160804_res_tea
Kadir A_20160804_res_tea
Kadir A Peker
 
Podobnostní hledání v netextových datech (Pavel Zezula)
Podobnostní hledání v netextových datech (Pavel Zezula)Podobnostní hledání v netextových datech (Pavel Zezula)
Podobnostní hledání v netextových datech (Pavel Zezula)
Národní technická knihovna (NTK)
 
Twente ir-course 20-10-2010
Twente ir-course 20-10-2010Twente ir-course 20-10-2010
Twente ir-course 20-10-2010
Arjen de Vries
 
Multimodal Searching and Semantic Spaces: ...or how to find images of Dalmati...
Multimodal Searching and Semantic Spaces: ...or how to find images of Dalmati...Multimodal Searching and Semantic Spaces: ...or how to find images of Dalmati...
Multimodal Searching and Semantic Spaces: ...or how to find images of Dalmati...
Jonathon Hare
 
SP1: Exploratory Network Analysis with Gephi
SP1: Exploratory Network Analysis with GephiSP1: Exploratory Network Analysis with Gephi
SP1: Exploratory Network Analysis with Gephi
John Breslin
 
Enhancing Social Network Security through Smart Credentials
Enhancing Social Network Security through Smart CredentialsEnhancing Social Network Security through Smart Credentials
Enhancing Social Network Security through Smart Credentials
IJCSIS Research Publications
 
Computer Vision Crash Course
Computer Vision Crash CourseComputer Vision Crash Course
Computer Vision Crash Course
Jia-Bin Huang
 
User-centric Networks for Immersive Communication
User-centric Networks for Immersive CommunicationUser-centric Networks for Immersive Communication
User-centric Networks for Immersive Communication
lauratoni4
 
Image and video annotation
Image and video annotationImage and video annotation
Image and video annotation
NityJaiswal1
 
Resume
ResumeResume
Resume
butest
 
Big-Data Analytics for Media Management
Big-Data Analytics for Media ManagementBig-Data Analytics for Media Management
Big-Data Analytics for Media Management
techkrish
 
Deep Learning
Deep LearningDeep Learning
Deep Learning
Riri Kusumarani
 
Sign Language Recognition with Gesture Analysis
Sign Language Recognition with Gesture AnalysisSign Language Recognition with Gesture Analysis
Sign Language Recognition with Gesture Analysis
paperpublications3
 
Speaker ID II (D4L1 Deep Learning for Speech and Language UPC 2017)
Speaker ID II (D4L1 Deep Learning for Speech and Language UPC 2017)Speaker ID II (D4L1 Deep Learning for Speech and Language UPC 2017)
Speaker ID II (D4L1 Deep Learning for Speech and Language UPC 2017)
Universitat Politècnica de Catalunya
 
Multimedia Information Retrieval
Multimedia Information RetrievalMultimedia Information Retrieval
Multimedia Information Retrieval
Stephane Marchand-Maillet
 
Calgary Multimedia Company
Calgary Multimedia CompanyCalgary Multimedia Company
Calgary Multimedia Company
brandsmultimedia
 
Multimedia Information Retrieval: Bytes and pixels meet the challenges of hum...
Multimedia Information Retrieval: Bytes and pixels meet the challenges of hum...Multimedia Information Retrieval: Bytes and pixels meet the challenges of hum...
Multimedia Information Retrieval: Bytes and pixels meet the challenges of hum...
maranlar
 

Weitere ähnliche Inhalte

Was ist angesagt?

OpenIMAJ and ImageTerrier: Java Libraries and Tools for Scalable Multimedia A...
OpenIMAJ and ImageTerrier: Java Libraries and Tools for Scalable Multimedia A...OpenIMAJ and ImageTerrier: Java Libraries and Tools for Scalable Multimedia A...
OpenIMAJ and ImageTerrier: Java Libraries and Tools for Scalable Multimedia A...
Jonathon Hare
 
TechnicalBackgroundOverview
TechnicalBackgroundOverviewTechnicalBackgroundOverview
TechnicalBackgroundOverview
Motaz El-Saban
 
Kadir A_20160804_res_tea
Kadir A_20160804_res_teaKadir A_20160804_res_tea
Kadir A_20160804_res_tea
Kadir A Peker
 
SP1: Exploratory Network Analysis with Gephi
SP1: Exploratory Network Analysis with GephiSP1: Exploratory Network Analysis with Gephi
SP1: Exploratory Network Analysis with Gephi
John Breslin
 
Enhancing Social Network Security through Smart Credentials
Enhancing Social Network Security through Smart CredentialsEnhancing Social Network Security through Smart Credentials
Enhancing Social Network Security through Smart Credentials
IJCSIS Research Publications
 
Resume
ResumeResume
Resume
butest
 
Sign Language Recognition with Gesture Analysis
Sign Language Recognition with Gesture AnalysisSign Language Recognition with Gesture Analysis
Sign Language Recognition with Gesture Analysis
paperpublications3
 
Speaker ID II (D4L1 Deep Learning for Speech and Language UPC 2017)
Speaker ID II (D4L1 Deep Learning for Speech and Language UPC 2017)Speaker ID II (D4L1 Deep Learning for Speech and Language UPC 2017)
Speaker ID II (D4L1 Deep Learning for Speech and Language UPC 2017)
Universitat Politècnica de Catalunya
 

Was ist angesagt? (19)

Semantics In Digital Photos A Contenxtual Analysis
Semantics In Digital Photos A Contenxtual AnalysisSemantics In Digital Photos A Contenxtual Analysis
Semantics In Digital Photos A Contenxtual Analysis
 
OpenIMAJ and ImageTerrier: Java Libraries and Tools for Scalable Multimedia A...
OpenIMAJ and ImageTerrier: Java Libraries and Tools for Scalable Multimedia A...OpenIMAJ and ImageTerrier: Java Libraries and Tools for Scalable Multimedia A...
OpenIMAJ and ImageTerrier: Java Libraries and Tools for Scalable Multimedia A...
 
Towards Collaborative Annotation for Video Accessibility
Towards Collaborative Annotation for Video AccessibilityTowards Collaborative Annotation for Video Accessibility
Towards Collaborative Annotation for Video Accessibility
 
Motaz_CV
Motaz_CVMotaz_CV
Motaz_CV
 
TechnicalBackgroundOverview
TechnicalBackgroundOverviewTechnicalBackgroundOverview
TechnicalBackgroundOverview
 
Kadir A_20160804_res_tea
Kadir A_20160804_res_teaKadir A_20160804_res_tea
Kadir A_20160804_res_tea
 
Podobnostní hledání v netextových datech (Pavel Zezula)
Podobnostní hledání v netextových datech (Pavel Zezula)Podobnostní hledání v netextových datech (Pavel Zezula)
Podobnostní hledání v netextových datech (Pavel Zezula)
 
Twente ir-course 20-10-2010
Twente ir-course 20-10-2010Twente ir-course 20-10-2010
Twente ir-course 20-10-2010
 
Multimodal Searching and Semantic Spaces: ...or how to find images of Dalmati...
Multimodal Searching and Semantic Spaces: ...or how to find images of Dalmati...Multimodal Searching and Semantic Spaces: ...or how to find images of Dalmati...
Multimodal Searching and Semantic Spaces: ...or how to find images of Dalmati...
 
SP1: Exploratory Network Analysis with Gephi
SP1: Exploratory Network Analysis with GephiSP1: Exploratory Network Analysis with Gephi
SP1: Exploratory Network Analysis with Gephi
 
Enhancing Social Network Security through Smart Credentials
Enhancing Social Network Security through Smart CredentialsEnhancing Social Network Security through Smart Credentials
Enhancing Social Network Security through Smart Credentials
 
Computer Vision Crash Course
Computer Vision Crash CourseComputer Vision Crash Course
Computer Vision Crash Course
 
User-centric Networks for Immersive Communication
User-centric Networks for Immersive CommunicationUser-centric Networks for Immersive Communication
User-centric Networks for Immersive Communication
 
Image and video annotation
Image and video annotationImage and video annotation
Image and video annotation
 
Resume
ResumeResume
Resume
 
Big-Data Analytics for Media Management
Big-Data Analytics for Media ManagementBig-Data Analytics for Media Management
Big-Data Analytics for Media Management
 
Deep Learning
Deep LearningDeep Learning
Deep Learning
 
Sign Language Recognition with Gesture Analysis
Sign Language Recognition with Gesture AnalysisSign Language Recognition with Gesture Analysis
Sign Language Recognition with Gesture Analysis
 
Speaker ID II (D4L1 Deep Learning for Speech and Language UPC 2017)
Speaker ID II (D4L1 Deep Learning for Speech and Language UPC 2017)Speaker ID II (D4L1 Deep Learning for Speech and Language UPC 2017)
Speaker ID II (D4L1 Deep Learning for Speech and Language UPC 2017)
 

Andere mochten auch

Multimedia Information Retrieval: Bytes and pixels meet the challenges of hum...
Multimedia Information Retrieval: Bytes and pixels meet the challenges of hum...Multimedia Information Retrieval: Bytes and pixels meet the challenges of hum...
Multimedia Information Retrieval: Bytes and pixels meet the challenges of hum...
maranlar
 
Motion graphics and_compositing_video_analysis_worksheet_3
Motion graphics and_compositing_video_analysis_worksheet_3Motion graphics and_compositing_video_analysis_worksheet_3
Motion graphics and_compositing_video_analysis_worksheet_3
megrobbo95
 
Deal, Brandon R. Resume
Deal, Brandon R. ResumeDeal, Brandon R. Resume
Deal, Brandon R. Resume
Brandon Deal
 
multimedia chapter1
multimedia chapter1multimedia chapter1
multimedia chapter1
nes
 
Design, selection and utilization of media
Design, selection and utilization of mediaDesign, selection and utilization of media
Design, selection and utilization of media
Alaa Sadik
 
Media and Information Literacy (MIL) - Intellectual Property, Fair Use, and C...
Media and Information Literacy (MIL) - Intellectual Property, Fair Use, and C...Media and Information Literacy (MIL) - Intellectual Property, Fair Use, and C...
Media and Information Literacy (MIL) - Intellectual Property, Fair Use, and C...
Arniel Ping
 

Andere mochten auch (20)

Multimedia Information Retrieval
Multimedia Information RetrievalMultimedia Information Retrieval
Multimedia Information Retrieval
 
Calgary Multimedia Company
Calgary Multimedia CompanyCalgary Multimedia Company
Calgary Multimedia Company
 
Multimedia Information Retrieval: Bytes and pixels meet the challenges of hum...
Multimedia Information Retrieval: Bytes and pixels meet the challenges of hum...Multimedia Information Retrieval: Bytes and pixels meet the challenges of hum...
Multimedia Information Retrieval: Bytes and pixels meet the challenges of hum...
 
Social in Motion: The Rise of the Video Format
Social in Motion: The Rise of the Video FormatSocial in Motion: The Rise of the Video Format
Social in Motion: The Rise of the Video Format
 
Motion graphics and_compositing_video_analysis_worksheet_3
Motion graphics and_compositing_video_analysis_worksheet_3Motion graphics and_compositing_video_analysis_worksheet_3
Motion graphics and_compositing_video_analysis_worksheet_3
 
Deal, Brandon R. Resume
Deal, Brandon R. ResumeDeal, Brandon R. Resume
Deal, Brandon R. Resume
 
Multimedia information management
Multimedia information managementMultimedia information management
Multimedia information management
 
Media, Multimedia & Digital Media
Media, Multimedia & Digital MediaMedia, Multimedia & Digital Media
Media, Multimedia & Digital Media
 
Motion and its description
Motion and its descriptionMotion and its description
Motion and its description
 
"Cahier de charges couscous salé de mil de l’île de Fadouth (Sentinelle Slow ...
"Cahier de charges couscous salé de mil de l’île de Fadouth (Sentinelle Slow ..."Cahier de charges couscous salé de mil de l’île de Fadouth (Sentinelle Slow ...
"Cahier de charges couscous salé de mil de l’île de Fadouth (Sentinelle Slow ...
 
multimedia chapter1
multimedia chapter1multimedia chapter1
multimedia chapter1
 
Multimedia database
Multimedia databaseMultimedia database
Multimedia database
 
Edtech101report
Edtech101reportEdtech101report
Edtech101report
 
Design, selection and utilization of media
Design, selection and utilization of mediaDesign, selection and utilization of media
Design, selection and utilization of media
 
Handout: Motion Media
Handout: Motion MediaHandout: Motion Media
Handout: Motion Media
 
Media and Information Literacy (MIL) 4.MIL Media Literacy (Part 1)- Definitio...
Media and Information Literacy (MIL) 4.MIL Media Literacy (Part 1)- Definitio...Media and Information Literacy (MIL) 4.MIL Media Literacy (Part 1)- Definitio...
Media and Information Literacy (MIL) 4.MIL Media Literacy (Part 1)- Definitio...
 
Media and Information Literacy (MIL) - 6. Media and Information Languages (Pa...
Media and Information Literacy (MIL) - 6. Media and Information Languages (Pa...Media and Information Literacy (MIL) - 6. Media and Information Languages (Pa...
Media and Information Literacy (MIL) - 6. Media and Information Languages (Pa...
 
Media and Information Literacy (MIL) - 10. Media and Information Literate Ind...
Media and Information Literacy (MIL) - 10. Media and Information Literate Ind...Media and Information Literacy (MIL) - 10. Media and Information Literate Ind...
Media and Information Literacy (MIL) - 10. Media and Information Literate Ind...
 
Media and Information Literacy (MIL) - Intellectual Property, Fair Use, and C...
Media and Information Literacy (MIL) - Intellectual Property, Fair Use, and C...Media and Information Literacy (MIL) - Intellectual Property, Fair Use, and C...
Media and Information Literacy (MIL) - Intellectual Property, Fair Use, and C...
 
Media and Information Literacy (MIL) 1. Introduction to Media and Informatio...
Media and Information Literacy (MIL) 1. Introduction to Media and Informatio...Media and Information Literacy (MIL) 1. Introduction to Media and Informatio...
Media and Information Literacy (MIL) 1. Introduction to Media and Informatio...
 

Ähnlich wie Multimedia Information Retrieval: What is it, and why isn't ...

Wearable Computing and Human Computer Interfaces
Wearable Computing and Human Computer InterfacesWearable Computing and Human Computer Interfaces
Wearable Computing and Human Computer Interfaces
Jeffrey Funk
 

Ähnlich wie Multimedia Information Retrieval: What is it, and why isn't ... (20)

Guru_poster
Guru_posterGuru_poster
Guru_poster
 
Similarity-based retrieval of multimedia content
Similarity-based retrieval of multimedia contentSimilarity-based retrieval of multimedia content
Similarity-based retrieval of multimedia content
 
Interactive Video Search: Where is the User in the Age of Deep Learning?
Interactive Video Search: Where is the User in the Age of Deep Learning?Interactive Video Search: Where is the User in the Age of Deep Learning?
Interactive Video Search: Where is the User in the Age of Deep Learning?
 
Deep Learning: Changing the Playing Field of Artificial Intelligence - MaRS G...
Deep Learning: Changing the Playing Field of Artificial Intelligence - MaRS G...Deep Learning: Changing the Playing Field of Artificial Intelligence - MaRS G...
Deep Learning: Changing the Playing Field of Artificial Intelligence - MaRS G...
 
New coding techniques, standardisation, and quality metrics
New coding techniques, standardisation, and quality metricsNew coding techniques, standardisation, and quality metrics
New coding techniques, standardisation, and quality metrics
 
Digital Signage Explained
Digital Signage ExplainedDigital Signage Explained
Digital Signage Explained
 
Wearable Computing and Human Computer Interfaces
Wearable Computing and Human Computer InterfacesWearable Computing and Human Computer Interfaces
Wearable Computing and Human Computer Interfaces
 
How to Enhance Your Career with AI
How to Enhance Your Career with AIHow to Enhance Your Career with AI
How to Enhance Your Career with AI
 
A Semantic Multimedia Web: Create, Annotate, Present and Share your Media
A Semantic Multimedia Web: Create, Annotate, Present and Share your MediaA Semantic Multimedia Web: Create, Annotate, Present and Share your Media
A Semantic Multimedia Web: Create, Annotate, Present and Share your Media
 
37 million reasons to give a damn about the disabled
37 million reasons to give a damn about the disabled37 million reasons to give a damn about the disabled
37 million reasons to give a damn about the disabled
 
Video Analytics on Hadoop webinar victor fang-201309
Video Analytics on Hadoop webinar victor fang-201309Video Analytics on Hadoop webinar victor fang-201309
Video Analytics on Hadoop webinar victor fang-201309
 
Big Video Data Revolution, Challenges Unresolved
Big Video Data Revolution, Challenges UnresolvedBig Video Data Revolution, Challenges Unresolved
Big Video Data Revolution, Challenges Unresolved
 
MediaEval 2016 - COSMIR and the OpenMIC Challenge: A Plan for Sustainable Mus...
MediaEval 2016 - COSMIR and the OpenMIC Challenge: A Plan for Sustainable Mus...MediaEval 2016 - COSMIR and the OpenMIC Challenge: A Plan for Sustainable Mus...
MediaEval 2016 - COSMIR and the OpenMIC Challenge: A Plan for Sustainable Mus...
 
AI for voice recognition.pptx
AI for voice recognition.pptxAI for voice recognition.pptx
AI for voice recognition.pptx
 
Raskar Emtech2010 Mar Final
Raskar Emtech2010 Mar FinalRaskar Emtech2010 Mar Final
Raskar Emtech2010 Mar Final
 
Automatic multi-modal metadata annotation based on trained cognitive solution...
Automatic multi-modal metadata annotation based on trained cognitive solution...Automatic multi-modal metadata annotation based on trained cognitive solution...
Automatic multi-modal metadata annotation based on trained cognitive solution...
 
110419 ENSWERS INTRODUCTION
110419 ENSWERS INTRODUCTION110419 ENSWERS INTRODUCTION
110419 ENSWERS INTRODUCTION
 
Raskar Emtech2010 Mar Final
Raskar Emtech2010 Mar FinalRaskar Emtech2010 Mar Final
Raskar Emtech2010 Mar Final
 
Introduction
IntroductionIntroduction
Introduction
 
Multimediaexercise
MultimediaexerciseMultimediaexercise
Multimediaexercise
 

Mehr von webhostingguy

Running and Developing Tests with the Apache::Test Framework
Running and Developing Tests with the Apache::Test FrameworkRunning and Developing Tests with the Apache::Test Framework
Running and Developing Tests with the Apache::Test Framework
webhostingguy
 
MySQL and memcached Guide
MySQL and memcached GuideMySQL and memcached Guide
MySQL and memcached Guide
webhostingguy
 
Novell® iChain® 2.3
Novell® iChain® 2.3Novell® iChain® 2.3
Novell® iChain® 2.3
webhostingguy
 
Load-balancing web servers Load-balancing web servers
Load-balancing web servers Load-balancing web serversLoad-balancing web servers Load-balancing web servers
Load-balancing web servers Load-balancing web servers
webhostingguy
 
SQL Server 2008 Consolidation
SQL Server 2008 ConsolidationSQL Server 2008 Consolidation
SQL Server 2008 Consolidation
webhostingguy
 
Master Service Agreement
Master Service AgreementMaster Service Agreement
Master Service Agreement
webhostingguy
 
PHP and MySQL PHP Written as a set of CGI binaries in C in ...
PHP and MySQL PHP Written as a set of CGI binaries in C in ...PHP and MySQL PHP Written as a set of CGI binaries in C in ...
PHP and MySQL PHP Written as a set of CGI binaries in C in ...
webhostingguy
 
Dell Reference Architecture Guide Deploying Microsoft® SQL ...
Dell Reference Architecture Guide Deploying Microsoft® SQL ...Dell Reference Architecture Guide Deploying Microsoft® SQL ...
Dell Reference Architecture Guide Deploying Microsoft® SQL ...
webhostingguy
 
Managing Diverse IT Infrastructure
Managing Diverse IT InfrastructureManaging Diverse IT Infrastructure
Managing Diverse IT Infrastructure
webhostingguy
 
Web design for business.ppt
Web design for business.pptWeb design for business.ppt
Web design for business.ppt
webhostingguy
 
IT Power Management Strategy
IT Power Management Strategy IT Power Management Strategy
IT Power Management Strategy
webhostingguy
 
Excel and SQL Quick Tricks for Merchandisers
Excel and SQL Quick Tricks for MerchandisersExcel and SQL Quick Tricks for Merchandisers
Excel and SQL Quick Tricks for Merchandisers
webhostingguy
 
Parallels Hosting Products
Parallels Hosting ProductsParallels Hosting Products
Parallels Hosting Products
webhostingguy
 
Microsoft PowerPoint presentation 2.175 Mb
Microsoft PowerPoint presentation 2.175 MbMicrosoft PowerPoint presentation 2.175 Mb
Microsoft PowerPoint presentation 2.175 Mb
webhostingguy
 

Mehr von webhostingguy (20)

File Upload
File UploadFile Upload
File Upload
 
Running and Developing Tests with the Apache::Test Framework
Running and Developing Tests with the Apache::Test FrameworkRunning and Developing Tests with the Apache::Test Framework
Running and Developing Tests with the Apache::Test Framework
 
MySQL and memcached Guide
MySQL and memcached GuideMySQL and memcached Guide
MySQL and memcached Guide
 
Novell® iChain® 2.3
Novell® iChain® 2.3Novell® iChain® 2.3
Novell® iChain® 2.3
 
Load-balancing web servers Load-balancing web servers
Load-balancing web servers Load-balancing web serversLoad-balancing web servers Load-balancing web servers
Load-balancing web servers Load-balancing web servers
 
SQL Server 2008 Consolidation
SQL Server 2008 ConsolidationSQL Server 2008 Consolidation
SQL Server 2008 Consolidation
 
What is mod_perl?
What is mod_perl?What is mod_perl?
What is mod_perl?
 
What is mod_perl?
What is mod_perl?What is mod_perl?
What is mod_perl?
 
Master Service Agreement
Master Service AgreementMaster Service Agreement
Master Service Agreement
 
Notes8
Notes8Notes8
Notes8
 
PHP and MySQL PHP Written as a set of CGI binaries in C in ...
PHP and MySQL PHP Written as a set of CGI binaries in C in ...PHP and MySQL PHP Written as a set of CGI binaries in C in ...
PHP and MySQL PHP Written as a set of CGI binaries in C in ...
 
Dell Reference Architecture Guide Deploying Microsoft® SQL ...
Dell Reference Architecture Guide Deploying Microsoft® SQL ...Dell Reference Architecture Guide Deploying Microsoft® SQL ...
Dell Reference Architecture Guide Deploying Microsoft® SQL ...
 
Managing Diverse IT Infrastructure
Managing Diverse IT InfrastructureManaging Diverse IT Infrastructure
Managing Diverse IT Infrastructure
 
Web design for business.ppt
Web design for business.pptWeb design for business.ppt
Web design for business.ppt
 
IT Power Management Strategy
IT Power Management Strategy IT Power Management Strategy
IT Power Management Strategy
 
Excel and SQL Quick Tricks for Merchandisers
Excel and SQL Quick Tricks for MerchandisersExcel and SQL Quick Tricks for Merchandisers
Excel and SQL Quick Tricks for Merchandisers
 
OLUG_xen.ppt
OLUG_xen.pptOLUG_xen.ppt
OLUG_xen.ppt
 
Parallels Hosting Products
Parallels Hosting ProductsParallels Hosting Products
Parallels Hosting Products
 
Microsoft PowerPoint presentation 2.175 Mb
Microsoft PowerPoint presentation 2.175 MbMicrosoft PowerPoint presentation 2.175 Mb
Microsoft PowerPoint presentation 2.175 Mb
 
Reseller's Guide
Reseller's GuideReseller's Guide
Reseller's Guide
 

Multimedia Information Retrieval: What is it, and why isn't ...

  • 1. Video Search: Opportunities and Challenges Keynote Speech at ACM MIR Workshop ACM Multimedia Conference 2005 Singapore Dr. Ramesh R. Sarukkai Yahoo! Search { [email_address] [email_address] }
  • 2.
  • 3.
  • 4.
  • 5.
  • 6.
  • 7.
  • 8.
  • 9.
  • 10.
  • 11.
  • 12.
  • 13.
  • 14.
  • 15.
  • 16. Video Search Meta-Content Video Production Unstructured Data Video Consumption /Community Content Features + Meta-Content Structured + Unstructured Data
  • 17.
  • 18.
  • 19.
  • 20.
  • 21. Video Search: Features 1970 2000 1990 1980 2010 Texture: Autocorrelation; Wavelet transforms; Gabor Filters Shape: Edge Detectors; Moment invariants; Animate Vision Marr; Finite Element Methods; Shape from Motion; Color: Color Moments Color Histograms Color Autocorrelograms Segmentation: Scene segmentation; Scene Segmentation; Shot detection; OCR: Modeling; Successful OCR deployments; Face: Face Detection algorithms; Neural Networks; EigenFaces ASR: Acoustic analysis; HMMS; N-grams; CSR; LVCSR; Domain Specific; NIST Video TREC Starts Media IR systems Web Media Search
  • 22.
  • 23.
  • 24.
  • 25.
  • 26.
  • 27.
  • 28.
  • 29.
  • 30.
  • 31.
  • 32.
  • 33.
  • 34.
  • 35.
  • 36. Video Search Meta-Content Video Production Unstructured Data Video Consumption /Community Content Features + Meta-Content Structured + Unstructured Data Web Video Search Traditional Media Search
  • 37.
  • 38.
  • 39.  
  • 40.
  • 41.  
  • 42.
  • 43. Play Video 1 Play Video 2
  • 44.
  • 46.
  • 47.
  • 48. Opportunities 1970 2000 1990 1980 2010 Acoustic Modeling Vocal Tract Modeling Formant Analysis DSP: FFT, MFCC Digit Recognizers Viterbi search; HMMs Sub-phonetic Models FSMs, Grammars, Statistical N-grams Digit Recognition; Small Vocabulary Discrete Medium Vocabulary Continuous Large Vocabulary Continuous LVCSR Telephony/Broadcast
  • 49. Opportunities 1970 2000 1990 1980 2010 Acoustic Modeling Vocal Tract Modeling Formant Analysis DSP: FFT, MFCC Digit Recognizers Viterbi search; HMMs Sub-phonetic Models FSMs, Grammars, Statistical N-grams Digit Recognition; Small Vocabulary Discrete Medium Vocabulary Continuous Large Vocabulary Continuous LVCSR Telephony/Broadcast Millions of non-audio Text Data Hundreds of Hours of Audio Data Modeling Framework Milestones
  • 50.
  • 51.
  • 52.
  • 53.
  • 54.
  • 55.
  • 56.
  • 57.
  • 58.
  • 59.
  • 60.
  • 61.
  • 62.
  • 63.
  • 64.
  • 65.
  • 66.
  • 67.
  • 68.
  • 69.
  • 70.
  • 71.
  • 72.
  • 73.
  • 74.