SlideShare ist ein Scribd-Unternehmen logo
1 von 9
CBIR with LIRe


Mathias Lux
Klagenfurt University
Austria

            This work is licensed under the Creative Commons Attribution-NonCommercial-ShareAlike 3.0
Lucene Image Retrieval

• Open source
• Java
• Based on Lucene
  – text retrieval engine
History

• Caliph & Emir
  – first release in July 2004
  – developed since ~ midth of 2003
• Lire as spin-off product
  – first release in 2006
  – first use case was
    „barrique“
  – Just MPEG-7

                  Barrique is a project of Roman Kern: http://sourceforge.net/projects/barrique/
Image Retrieval Features

• Color Histograms
• MPEG-7 features
    – scalable color, color layout and edge histogram
• Tamura features
    – coarseness, contrast and directionality
•   Joint histograms CEDD, FCTH and JCD
•   Auto color correlation
•   JPEG coefficients histogram
•   Local features
    – SIFT , SURF, MSER
• ... and more to come
Indexing and Search

• Fast linear search
• BoVW search based on Lucene
• Parallel k-means & visual word indexing
  for BoVW
• Fastmap for spatial indexing
• Metric spaces approach for fast search in
  global features
Lire: Some Examples

• Utilize Lucene
  – put an index into RAM
  – distribute indexes over the network
• Rapid prototyping
  – Basic auto-tagging < 100 loc
• Test different features
  & approaches
  – eg. mediamid & CEDD
Where has LIRe been used?

• ImageCLEF
  – different groups
  – mentioned on the website
• TRECVid
  – 2010 ranked 3rd in known item search
• Medical domain
  – image retrieval & video summarization
• Apparel search applications
Future Directions …

• Unified way to change & test metrics
• Easier benchmarking
• Further support and maintenance
Thanks …

• Want to download & try LIRe:
• http://www.semanticmetadata.net

Weitere ähnliche Inhalte

Ähnlich wie Content based image retrieval with LIRe

Compact Descriptors for Visual Search
Compact Descriptors for Visual SearchCompact Descriptors for Visual Search
Compact Descriptors for Visual Search
Antonio Capone
 
Keynote Yonik Seeley & Steve Rowe lucene solr roadmap
Keynote   Yonik Seeley & Steve Rowe lucene solr roadmapKeynote   Yonik Seeley & Steve Rowe lucene solr roadmap
Keynote Yonik Seeley & Steve Rowe lucene solr roadmap
lucenerevolution
 
KEYNOTE: Lucene / Solr road map
KEYNOTE: Lucene / Solr road mapKEYNOTE: Lucene / Solr road map
KEYNOTE: Lucene / Solr road map
lucenerevolution
 

Ähnlich wie Content based image retrieval with LIRe (20)

2nd Microscopy Congress: Public archiving of bio-imaging data - perspectives,...
2nd Microscopy Congress: Public archiving of bio-imaging data - perspectives,...2nd Microscopy Congress: Public archiving of bio-imaging data - perspectives,...
2nd Microscopy Congress: Public archiving of bio-imaging data - perspectives,...
 
State of the Art Logging. Kibana4Solr is Here!
State of the Art Logging. Kibana4Solr is Here! State of the Art Logging. Kibana4Solr is Here!
State of the Art Logging. Kibana4Solr is Here!
 
CBIR in the Era of Deep Learning
CBIR in the Era of Deep LearningCBIR in the Era of Deep Learning
CBIR in the Era of Deep Learning
 
A Segmentation based Sequential Pattern Matching for Efficient Video Copy De...
A Segmentation based Sequential Pattern Matching for Efficient Video Copy De...A Segmentation based Sequential Pattern Matching for Efficient Video Copy De...
A Segmentation based Sequential Pattern Matching for Efficient Video Copy De...
 
Alfresco Summit 2014 - Crafter CMS - Case European Bank
Alfresco Summit 2014 - Crafter CMS - Case European BankAlfresco Summit 2014 - Crafter CMS - Case European Bank
Alfresco Summit 2014 - Crafter CMS - Case European Bank
 
Searching Images: Recent research at Southampton
Searching Images: Recent research at SouthamptonSearching Images: Recent research at Southampton
Searching Images: Recent research at Southampton
 
Summon @ LBSU
Summon @ LBSUSummon @ LBSU
Summon @ LBSU
 
Compact Descriptors for Visual Search
Compact Descriptors for Visual SearchCompact Descriptors for Visual Search
Compact Descriptors for Visual Search
 
Searching Images: Recent research at Southampton
Searching Images: Recent research at SouthamptonSearching Images: Recent research at Southampton
Searching Images: Recent research at Southampton
 
Evolving a Medical Image Similarity Search
Evolving a Medical Image Similarity SearchEvolving a Medical Image Similarity Search
Evolving a Medical Image Similarity Search
 
Selecting a Container Image Registry for Production - Microservices Meetup Fe...
Selecting a Container Image Registry for Production - Microservices Meetup Fe...Selecting a Container Image Registry for Production - Microservices Meetup Fe...
Selecting a Container Image Registry for Production - Microservices Meetup Fe...
 
Searching Images: Recent research at Southampton
Searching Images: Recent research at SouthamptonSearching Images: Recent research at Southampton
Searching Images: Recent research at Southampton
 
Keynote Yonik Seeley & Steve Rowe lucene solr roadmap
Keynote   Yonik Seeley & Steve Rowe lucene solr roadmapKeynote   Yonik Seeley & Steve Rowe lucene solr roadmap
Keynote Yonik Seeley & Steve Rowe lucene solr roadmap
 
KEYNOTE: Lucene / Solr road map
KEYNOTE: Lucene / Solr road mapKEYNOTE: Lucene / Solr road map
KEYNOTE: Lucene / Solr road map
 
Discovery Systems Used in Academic Libraries Projects & Case Study
Discovery Systems Used in Academic Libraries Projects & Case StudyDiscovery Systems Used in Academic Libraries Projects & Case Study
Discovery Systems Used in Academic Libraries Projects & Case Study
 
Elasticsearch for Autosuggest in Clojure at Workframe
Elasticsearch for Autosuggest in Clojure at WorkframeElasticsearch for Autosuggest in Clojure at Workframe
Elasticsearch for Autosuggest in Clojure at Workframe
 
From Ruby on Rails to RubyMotion - Writing your First iOS App with RubyMotion
From Ruby on Rails to RubyMotion - Writing your First iOS App with RubyMotionFrom Ruby on Rails to RubyMotion - Writing your First iOS App with RubyMotion
From Ruby on Rails to RubyMotion - Writing your First iOS App with RubyMotion
 
Melbourne User Group OAK and MongoDB
Melbourne User Group OAK and MongoDBMelbourne User Group OAK and MongoDB
Melbourne User Group OAK and MongoDB
 
GraphTour - Albelli: Running Neo4j on a large scale image platform
GraphTour - Albelli: Running Neo4j on a large scale image platformGraphTour - Albelli: Running Neo4j on a large scale image platform
GraphTour - Albelli: Running Neo4j on a large scale image platform
 
Serverless spark
Serverless sparkServerless spark
Serverless spark
 

Mehr von dermotte

LIRE presentation at the ACM Multimedia Open Source Software Competition 2013
LIRE presentation at the ACM Multimedia Open Source Software Competition 2013LIRE presentation at the ACM Multimedia Open Source Software Competition 2013
LIRE presentation at the ACM Multimedia Open Source Software Competition 2013
dermotte
 
CBMI 2013 Presentation: User Intentions in Multimedia
CBMI 2013 Presentation: User Intentions in MultimediaCBMI 2013 Presentation: User Intentions in Multimedia
CBMI 2013 Presentation: User Intentions in Multimedia
dermotte
 
Callisto: Content Based Tag Recommendation for Images
Callisto: Content Based Tag Recommendation for ImagesCallisto: Content Based Tag Recommendation for Images
Callisto: Content Based Tag Recommendation for Images
dermotte
 
Using Visual Features to Improve Tag Suggestions in Image Sharing Sites :: pr...
Using Visual Features to Improve Tag Suggestions in Image Sharing Sites :: pr...Using Visual Features to Improve Tag Suggestions in Image Sharing Sites :: pr...
Using Visual Features to Improve Tag Suggestions in Image Sharing Sites :: pr...
dermotte
 

Mehr von dermotte (11)

Invited Talk OAGM Workshop Salzburg, May 2015
Invited Talk OAGM Workshop Salzburg, May 2015Invited Talk OAGM Workshop Salzburg, May 2015
Invited Talk OAGM Workshop Salzburg, May 2015
 
LIRE presentation at the ACM Multimedia Open Source Software Competition 2013
LIRE presentation at the ACM Multimedia Open Source Software Competition 2013LIRE presentation at the ACM Multimedia Open Source Software Competition 2013
LIRE presentation at the ACM Multimedia Open Source Software Competition 2013
 
CBMI 2013 Presentation: User Intentions in Multimedia
CBMI 2013 Presentation: User Intentions in MultimediaCBMI 2013 Presentation: User Intentions in Multimedia
CBMI 2013 Presentation: User Intentions in Multimedia
 
Why did you record this video?
Why did you record this video?Why did you record this video?
Why did you record this video?
 
Ohne LIRe keine Bildsuche
Ohne LIRe keine BildsucheOhne LIRe keine Bildsuche
Ohne LIRe keine Bildsuche
 
Callisto: Content Based Tag Recommendation for Images
Callisto: Content Based Tag Recommendation for ImagesCallisto: Content Based Tag Recommendation for Images
Callisto: Content Based Tag Recommendation for Images
 
User Intentions or "The other end of the camera ..."
User Intentions or "The other end of the camera ..."User Intentions or "The other end of the camera ..."
User Intentions or "The other end of the camera ..."
 
Visual Information Retrieval
Visual Information RetrievalVisual Information Retrieval
Visual Information Retrieval
 
Using Visual Features to Improve Tag Suggestions in Image Sharing Sites :: pr...
Using Visual Features to Improve Tag Suggestions in Image Sharing Sites :: pr...Using Visual Features to Improve Tag Suggestions in Image Sharing Sites :: pr...
Using Visual Features to Improve Tag Suggestions in Image Sharing Sites :: pr...
 
Power Laws Popularity And Interestingness
Power Laws Popularity And InterestingnessPower Laws Popularity And Interestingness
Power Laws Popularity And Interestingness
 
Aspects of broad folksonomies
Aspects of broad folksonomiesAspects of broad folksonomies
Aspects of broad folksonomies
 

Kürzlich hochgeladen

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
Earley Information Science
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 

Kürzlich hochgeladen (20)

Evaluating the top large language models.pdf
Evaluating the top large language models.pdfEvaluating the top large language models.pdf
Evaluating the top large language models.pdf
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 

Content based image retrieval with LIRe

  • 1. CBIR with LIRe Mathias Lux Klagenfurt University Austria This work is licensed under the Creative Commons Attribution-NonCommercial-ShareAlike 3.0
  • 2. Lucene Image Retrieval • Open source • Java • Based on Lucene – text retrieval engine
  • 3. History • Caliph & Emir – first release in July 2004 – developed since ~ midth of 2003 • Lire as spin-off product – first release in 2006 – first use case was „barrique“ – Just MPEG-7 Barrique is a project of Roman Kern: http://sourceforge.net/projects/barrique/
  • 4. Image Retrieval Features • Color Histograms • MPEG-7 features – scalable color, color layout and edge histogram • Tamura features – coarseness, contrast and directionality • Joint histograms CEDD, FCTH and JCD • Auto color correlation • JPEG coefficients histogram • Local features – SIFT , SURF, MSER • ... and more to come
  • 5. Indexing and Search • Fast linear search • BoVW search based on Lucene • Parallel k-means & visual word indexing for BoVW • Fastmap for spatial indexing • Metric spaces approach for fast search in global features
  • 6. Lire: Some Examples • Utilize Lucene – put an index into RAM – distribute indexes over the network • Rapid prototyping – Basic auto-tagging < 100 loc • Test different features & approaches – eg. mediamid & CEDD
  • 7. Where has LIRe been used? • ImageCLEF – different groups – mentioned on the website • TRECVid – 2010 ranked 3rd in known item search • Medical domain – image retrieval & video summarization • Apparel search applications
  • 8. Future Directions … • Unified way to change & test metrics • Easier benchmarking • Further support and maintenance
  • 9. Thanks … • Want to download & try LIRe: • http://www.semanticmetadata.net