SlideShare ist ein Scribd-Unternehmen logo
1 von 4
Mining User Queries with Markov Chains: Application to
Online Image Retrieval
ABSTRACT:
We propose a novel method for automatic annotation, indexing and annotation-
based retrieval of images. The new method, that we call Markovian Semantic
Indexing (MSI), is presented in the context of an online image retrieval system.
Assuming such a system, the users’ queries are used to construct an Aggregate
Markov Chain (AMC) through which the relevance between the keywords seen by
the system is defined. The users’ queries are also used to automatically annotate
the images. A stochastic distance between images, based on their annotation and
the keyword relevance captured in the AMC is then introduced. Geometric
interpretations of the proposed distance are provided and its relation to a clustering
in the keyword space is investigated. By means of a new measure of Markovian
state similarity, the mean first cross passage time (CPT), optimality properties of
the proposed distance are proved. Images are modeled as points in a vector space
and their similarity is measured with MSI. The new method is shown to possess
certain theoretical advantages and also to achieve better Precision versus Recall
results when compared to Latent Semantic Indexing (LSI) and probabilistic Latent
Semantic Indexing (pLSI) methods in Annotation-Based Image Retrieval (ABIR)
tasks.
EXISTING SYSTEM:
Annotation-Based Image Retrieval (ABIR) systems are an attempt to incorporate
more efficient semantic content into both text-based queries and image captions
(i.e. Google Image Search, Yahoo! Image Search). The Latent Semantic Indexing
(LSI)-based approaches that were initially applied with increased success in
document indexing and retrieval were incorporated into the ABIR systems to
discover a more reliable conceptassociation.
DISADVANTAGES OF EXISTING SYSTEM:
While the former gap brings in the issue of users’ interpretations of images and
how it is inherently difficult to capture them in visual content, the latter gap makes
recognition from image content challenging due to limitations in recording and
description capabilities.
A reason for this lies in the sparsity of the per-image keyword annotation data in
comparison to the number of keywords that are usually assigned to documents.
PROPOSED SYSTEM:
We introduce the Markovian Semantic Indexing (MSI), a new method for
automatic annotation and annotation based image retrieval. The properties of MSI
make it particularly suitable for ABIR tasks when the per image annotation data is
limited. The characteristics of the method make it also particularly applicable in
the context of online image retrieval systems.
ADVANTAGES OF PROPOSED SYSTEM:
The targeting is more accurate, compared to other systems that use external means
of non-dynamic or non-adaptive nature to define keyword relevance.
MSI achieves better retrieval results in sparsely annotated image data sets. A
comparison to LSI on 64 images gathered from the Google Image Search and
annotated in a transparent way by the proposed system, revealed certain
advantages for the MSI method, mainly in retrieving images with deeper
dependencies than simple keyword co-occurrence
SYSTEM REQUIREMENTS:
HARDWARE REQUIREMENTS:
 System : Pentium IV 2.4 GHz.
 Hard Disk : 40 GB.
 Monitor : 15 inch VGA Colour.
 Mouse : Logitech Mouse.
 Ram : 512 MB
 Keyboard : Standard Keyboard
SOFTWARE REQUIREMENTS:
 Operating System : Windows XP.
 Coding Language : ASP.NET, C#.Net.
 Database : SQL Server 2005
REFERENCE:
Konstantinos A. Raftopoulos,Member, IEEE, Klimis S. Ntalianis, Dionyssios D.
Sourlas, and Stefanos D. Kollias,Member, IEEE “Mining User Queries with
Markov Chains: Application to Online Image Retrieval” - IEEE
TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, VOL.
25, NO. 2, FEBRUARY2013.

Weitere ähnliche Inhalte

Andere mochten auch

A probabilistic model of visual cryptography Scheme With Dynamic Group
A probabilistic model of visual cryptography Scheme With Dynamic GroupA probabilistic model of visual cryptography Scheme With Dynamic Group
A probabilistic model of visual cryptography Scheme With Dynamic GroupJPINFOTECH JAYAPRAKASH
 
2012 - 2013 DOTNET IEEE PROJECT TITLES
2012 - 2013 DOTNET IEEE PROJECT TITLES2012 - 2013 DOTNET IEEE PROJECT TITLES
2012 - 2013 DOTNET IEEE PROJECT TITLESJPINFOTECH JAYAPRAKASH
 
Efficient algorithms for neighbor discovery in wireless networks
Efficient algorithms for neighbor discovery in wireless networksEfficient algorithms for neighbor discovery in wireless networks
Efficient algorithms for neighbor discovery in wireless networksJPINFOTECH JAYAPRAKASH
 
2012 - 2013 bulk ieee projects for sale
2012 - 2013 bulk ieee projects for sale2012 - 2013 bulk ieee projects for sale
2012 - 2013 bulk ieee projects for saleJPINFOTECH JAYAPRAKASH
 
Discovery and verification of neighbor positions in mobile ad hoc networks
Discovery and verification of neighbor positions in mobile ad hoc networksDiscovery and verification of neighbor positions in mobile ad hoc networks
Discovery and verification of neighbor positions in mobile ad hoc networksJPINFOTECH JAYAPRAKASH
 
A Scalable Two-Phase Top-Down Specialization Approach for Data Anonymization ...
A Scalable Two-Phase Top-Down Specialization Approach for Data Anonymization ...A Scalable Two-Phase Top-Down Specialization Approach for Data Anonymization ...
A Scalable Two-Phase Top-Down Specialization Approach for Data Anonymization ...JPINFOTECH JAYAPRAKASH
 
A real time adaptive algorithm for video streaming over multiple wireless acc...
A real time adaptive algorithm for video streaming over multiple wireless acc...A real time adaptive algorithm for video streaming over multiple wireless acc...
A real time adaptive algorithm for video streaming over multiple wireless acc...JPINFOTECH JAYAPRAKASH
 
Allah jalay shan-2 Urdu
Allah jalay shan-2 UrduAllah jalay shan-2 Urdu
Allah jalay shan-2 UrduRiaz Masud
 
Coletneadeatividades5ano
Coletneadeatividades5ano Coletneadeatividades5ano
Coletneadeatividades5ano rosemereporto
 
Itinerari a Vallhonesta
Itinerari a VallhonestaItinerari a Vallhonesta
Itinerari a Vallhonestabiblio22
 
Shilpi Sharma Hot Photos
Shilpi Sharma Hot Photos   Shilpi Sharma Hot Photos
Shilpi Sharma Hot Photos telugustop.com
 
Como podemos poupar?
Como podemos poupar?Como podemos poupar?
Como podemos poupar?hcbmelo
 
5 dicas para educar os filhos respeitando a privacidade - A Gazeta 21.06
5 dicas para educar os filhos respeitando a privacidade - A Gazeta 21.065 dicas para educar os filhos respeitando a privacidade - A Gazeta 21.06
5 dicas para educar os filhos respeitando a privacidade - A Gazeta 21.06Fábio Nogueira, PhD
 
SANJAY_HANDA_RHCSA_renew
SANJAY_HANDA_RHCSA_renewSANJAY_HANDA_RHCSA_renew
SANJAY_HANDA_RHCSA_renewSanjay Handa
 
URS - implementacja procesu bim
URS  - implementacja procesu bimURS  - implementacja procesu bim
URS - implementacja procesu bimthyforhtian
 

Andere mochten auch (18)

A probabilistic model of visual cryptography Scheme With Dynamic Group
A probabilistic model of visual cryptography Scheme With Dynamic GroupA probabilistic model of visual cryptography Scheme With Dynamic Group
A probabilistic model of visual cryptography Scheme With Dynamic Group
 
Spatial approximate string search
Spatial approximate string searchSpatial approximate string search
Spatial approximate string search
 
2012 - 2013 DOTNET IEEE PROJECT TITLES
2012 - 2013 DOTNET IEEE PROJECT TITLES2012 - 2013 DOTNET IEEE PROJECT TITLES
2012 - 2013 DOTNET IEEE PROJECT TITLES
 
Efficient algorithms for neighbor discovery in wireless networks
Efficient algorithms for neighbor discovery in wireless networksEfficient algorithms for neighbor discovery in wireless networks
Efficient algorithms for neighbor discovery in wireless networks
 
2012 - 2013 bulk ieee projects for sale
2012 - 2013 bulk ieee projects for sale2012 - 2013 bulk ieee projects for sale
2012 - 2013 bulk ieee projects for sale
 
Discovery and verification of neighbor positions in mobile ad hoc networks
Discovery and verification of neighbor positions in mobile ad hoc networksDiscovery and verification of neighbor positions in mobile ad hoc networks
Discovery and verification of neighbor positions in mobile ad hoc networks
 
A Scalable Two-Phase Top-Down Specialization Approach for Data Anonymization ...
A Scalable Two-Phase Top-Down Specialization Approach for Data Anonymization ...A Scalable Two-Phase Top-Down Specialization Approach for Data Anonymization ...
A Scalable Two-Phase Top-Down Specialization Approach for Data Anonymization ...
 
A real time adaptive algorithm for video streaming over multiple wireless acc...
A real time adaptive algorithm for video streaming over multiple wireless acc...A real time adaptive algorithm for video streaming over multiple wireless acc...
A real time adaptive algorithm for video streaming over multiple wireless acc...
 
Allah jalay shan-2 Urdu
Allah jalay shan-2 UrduAllah jalay shan-2 Urdu
Allah jalay shan-2 Urdu
 
Lst 1322489545
Lst 1322489545Lst 1322489545
Lst 1322489545
 
Coletneadeatividades5ano
Coletneadeatividades5ano Coletneadeatividades5ano
Coletneadeatividades5ano
 
Reflexiooon
ReflexiooonReflexiooon
Reflexiooon
 
Itinerari a Vallhonesta
Itinerari a VallhonestaItinerari a Vallhonesta
Itinerari a Vallhonesta
 
Shilpi Sharma Hot Photos
Shilpi Sharma Hot Photos   Shilpi Sharma Hot Photos
Shilpi Sharma Hot Photos
 
Como podemos poupar?
Como podemos poupar?Como podemos poupar?
Como podemos poupar?
 
5 dicas para educar os filhos respeitando a privacidade - A Gazeta 21.06
5 dicas para educar os filhos respeitando a privacidade - A Gazeta 21.065 dicas para educar os filhos respeitando a privacidade - A Gazeta 21.06
5 dicas para educar os filhos respeitando a privacidade - A Gazeta 21.06
 
SANJAY_HANDA_RHCSA_renew
SANJAY_HANDA_RHCSA_renewSANJAY_HANDA_RHCSA_renew
SANJAY_HANDA_RHCSA_renew
 
URS - implementacja procesu bim
URS  - implementacja procesu bimURS  - implementacja procesu bim
URS - implementacja procesu bim
 

Kürzlich hochgeladen

ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...JhezDiaz1
 
Full Stack Web Development Course for Beginners
Full Stack Web Development Course  for BeginnersFull Stack Web Development Course  for Beginners
Full Stack Web Development Course for BeginnersSabitha Banu
 
Science 7 Quarter 4 Module 2: Natural Resources.pptx
Science 7 Quarter 4 Module 2: Natural Resources.pptxScience 7 Quarter 4 Module 2: Natural Resources.pptx
Science 7 Quarter 4 Module 2: Natural Resources.pptxMaryGraceBautista27
 
Q4 English4 Week3 PPT Melcnmg-based.pptx
Q4 English4 Week3 PPT Melcnmg-based.pptxQ4 English4 Week3 PPT Melcnmg-based.pptx
Q4 English4 Week3 PPT Melcnmg-based.pptxnelietumpap1
 
Judging the Relevance and worth of ideas part 2.pptx
Judging the Relevance  and worth of ideas part 2.pptxJudging the Relevance  and worth of ideas part 2.pptx
Judging the Relevance and worth of ideas part 2.pptxSherlyMaeNeri
 
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTiammrhaywood
 
Proudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxProudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxthorishapillay1
 
Grade 9 Q4-MELC1-Active and Passive Voice.pptx
Grade 9 Q4-MELC1-Active and Passive Voice.pptxGrade 9 Q4-MELC1-Active and Passive Voice.pptx
Grade 9 Q4-MELC1-Active and Passive Voice.pptxChelloAnnAsuncion2
 
ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4MiaBumagat1
 
Roles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceRoles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceSamikshaHamane
 
Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17Celine George
 
Gas measurement O2,Co2,& ph) 04/2024.pptx
Gas measurement O2,Co2,& ph) 04/2024.pptxGas measurement O2,Co2,& ph) 04/2024.pptx
Gas measurement O2,Co2,& ph) 04/2024.pptxDr.Ibrahim Hassaan
 
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptxECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptxiammrhaywood
 
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITYISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITYKayeClaireEstoconing
 
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...Postal Advocate Inc.
 
Keynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-designKeynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-designMIPLM
 

Kürzlich hochgeladen (20)

YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptxYOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
 
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
 
Full Stack Web Development Course for Beginners
Full Stack Web Development Course  for BeginnersFull Stack Web Development Course  for Beginners
Full Stack Web Development Course for Beginners
 
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdfTataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
 
Science 7 Quarter 4 Module 2: Natural Resources.pptx
Science 7 Quarter 4 Module 2: Natural Resources.pptxScience 7 Quarter 4 Module 2: Natural Resources.pptx
Science 7 Quarter 4 Module 2: Natural Resources.pptx
 
Q4 English4 Week3 PPT Melcnmg-based.pptx
Q4 English4 Week3 PPT Melcnmg-based.pptxQ4 English4 Week3 PPT Melcnmg-based.pptx
Q4 English4 Week3 PPT Melcnmg-based.pptx
 
Judging the Relevance and worth of ideas part 2.pptx
Judging the Relevance  and worth of ideas part 2.pptxJudging the Relevance  and worth of ideas part 2.pptx
Judging the Relevance and worth of ideas part 2.pptx
 
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
 
Proudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxProudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptx
 
Grade 9 Q4-MELC1-Active and Passive Voice.pptx
Grade 9 Q4-MELC1-Active and Passive Voice.pptxGrade 9 Q4-MELC1-Active and Passive Voice.pptx
Grade 9 Q4-MELC1-Active and Passive Voice.pptx
 
ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4
 
Roles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceRoles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in Pharmacovigilance
 
Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17
 
Gas measurement O2,Co2,& ph) 04/2024.pptx
Gas measurement O2,Co2,& ph) 04/2024.pptxGas measurement O2,Co2,& ph) 04/2024.pptx
Gas measurement O2,Co2,& ph) 04/2024.pptx
 
YOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptx
YOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptxYOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptx
YOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptx
 
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptxECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
 
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITYISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
 
OS-operating systems- ch04 (Threads) ...
OS-operating systems- ch04 (Threads) ...OS-operating systems- ch04 (Threads) ...
OS-operating systems- ch04 (Threads) ...
 
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
 
Keynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-designKeynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-design
 

Mining user queries with markov chains application to online image retrieval

  • 1. Mining User Queries with Markov Chains: Application to Online Image Retrieval ABSTRACT: We propose a novel method for automatic annotation, indexing and annotation- based retrieval of images. The new method, that we call Markovian Semantic Indexing (MSI), is presented in the context of an online image retrieval system. Assuming such a system, the users’ queries are used to construct an Aggregate Markov Chain (AMC) through which the relevance between the keywords seen by the system is defined. The users’ queries are also used to automatically annotate the images. A stochastic distance between images, based on their annotation and the keyword relevance captured in the AMC is then introduced. Geometric interpretations of the proposed distance are provided and its relation to a clustering in the keyword space is investigated. By means of a new measure of Markovian state similarity, the mean first cross passage time (CPT), optimality properties of the proposed distance are proved. Images are modeled as points in a vector space and their similarity is measured with MSI. The new method is shown to possess certain theoretical advantages and also to achieve better Precision versus Recall results when compared to Latent Semantic Indexing (LSI) and probabilistic Latent
  • 2. Semantic Indexing (pLSI) methods in Annotation-Based Image Retrieval (ABIR) tasks. EXISTING SYSTEM: Annotation-Based Image Retrieval (ABIR) systems are an attempt to incorporate more efficient semantic content into both text-based queries and image captions (i.e. Google Image Search, Yahoo! Image Search). The Latent Semantic Indexing (LSI)-based approaches that were initially applied with increased success in document indexing and retrieval were incorporated into the ABIR systems to discover a more reliable conceptassociation. DISADVANTAGES OF EXISTING SYSTEM: While the former gap brings in the issue of users’ interpretations of images and how it is inherently difficult to capture them in visual content, the latter gap makes recognition from image content challenging due to limitations in recording and description capabilities. A reason for this lies in the sparsity of the per-image keyword annotation data in comparison to the number of keywords that are usually assigned to documents.
  • 3. PROPOSED SYSTEM: We introduce the Markovian Semantic Indexing (MSI), a new method for automatic annotation and annotation based image retrieval. The properties of MSI make it particularly suitable for ABIR tasks when the per image annotation data is limited. The characteristics of the method make it also particularly applicable in the context of online image retrieval systems. ADVANTAGES OF PROPOSED SYSTEM: The targeting is more accurate, compared to other systems that use external means of non-dynamic or non-adaptive nature to define keyword relevance. MSI achieves better retrieval results in sparsely annotated image data sets. A comparison to LSI on 64 images gathered from the Google Image Search and annotated in a transparent way by the proposed system, revealed certain advantages for the MSI method, mainly in retrieving images with deeper dependencies than simple keyword co-occurrence SYSTEM REQUIREMENTS: HARDWARE REQUIREMENTS:  System : Pentium IV 2.4 GHz.  Hard Disk : 40 GB.
  • 4.  Monitor : 15 inch VGA Colour.  Mouse : Logitech Mouse.  Ram : 512 MB  Keyboard : Standard Keyboard SOFTWARE REQUIREMENTS:  Operating System : Windows XP.  Coding Language : ASP.NET, C#.Net.  Database : SQL Server 2005 REFERENCE: Konstantinos A. Raftopoulos,Member, IEEE, Klimis S. Ntalianis, Dionyssios D. Sourlas, and Stefanos D. Kollias,Member, IEEE “Mining User Queries with Markov Chains: Application to Online Image Retrieval” - IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, VOL. 25, NO. 2, FEBRUARY2013.