Diese Präsentation wurde erfolgreich gemeldet.
Wir verwenden Ihre LinkedIn Profilangaben und Informationen zu Ihren Aktivitäten, um Anzeigen zu personalisieren und Ihnen relevantere Inhalte anzuzeigen. Sie können Ihre Anzeigeneinstellungen jederzeit ändern.
The heart of search engine - Inverted Index
It is the foundation of the search engine.
When you want to build search engin...
Step 01
Build an index by crawling the web
e.g. Selenium occurs on which all sites. In order to build an Inverted Index we...
Step 02
Build an inverted index
www.abc.com Training provided on Selenium BigData Hadoop
www.xyz.com Trainings provided on...
Step 03
Given a search term, look up the inverted index for the relevant webpages
Training www.abc.com, www.xyz.com, www.d...
Building an Inverted Index `
www.abc.com Selenium BigData Hadoop
www.xyz.com ApacheSpark Scala J2EE Selenium
www.def.com J...
Building an Inverted Index `
Reduce
Selenium [www.abc.com www.xyz.com www.def.com]
BigData [ www.abc.com ]
ApacheSpark www...
The heart of search engine  Inverted index
Nächste SlideShare
Wird geladen in …5
×

The heart of search engine Inverted index

276 Aufrufe

Veröffentlicht am

The heart of search engine Inverted index

Veröffentlicht in: Software
  • Als Erste(r) kommentieren

  • Gehören Sie zu den Ersten, denen das gefällt!

The heart of search engine Inverted index

  1. 1. The heart of search engine - Inverted Index It is the foundation of the search engine. When you want to build search engine such as yahoo, google at the core of the search engine it lays an Inverted Index. 1 Building an index by crawling the web. 2 Building an inverted index. 3 Lookup the Inverted Index for relevant webpages Steps involved in building Inverted Index www.npntraining.com/courses/big-data-and-hadoop.php
  2. 2. Step 01 Build an index by crawling the web e.g. Selenium occurs on which all sites. In order to build an Inverted Index we have to crawl the webpages from the web and store them along with their contents. www.abc.com Training provided on Selenium Big Data Hadoop www.xyz.com Trainings provided on Apache Spark Scala J2EE www.def.com Training provided on Java J2EE Python Selenium This is an index of webpages and their contents www.npntraining.com/courses/big-data-and-hadoop.php
  3. 3. Step 02 Build an inverted index www.abc.com Training provided on Selenium BigData Hadoop www.xyz.com Trainings provided on Apache Spark Scala J2EE www.def.com Training provided on Java J2EE Python Selenium This is an index of webpages and their contents Training www.abc.com, www.xyz.com, www.def.com BigData www.abc.com Spark www.xyz.com J2EE www.xyz.com, www.def.com Build an index of words to webpages they appear in www.npntraining.com/courses/big-data-and-hadoop.php
  4. 4. Step 03 Given a search term, look up the inverted index for the relevant webpages Training www.abc.com, www.xyz.com, www.def.com Big Data www.abc.com Spark www.xyz.com J2EE www.xyz.com, www.def.com Build an index of words to webpages they appear in www.npntraining.com/courses/big-data-and-hadoop.php
  5. 5. Building an Inverted Index ` www.abc.com Selenium BigData Hadoop www.xyz.com ApacheSpark Scala J2EE Selenium www.def.com Java J2EE Python Selenium Map Selenium www.abc.com Selenium ww.xyz.com Selenium www.def.com BigData www.abc.com ApacheSpark www.def.com Spark www.xyz.com Scala www.xyz.com J2EE www.xyz.com J2EE www.def.com Python www.def.com www.npntraining.com/courses/big-data-and-hadoop.php
  6. 6. Building an Inverted Index ` Reduce Selenium [www.abc.com www.xyz.com www.def.com] BigData [ www.abc.com ] ApacheSpark www.def.com Spark www.xyz.com Scala www.xyz.com J2EE [ www.xyz.com www.def.com ] Python www.def.com Selenium www.abc.com|www.xyz.com|www.def.com BigData www.abc.com ApacheSpark www.def.com Spark www.xyz.com Scala www.xyz.com J2EE www.xyz.com|www.def.com Python www.def.com

×