2. Summary
First, crawler or spider get document and URLs
and send them indexing software.
Second, software receives them and indexes
their information.
Next, type words on the web page.
Finally, database show the results as pages, or
files.
4. Crawler or Spider
Have set of rules guide about gathering
documents.
Taking from several seconds to many minutes
to find owing to the size of the sites.
Take software agents get documents and
URLs and send them to indexing software as
discovering them.