A short history of the Internet and searching on the Internet and World Wide Web.

1. History of Internet
Searching
 Fall, 2015Fall, 2015

2. The Internet
 Built in 1969.Built in 1969.
 Funded by the DoD for scientific research,Funded by the DoD for scientific research,
built by BBN (Bolt, Beranek & Newman)built by BBN (Bolt, Beranek & Newman)
Technologies.Technologies.
 Originally calledOriginally called ARPANETARPANET
 AAdvanceddvanced RResearchesearch PProjectsrojects AAgencygency
 First nodes (connections) were atFirst nodes (connections) were at
universities (UCLA, UCSB, Stanford, Univ.universities (UCLA, UCSB, Stanford, Univ.
of Utah)of Utah)
 First message sent on Oct. 29, 1969 fromFirst message sent on Oct. 29, 1969 from
UCLA to Stanford was “lo”UCLA to Stanford was “lo”..

7. Bolt, Beranek, and Newman (BBN)

8. Ray Tomlinson
Invented Email in 1971.Invented Email in 1971.
Wasn’t supposed to be working on it, he thought it would be aWasn’t supposed to be working on it, he thought it would be a “neat“neat
idea”. Decided to use the @ symbol because it was not being used foridea”. Decided to use the @ symbol because it was not being used for
anything else.anything else.

9. The Internet
Computers that made up the ARPANET wereComputers that made up the ARPANET were
calledcalled IMPIMP’s’s (Internet Message Processor)(Internet Message Processor)
The ‘net is grows by
about one node per
month for first few
years.

14. The Internet
Computers that made up the ARPANET wereComputers that made up the ARPANET were
calledcalled IMPIMP’s’s (Internet Message Processor)(Internet Message Processor)

15. Internet Access Speeds - Personal
 An Internet Service Provider (ISP) providesAn Internet Service Provider (ISP) provides
connection between user and Internet.connection between user and Internet.
 DSL 1.5 MbpsDSL 1.5 Mbps
 Cable 2.5 MbpsCable 2.5 Mbps
 3G Cellular .5 Mbps3G Cellular .5 Mbps
 4G Cellular 10 Mbps - 1 Gbps4G Cellular 10 Mbps - 1 Gbps

16. Internet Access Speeds -
Professional
 T-1T-1 1.544 Mbps
 T-3 43.232 Mbps (28 T1's)
 OC-3 155 Mbps (84 T1's)
 OC-12 622 Mbps (4 OC3's)
 OC-48 2.5 Gbps (4 OC12's)
 OC-192 9.6 Gbps (4 OC48's)

17. Internet Access Speeds – Future
 ConnectionsConnections
 Lasers & Fiber OpticsLasers & Fiber Optics
 BPL (Broadband Over PowerlineBPL (Broadband Over Powerline
 TerabitsTerabits
 Trillion Bits per SecondTrillion Bits per Second

18. Protocols
 Methods of using the Internet:Methods of using the Internet:
 Telnet – Access and Control ComputersTelnet – Access and Control Computers
 FTP – File Transfer ProtocolFTP – File Transfer Protocol
 HTTP – HyperText Transfer ProtocolHTTP – HyperText Transfer Protocol
 Gopher – File Access & DownloadingGopher – File Access & Downloading
 EmailEmail
Uses IMAP, SMTP, or POP.Uses IMAP, SMTP, or POP.

19. History of Internet
Searching
 FTP – File Transfer ProtocolFTP – File Transfer Protocol
 Protocol established in 1985.Protocol established in 1985.
 FTP Servers provide files to FTP ClientsFTP Servers provide files to FTP Clients
Problems with FTP
 No organization of FTP Servers
 User had to know an FTP Server existed
 User had to visit FTP Server to see files

20. History of Internet
Searching
 ARCHIEARCHIE
 1990 (No WWW)1990 (No WWW)
 Alan Emtage @ McGill Univ. inAlan Emtage @ McGill Univ. in
MontrealMontreal
 Searchable directory of FTP filesSearchable directory of FTP files
 Searched FTP Servers and indexed theirSearched FTP Servers and indexed their
filesfiles
 User searched the IndexUser searched the Index


21. History of Internet
Searching
 GopherGopher
 1991 (WWW Began)1991 (WWW Began)
 Paul Lindner & Mark P. McCahill ofPaul Lindner & Mark P. McCahill of
Univ. of MinnesotaUniv. of Minnesota
 Named after the Univ. of Minn. MascotNamed after the Univ. of Minn. Mascot
 Connected Gopher servers through theConnected Gopher servers through the
Gopher hierarchy (gopherspace)Gopher hierarchy (gopherspace)

22. History of Internet
Searching
 WandererWanderer (Matthew Gray(Matthew Gray’s World Wide’s World Wide
Web Wanderer)Web Wanderer)
 First WWW EngineFirst WWW Engine
 Designed to track the size of the WWWDesigned to track the size of the WWW
 Captured URLCaptured URL’s and entered into’s and entered into
database (Wandex)database (Wandex)
 First RobotsFirst Robots “bots”“bots”

23. Search Engine Technology
 Three parts to a Search EngineThree parts to a Search Engine
Bots (Robots)Bots (Robots)
DatabaseDatabase
User InterfaceUser Interface

24. Search Engine Technology
 Bots (Robots)Bots (Robots)
 Also called SpidersAlso called Spiders
 Computer programs sent out by QueryComputer programs sent out by Query
ServersServers
 Search the Internet for serversSearch the Internet for servers
 Identify servers & collect informationIdentify servers & collect information
 Uses links from websites to find otherUses links from websites to find other
sitessites

25. Search Engine Technology
 DatabaseDatabase
 Collects the information from QueryCollects the information from Query
Server and organizes it.Server and organizes it.

26. Search Engine Technology
 User InterfaceUser Interface
 Allows users to search the database andAllows users to search the database and
returns the information from it.returns the information from it.

27. Search Engine Technology
 Relevance RankingRelevance Ranking
 Search engine measures the relevance ofSearch engine measures the relevance of
the information found to your requestthe information found to your request
 First search engine to use RelevanceFirst search engine to use Relevance
Ranking was the Repository-BasedRanking was the Repository-Based
Software Engine (RBSE) in 1993Software Engine (RBSE) in 1993

28. Search Engine Technology
 Relevance Ranking (Techniques)Relevance Ranking (Techniques)
 How often do the search terms appearHow often do the search terms appear
 How close are the search terms to eachHow close are the search terms to each
otherother
 Where do the search terms appearWhere do the search terms appear
 How often do the search terms appearHow often do the search terms appear
compared to the length of the web pagecompared to the length of the web page