SlideShare a Scribd company logo

Web Harvesting Concepts, Issues and Prospects

•
•
De La Salle University Library
De La Salle University Library

Paper presented at PAARL seminar (Villa Escudero, San Pablo City, 27 October 2004) by Vivian del Castillo-Sy

TechnologyDesign
1 of 24
Web-Harvesting
Web-Harvesting ,[object Object],[object Object],[object Object]
Web-Harvesting ,[object Object],[object Object],[object Object]
Concept Web resource Web resource Web resource Web resource Web resource Web resource Web resource Web resource Web resource
Reference to Web Resource ,[object Object]
The Web
The Web
The Web Harvester
3 Major Activities ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Storage
Migration
Retrieval
Developments in Web Archiving ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Web-Harvesting Concept ,[object Object],[object Object],[object Object]
Web-Harvesting ,[object Object],[object Object],[object Object]
Web-Harvesting ,[object Object],[object Object],[object Object]
Issues – Storage ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Issues – Storage ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Issues – Migration ,[object Object],[object Object]
Issues – Retrieval ,[object Object],[object Object],[object Object],[object Object]
Web-Harvesting ,[object Object],[object Object],[object Object]
Web-Harvesting ,[object Object],[object Object],[object Object]
Prospects ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Have a nice day!

Recommended

Webinar@ASIRA: AGRIS: Providing Access to Agricultural Research and Technolog...
Webinar@ASIRA: AGRIS: Providing Access to Agricultural Research and Technolog...Webinar@ASIRA: AGRIS: Providing Access to Agricultural Research and Technolog...
Webinar@ASIRA: AGRIS: Providing Access to Agricultural Research and Technolog...AIMS (Agricultural Information Management Standards)
 
How can you contribute to AGRIS?
How can you contribute to AGRIS?How can you contribute to AGRIS?
How can you contribute to AGRIS?AIMS (Agricultural Information Management Standards)
 
Results of the new AGRIS Vision: Promoting Open Access to Research
Results of the new AGRIS Vision: Promoting Open Access to Research Results of the new AGRIS Vision: Promoting Open Access to Research
Results of the new AGRIS Vision: Promoting Open Access to Research AIMS (Agricultural Information Management Standards)
 
Using AGRIS as a portal of choice to access agricultural research and technol...
Using AGRIS as a portal of choice to access agricultural research and technol...Using AGRIS as a portal of choice to access agricultural research and technol...
Using AGRIS as a portal of choice to access agricultural research and technol...AIMS (Agricultural Information Management Standards)
 
'Building the Legal Deposit E-Journal Archive for the UK' by Andrew MacEwan
'Building the Legal Deposit E-Journal Archive for the UK' by Andrew MacEwan'Building the Legal Deposit E-Journal Archive for the UK' by Andrew MacEwan
'Building the Legal Deposit E-Journal Archive for the UK' by Andrew MacEwanEDINA, University of Edinburgh
 
EXPLOREit@ICRISAT
EXPLOREit@ICRISAT EXPLOREit@ICRISAT
EXPLOREit@ICRISAT ICRISAT
 
Spreading the word: marketing your Trusted Institutional Repository
Spreading the word: marketing your Trusted Institutional RepositorySpreading the word: marketing your Trusted Institutional Repository
Spreading the word: marketing your Trusted Institutional RepositoryAcademy of Science of South Africa (ASSAf)
 
DATAD-R: Criteria for Trusted African Institutional Repositories
DATAD-R: Criteria for Trusted African Institutional RepositoriesDATAD-R: Criteria for Trusted African Institutional Repositories
DATAD-R: Criteria for Trusted African Institutional RepositoriesAcademy of Science of South Africa (ASSAf)
 

Recommended

Webinar@ASIRA: AGRIS: Providing Access to Agricultural Research and Technolog...
Webinar@ASIRA: AGRIS: Providing Access to Agricultural Research and Technolog...Webinar@ASIRA: AGRIS: Providing Access to Agricultural Research and Technolog...
Webinar@ASIRA: AGRIS: Providing Access to Agricultural Research and Technolog...AIMS (Agricultural Information Management Standards)
 
How can you contribute to AGRIS?
How can you contribute to AGRIS?How can you contribute to AGRIS?
How can you contribute to AGRIS?AIMS (Agricultural Information Management Standards)
 
Results of the new AGRIS Vision: Promoting Open Access to Research
Results of the new AGRIS Vision: Promoting Open Access to Research Results of the new AGRIS Vision: Promoting Open Access to Research
Results of the new AGRIS Vision: Promoting Open Access to Research AIMS (Agricultural Information Management Standards)
 
Using AGRIS as a portal of choice to access agricultural research and technol...
Using AGRIS as a portal of choice to access agricultural research and technol...Using AGRIS as a portal of choice to access agricultural research and technol...
Using AGRIS as a portal of choice to access agricultural research and technol...AIMS (Agricultural Information Management Standards)
 
'Building the Legal Deposit E-Journal Archive for the UK' by Andrew MacEwan
'Building the Legal Deposit E-Journal Archive for the UK' by Andrew MacEwan'Building the Legal Deposit E-Journal Archive for the UK' by Andrew MacEwan
'Building the Legal Deposit E-Journal Archive for the UK' by Andrew MacEwanEDINA, University of Edinburgh
 
EXPLOREit@ICRISAT
EXPLOREit@ICRISAT EXPLOREit@ICRISAT
EXPLOREit@ICRISAT ICRISAT
 
Spreading the word: marketing your Trusted Institutional Repository
Spreading the word: marketing your Trusted Institutional RepositorySpreading the word: marketing your Trusted Institutional Repository
Spreading the word: marketing your Trusted Institutional RepositoryAcademy of Science of South Africa (ASSAf)
 
DATAD-R: Criteria for Trusted African Institutional Repositories
DATAD-R: Criteria for Trusted African Institutional RepositoriesDATAD-R: Criteria for Trusted African Institutional Repositories
DATAD-R: Criteria for Trusted African Institutional RepositoriesAcademy of Science of South Africa (ASSAf)
 
Load webinar deposit.final
Load webinar deposit.finalLoad webinar deposit.final
Load webinar deposit.finalSue Hodge
 
‘PERSIST – UNESCO’s Memory of the World Programme as a catalyst for the deba...
‘PERSIST – UNESCO’s Memory of the World Programme as a catalyst for the deba... ‘PERSIST – UNESCO’s Memory of the World Programme as a catalyst for the deba...
‘PERSIST – UNESCO’s Memory of the World Programme as a catalyst for the deba...EDINA, University of Edinburgh
 
Web24dev Icrisat 2
Web24dev Icrisat 2Web24dev Icrisat 2
Web24dev Icrisat 2pritpalkaur
 
AKstem Service: Supporting the AGRIS Network
AKstem Service: Supporting the AGRIS NetworkAKstem Service: Supporting the AGRIS Network
AKstem Service: Supporting the AGRIS NetworkAIMS (Agricultural Information Management Standards)
 
Ariadne: Archiving and Repositories
Ariadne: Archiving and RepositoriesAriadne: Archiving and Repositories
Ariadne: Archiving and Repositoriesariadnenetwork
 
iMarine Services
iMarine ServicesiMarine Services
iMarine ServicesBlue BRIDGE
 
Open Access of Research Data - The Present and Future Situation in Germany
Open Access of Research Data - The Present and Future Situation in GermanyOpen Access of Research Data - The Present and Future Situation in Germany
Open Access of Research Data - The Present and Future Situation in Germanyariadnenetwork
 
Andrew White's Technical Breakfast Club
Andrew White's Technical Breakfast ClubAndrew White's Technical Breakfast Club
Andrew White's Technical Breakfast ClubUnboxed
 
2014-02-27 Wikidata talk Cambridge
2014-02-27 Wikidata talk Cambridge2014-02-27 Wikidata talk Cambridge
2014-02-27 Wikidata talk CambridgeMagnus Manske
 
IPTC Semantic Web 2012 Spring Working Group
IPTC Semantic Web 2012 Spring Working GroupIPTC Semantic Web 2012 Spring Working Group
IPTC Semantic Web 2012 Spring Working GroupStuart Myles
 
ARTiFACTS, Emma Boswood
ARTiFACTS, Emma BoswoodARTiFACTS, Emma Boswood
ARTiFACTS, Emma BoswoodNapier University
 
Integrating Data for Archaeology
Integrating Data for ArchaeologyIntegrating Data for Archaeology
Integrating Data for Archaeologyariadnenetwork
 
The OAIS reference model and archaeological data
The OAIS reference model and archaeological dataThe OAIS reference model and archaeological data
The OAIS reference model and archaeological dataariadnenetwork
 
ICOS: Integrated Carbon Observation System Open data to open our eyes to clim...
ICOS: Integrated Carbon Observation System Open data to open our eyes to clim...ICOS: Integrated Carbon Observation System Open data to open our eyes to clim...
ICOS: Integrated Carbon Observation System Open data to open our eyes to clim...Blue BRIDGE
 
Let's talk about data: Citation and publication
Let's talk about data: Citation and publicationLet's talk about data: Citation and publication
Let's talk about data: Citation and publicationAdam Leadbetter
 
Ag Data Commons for AgBioData
Ag Data Commons for AgBioDataAg Data Commons for AgBioData
Ag Data Commons for AgBioDataCyndy Parr
 
Jisc updates - Jisc research data shared service
Jisc updates - Jisc research data shared service Jisc updates - Jisc research data shared service
Jisc updates - Jisc research data shared service Jisc
 
BIBFRAME on its way
BIBFRAME on its wayBIBFRAME on its way
BIBFRAME on its wayReinhold Heuvelmann
 
Using controlled vocabularies to help organize ILRI’s information products
Using controlled vocabularies to help organize ILRI’s information productsUsing controlled vocabularies to help organize ILRI’s information products
Using controlled vocabularies to help organize ILRI’s information productsILRI
 
IPTC Semantic Web Working Group 2011 Autumn Working Group
IPTC Semantic Web Working Group 2011 Autumn Working GroupIPTC Semantic Web Working Group 2011 Autumn Working Group
IPTC Semantic Web Working Group 2011 Autumn Working GroupStuart Myles
 
Smart Crawler -A Two Stage Crawler For Efficiently Harvesting Deep Web
Smart Crawler -A Two Stage Crawler For Efficiently Harvesting Deep WebSmart Crawler -A Two Stage Crawler For Efficiently Harvesting Deep Web
Smart Crawler -A Two Stage Crawler For Efficiently Harvesting Deep WebS Sai Karthik
 
Rethink Web Harvesting and Scraping
Rethink Web Harvesting and ScrapingRethink Web Harvesting and Scraping
Rethink Web Harvesting and Scrapingscrapeit
 

More Related Content

What's hot

Load webinar deposit.final
Load webinar deposit.finalLoad webinar deposit.final
Load webinar deposit.finalSue Hodge
 
‘PERSIST – UNESCO’s Memory of the World Programme as a catalyst for the deba...
‘PERSIST – UNESCO’s Memory of the World Programme as a catalyst for the deba... ‘PERSIST – UNESCO’s Memory of the World Programme as a catalyst for the deba...
‘PERSIST – UNESCO’s Memory of the World Programme as a catalyst for the deba...EDINA, University of Edinburgh
 
Web24dev Icrisat 2
Web24dev Icrisat 2Web24dev Icrisat 2
Web24dev Icrisat 2pritpalkaur
 
Ariadne: Archiving and Repositories
Ariadne: Archiving and RepositoriesAriadne: Archiving and Repositories
Ariadne: Archiving and Repositoriesariadnenetwork
 
iMarine Services
iMarine ServicesiMarine Services
iMarine ServicesBlue BRIDGE
 
Open Access of Research Data - The Present and Future Situation in Germany
Open Access of Research Data - The Present and Future Situation in GermanyOpen Access of Research Data - The Present and Future Situation in Germany
Open Access of Research Data - The Present and Future Situation in Germanyariadnenetwork
 
Andrew White's Technical Breakfast Club
Andrew White's Technical Breakfast ClubAndrew White's Technical Breakfast Club
Andrew White's Technical Breakfast ClubUnboxed
 
2014-02-27 Wikidata talk Cambridge
2014-02-27 Wikidata talk Cambridge2014-02-27 Wikidata talk Cambridge
2014-02-27 Wikidata talk CambridgeMagnus Manske
 
IPTC Semantic Web 2012 Spring Working Group
IPTC Semantic Web 2012 Spring Working GroupIPTC Semantic Web 2012 Spring Working Group
IPTC Semantic Web 2012 Spring Working GroupStuart Myles
 
Integrating Data for Archaeology
Integrating Data for ArchaeologyIntegrating Data for Archaeology
Integrating Data for Archaeologyariadnenetwork
 
The OAIS reference model and archaeological data
The OAIS reference model and archaeological dataThe OAIS reference model and archaeological data
The OAIS reference model and archaeological dataariadnenetwork
 
ICOS: Integrated Carbon Observation System Open data to open our eyes to clim...
ICOS: Integrated Carbon Observation System Open data to open our eyes to clim...ICOS: Integrated Carbon Observation System Open data to open our eyes to clim...
ICOS: Integrated Carbon Observation System Open data to open our eyes to clim...Blue BRIDGE
 
Let's talk about data: Citation and publication
Let's talk about data: Citation and publicationLet's talk about data: Citation and publication
Let's talk about data: Citation and publicationAdam Leadbetter
 
Ag Data Commons for AgBioData
Ag Data Commons for AgBioDataAg Data Commons for AgBioData
Ag Data Commons for AgBioDataCyndy Parr
 
Jisc updates - Jisc research data shared service
Jisc updates - Jisc research data shared service Jisc updates - Jisc research data shared service
Jisc updates - Jisc research data shared service Jisc
 
Using controlled vocabularies to help organize ILRI’s information products
Using controlled vocabularies to help organize ILRI’s information productsUsing controlled vocabularies to help organize ILRI’s information products
Using controlled vocabularies to help organize ILRI’s information productsILRI
 
IPTC Semantic Web Working Group 2011 Autumn Working Group
IPTC Semantic Web Working Group 2011 Autumn Working GroupIPTC Semantic Web Working Group 2011 Autumn Working Group
IPTC Semantic Web Working Group 2011 Autumn Working GroupStuart Myles
 

What's hot (20)

Load webinar deposit.final
Load webinar deposit.finalLoad webinar deposit.final
Load webinar deposit.final
 
‘PERSIST – UNESCO’s Memory of the World Programme as a catalyst for the deba...
‘PERSIST – UNESCO’s Memory of the World Programme as a catalyst for the deba... ‘PERSIST – UNESCO’s Memory of the World Programme as a catalyst for the deba...
‘PERSIST – UNESCO’s Memory of the World Programme as a catalyst for the deba...
 
Web24dev Icrisat 2
Web24dev Icrisat 2Web24dev Icrisat 2
Web24dev Icrisat 2
 
AKstem Service: Supporting the AGRIS Network
AKstem Service: Supporting the AGRIS NetworkAKstem Service: Supporting the AGRIS Network
AKstem Service: Supporting the AGRIS Network
 
Ariadne: Archiving and Repositories
Ariadne: Archiving and RepositoriesAriadne: Archiving and Repositories
Ariadne: Archiving and Repositories
 
iMarine Services
iMarine ServicesiMarine Services
iMarine Services
 
Open Access of Research Data - The Present and Future Situation in Germany
Open Access of Research Data - The Present and Future Situation in GermanyOpen Access of Research Data - The Present and Future Situation in Germany
Open Access of Research Data - The Present and Future Situation in Germany
 
Andrew White's Technical Breakfast Club
Andrew White's Technical Breakfast ClubAndrew White's Technical Breakfast Club
Andrew White's Technical Breakfast Club
 
2014-02-27 Wikidata talk Cambridge
2014-02-27 Wikidata talk Cambridge2014-02-27 Wikidata talk Cambridge
2014-02-27 Wikidata talk Cambridge
 
IPTC Semantic Web 2012 Spring Working Group
IPTC Semantic Web 2012 Spring Working GroupIPTC Semantic Web 2012 Spring Working Group
IPTC Semantic Web 2012 Spring Working Group
 
ARTiFACTS, Emma Boswood
ARTiFACTS, Emma BoswoodARTiFACTS, Emma Boswood
ARTiFACTS, Emma Boswood
 
Integrating Data for Archaeology
Integrating Data for ArchaeologyIntegrating Data for Archaeology
Integrating Data for Archaeology
 
The OAIS reference model and archaeological data
The OAIS reference model and archaeological dataThe OAIS reference model and archaeological data
The OAIS reference model and archaeological data
 
ICOS: Integrated Carbon Observation System Open data to open our eyes to clim...
ICOS: Integrated Carbon Observation System Open data to open our eyes to clim...ICOS: Integrated Carbon Observation System Open data to open our eyes to clim...
ICOS: Integrated Carbon Observation System Open data to open our eyes to clim...
 
Let's talk about data: Citation and publication
Let's talk about data: Citation and publicationLet's talk about data: Citation and publication
Let's talk about data: Citation and publication
 
Ag Data Commons for AgBioData
Ag Data Commons for AgBioDataAg Data Commons for AgBioData
Ag Data Commons for AgBioData
 
Jisc updates - Jisc research data shared service
Jisc updates - Jisc research data shared service Jisc updates - Jisc research data shared service
Jisc updates - Jisc research data shared service
 
BIBFRAME on its way
BIBFRAME on its wayBIBFRAME on its way
BIBFRAME on its way
 
Using controlled vocabularies to help organize ILRI’s information products
Using controlled vocabularies to help organize ILRI’s information productsUsing controlled vocabularies to help organize ILRI’s information products
Using controlled vocabularies to help organize ILRI’s information products
 
IPTC Semantic Web Working Group 2011 Autumn Working Group
IPTC Semantic Web Working Group 2011 Autumn Working GroupIPTC Semantic Web Working Group 2011 Autumn Working Group
IPTC Semantic Web Working Group 2011 Autumn Working Group
 

Viewers also liked

Smart Crawler -A Two Stage Crawler For Efficiently Harvesting Deep Web
Smart Crawler -A Two Stage Crawler For Efficiently Harvesting Deep WebSmart Crawler -A Two Stage Crawler For Efficiently Harvesting Deep Web
Smart Crawler -A Two Stage Crawler For Efficiently Harvesting Deep WebS Sai Karthik
 
Rethink Web Harvesting and Scraping
Rethink Web Harvesting and ScrapingRethink Web Harvesting and Scraping
Rethink Web Harvesting and Scrapingscrapeit
 
Usage of Technology and Digital Resources in the De La Salle University Library
Usage of Technology and Digital Resources in the De La Salle University LibraryUsage of Technology and Digital Resources in the De La Salle University Library
Usage of Technology and Digital Resources in the De La Salle University LibraryDe La Salle University Library
 
Hummingbird Banding in Paridise, AZ
Hummingbird Banding in Paridise, AZHummingbird Banding in Paridise, AZ
Hummingbird Banding in Paridise, AZtdainsure
 
Colloquim Report on Crawler - 1 Dec 2014
Colloquim Report on Crawler - 1 Dec 2014Colloquim Report on Crawler - 1 Dec 2014
Colloquim Report on Crawler - 1 Dec 2014Sunny Gupta
 
Smart crawlet A two stage crawler for efficiently harvesting deep web interf...
Smart crawlet A two stage crawler for efficiently harvesting deep web interf...Smart crawlet A two stage crawler for efficiently harvesting deep web interf...
Smart crawlet A two stage crawler for efficiently harvesting deep web interf...Rana Jayant
 
M.Tech_Thesis_Presentation
M.Tech_Thesis_PresentationM.Tech_Thesis_Presentation
M.Tech_Thesis_PresentationManish Pillai
 
Biomass supported solar thermal power plant
Biomass supported solar thermal power plantBiomass supported solar thermal power plant
Biomass supported solar thermal power plantA Nagesh Bhat
 

Viewers also liked (20)

Smart Crawler -A Two Stage Crawler For Efficiently Harvesting Deep Web
Smart Crawler -A Two Stage Crawler For Efficiently Harvesting Deep WebSmart Crawler -A Two Stage Crawler For Efficiently Harvesting Deep Web
Smart Crawler -A Two Stage Crawler For Efficiently Harvesting Deep Web
 
Rethink Web Harvesting and Scraping
Rethink Web Harvesting and ScrapingRethink Web Harvesting and Scraping
Rethink Web Harvesting and Scraping
 
Usage of Technology and Digital Resources in the De La Salle University Library
Usage of Technology and Digital Resources in the De La Salle University LibraryUsage of Technology and Digital Resources in the De La Salle University Library
Usage of Technology and Digital Resources in the De La Salle University Library
 
Preaching
PreachingPreaching
Preaching
 
Preaching
PreachingPreaching
Preaching
 
Hummingbird Banding in Paridise, AZ
Hummingbird Banding in Paridise, AZHummingbird Banding in Paridise, AZ
Hummingbird Banding in Paridise, AZ
 
Preaching
PreachingPreaching
Preaching
 
ProQuest Tutorial Revised
ProQuest Tutorial RevisedProQuest Tutorial Revised
ProQuest Tutorial Revised
 
Electronic Resource Management Systems
Electronic Resource Management SystemsElectronic Resource Management Systems
Electronic Resource Management Systems
 
Colloquim Report on Crawler - 1 Dec 2014
Colloquim Report on Crawler - 1 Dec 2014Colloquim Report on Crawler - 1 Dec 2014
Colloquim Report on Crawler - 1 Dec 2014
 
Library Orientation Revised
Library Orientation RevisedLibrary Orientation Revised
Library Orientation Revised
 
Web crawler
Web crawlerWeb crawler
Web crawler
 
Smart crawler a two stage crawler
Smart crawler a two stage crawlerSmart crawler a two stage crawler
Smart crawler a two stage crawler
 
Smart crawlet A two stage crawler for efficiently harvesting deep web interf...
Smart crawlet A two stage crawler for efficiently harvesting deep web interf...Smart crawlet A two stage crawler for efficiently harvesting deep web interf...
Smart crawlet A two stage crawler for efficiently harvesting deep web interf...
 
WebCrawler
WebCrawlerWebCrawler
WebCrawler
 
M.Tech_Thesis_Presentation
M.Tech_Thesis_PresentationM.Tech_Thesis_Presentation
M.Tech_Thesis_Presentation
 
Web crawler
Web crawlerWeb crawler
Web crawler
 
Deep web
Deep webDeep web
Deep web
 
Deep web
Deep webDeep web
Deep web
 
Biomass supported solar thermal power plant
Biomass supported solar thermal power plantBiomass supported solar thermal power plant
Biomass supported solar thermal power plant
 

Similar to Web Harvesting Concepts, Issues and Prospects

Creating and Maintaining Web Archives
Creating and Maintaining Web ArchivesCreating and Maintaining Web Archives
Creating and Maintaining Web ArchivesMARAC Bethlehem PC
 
Web Archiving Intro (circa 2015)
Web Archiving Intro (circa 2015)Web Archiving Intro (circa 2015)
Web Archiving Intro (circa 2015)Anna Perricci
 
The development of web archiving 3
The development of web archiving 3The development of web archiving 3
The development of web archiving 3Essam Obaid
 
Web archiving challenges and opportunities
Web archiving challenges and opportunitiesWeb archiving challenges and opportunities
Web archiving challenges and opportunitiesAhmed AlSum
 
Tools for Managing the Past Web
Tools for Managing the Past WebTools for Managing the Past Web
Tools for Managing the Past WebMichele Weigle
 
"Woe, Destruction, Ruin, and Decay:" An Introduction to Web Archiving
"Woe, Destruction, Ruin, and Decay:" An Introduction to Web Archiving"Woe, Destruction, Ruin, and Decay:" An Introduction to Web Archiving
"Woe, Destruction, Ruin, and Decay:" An Introduction to Web Archivingjaime916
 
Progress Made and Lessons Learned through Collaborative Web Archiving Proj...
Progress Made and Lessons Learned through Collaborative Web Archiving Proj...Progress Made and Lessons Learned through Collaborative Web Archiving Proj...
Progress Made and Lessons Learned through Collaborative Web Archiving Proj...Anna Perricci
 
CORE Repositories Dashboard
CORE Repositories DashboardCORE Repositories Dashboard
CORE Repositories DashboardNancy Pontika
 
Analytics and Access to the UK web archive
Analytics and Access to the UK web archiveAnalytics and Access to the UK web archive
Analytics and Access to the UK web archiveLewis Crawford
 
Detecting Off-Topic Pages in Web Archives
Detecting Off-Topic Pages in Web ArchivesDetecting Off-Topic Pages in Web Archives
Detecting Off-Topic Pages in Web ArchivesYasmin AlNoamany, PhD
 
Tuesday 5 May 2020: Contextualizing and engaging with Web domains, Valérie Sc...
Tuesday 5 May 2020: Contextualizing and engaging with Web domains, Valérie Sc...Tuesday 5 May 2020: Contextualizing and engaging with Web domains, Valérie Sc...
Tuesday 5 May 2020: Contextualizing and engaging with Web domains, Valérie Sc...WARCnet
 
Answers to usual issues in getting started with consuming Linked Data
Answers to usual issues in getting started with consuming Linked DataAnswers to usual issues in getting started with consuming Linked Data
Answers to usual issues in getting started with consuming Linked DataOlaf Hartig
 
eHive Open Day - London November 2010
eHive Open Day - London November 2010eHive Open Day - London November 2010
eHive Open Day - London November 2010Paul Rowe
 
Lsr vpresntation
Lsr vpresntationLsr vpresntation
Lsr vpresntationjarcherumd
 
Digital Infrastructure: Storage and Content Management
Digital Infrastructure: Storage and Content ManagementDigital Infrastructure: Storage and Content Management
Digital Infrastructure: Storage and Content ManagementNoreen Whysel
 
Slides anu talkwebarchivingaug2012
Slides anu talkwebarchivingaug2012Slides anu talkwebarchivingaug2012
Slides anu talkwebarchivingaug2012Roxanne Missingham
 

Similar to Web Harvesting Concepts, Issues and Prospects (20)

Creating and Maintaining Web Archives
Creating and Maintaining Web ArchivesCreating and Maintaining Web Archives
Creating and Maintaining Web Archives
 
Web Archiving Intro (circa 2015)
Web Archiving Intro (circa 2015)Web Archiving Intro (circa 2015)
Web Archiving Intro (circa 2015)
 
The development of web archiving 3
The development of web archiving 3The development of web archiving 3
The development of web archiving 3
 
Web archiving challenges and opportunities
Web archiving challenges and opportunitiesWeb archiving challenges and opportunities
Web archiving challenges and opportunities
 
November 19, 2014 NISO Virtual Conference: Can't We All Work Together?: Inter...
November 19, 2014 NISO Virtual Conference: Can't We All Work Together?: Inter...November 19, 2014 NISO Virtual Conference: Can't We All Work Together?: Inter...
November 19, 2014 NISO Virtual Conference: Can't We All Work Together?: Inter...
 
Tools for Managing the Past Web
Tools for Managing the Past WebTools for Managing the Past Web
Tools for Managing the Past Web
 
5463 26 web mining
5463 26 web mining5463 26 web mining
5463 26 web mining
 
"Woe, Destruction, Ruin, and Decay:" An Introduction to Web Archiving
"Woe, Destruction, Ruin, and Decay:" An Introduction to Web Archiving"Woe, Destruction, Ruin, and Decay:" An Introduction to Web Archiving
"Woe, Destruction, Ruin, and Decay:" An Introduction to Web Archiving
 
Progress Made and Lessons Learned through Collaborative Web Archiving Proj...
Progress Made and Lessons Learned through Collaborative Web Archiving Proj...Progress Made and Lessons Learned through Collaborative Web Archiving Proj...
Progress Made and Lessons Learned through Collaborative Web Archiving Proj...
 
CORE Repositories Dashboard
CORE Repositories DashboardCORE Repositories Dashboard
CORE Repositories Dashboard
 
Analytics and Access to the UK web archive
Analytics and Access to the UK web archiveAnalytics and Access to the UK web archive
Analytics and Access to the UK web archive
 
Internet content as research data
Internet content as research dataInternet content as research data
Internet content as research data
 
Detecting Off-Topic Pages in Web Archives
Detecting Off-Topic Pages in Web ArchivesDetecting Off-Topic Pages in Web Archives
Detecting Off-Topic Pages in Web Archives
 
Tuesday 5 May 2020: Contextualizing and engaging with Web domains, Valérie Sc...
Tuesday 5 May 2020: Contextualizing and engaging with Web domains, Valérie Sc...Tuesday 5 May 2020: Contextualizing and engaging with Web domains, Valérie Sc...
Tuesday 5 May 2020: Contextualizing and engaging with Web domains, Valérie Sc...
 
Answers to usual issues in getting started with consuming Linked Data
Answers to usual issues in getting started with consuming Linked DataAnswers to usual issues in getting started with consuming Linked Data
Answers to usual issues in getting started with consuming Linked Data
 
eHive Open Day - London November 2010
eHive Open Day - London November 2010eHive Open Day - London November 2010
eHive Open Day - London November 2010
 
Lsr vpresntation
Lsr vpresntationLsr vpresntation
Lsr vpresntation
 
Digital Infrastructure: Storage and Content Management
Digital Infrastructure: Storage and Content ManagementDigital Infrastructure: Storage and Content Management
Digital Infrastructure: Storage and Content Management
 
Web content mining
Web content miningWeb content mining
Web content mining
 
Slides anu talkwebarchivingaug2012
Slides anu talkwebarchivingaug2012Slides anu talkwebarchivingaug2012
Slides anu talkwebarchivingaug2012
 

More from De La Salle University Library

Technical Competencies of Health Librarians in a Library 2.0 Environment
Technical Competencies of Health Librarians in a Library 2.0 EnvironmentTechnical Competencies of Health Librarians in a Library 2.0 Environment
Technical Competencies of Health Librarians in a Library 2.0 EnvironmentDe La Salle University Library
 
De La Salle University Library System Migration: a Strategic Decision
De La Salle University Library System Migration: a Strategic DecisionDe La Salle University Library System Migration: a Strategic Decision
De La Salle University Library System Migration: a Strategic DecisionDe La Salle University Library
 
Knowledge Management: the De La Salle University-Manila Library’s Experience
Knowledge Management: the De La Salle University-Manila Library’s ExperienceKnowledge Management: the De La Salle University-Manila Library’s Experience
Knowledge Management: the De La Salle University-Manila Library’s ExperienceDe La Salle University Library
 

More from De La Salle University Library (6)

Technical Competencies of Health Librarians in a Library 2.0 Environment
Technical Competencies of Health Librarians in a Library 2.0 EnvironmentTechnical Competencies of Health Librarians in a Library 2.0 Environment
Technical Competencies of Health Librarians in a Library 2.0 Environment
 
De La Salle University Library System Migration: a Strategic Decision
De La Salle University Library System Migration: a Strategic DecisionDe La Salle University Library System Migration: a Strategic Decision
De La Salle University Library System Migration: a Strategic Decision
 
Collaborative Cataloging
Collaborative CatalogingCollaborative Cataloging
Collaborative Cataloging
 
Proquest Tutorial
Proquest TutorialProquest Tutorial
Proquest Tutorial
 
Cataloging At The De La Salle University Library
Cataloging At The De La Salle University LibraryCataloging At The De La Salle University Library
Cataloging At The De La Salle University Library
 
Knowledge Management: the De La Salle University-Manila Library’s Experience
Knowledge Management: the De La Salle University-Manila Library’s ExperienceKnowledge Management: the De La Salle University-Manila Library’s Experience
Knowledge Management: the De La Salle University-Manila Library’s Experience
 

Recently uploaded

Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piececharlottematthew16
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clashcharlottematthew16
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostZilliz
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfRankYa
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 

Recently uploaded (20)

Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clash
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdf
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 

Web Harvesting Concepts, Issues and Prospects