SlideShare ist ein Scribd-Unternehmen logo
1 von 87
Telling Stories with Web Archives
Dr. Michele C. Weigle
Web Sciences and Digital Libraries (WS-DL) Lab
Department of Computer Science
Old Dominion University
Norfolk, VA
Includes joint work with Dr. Michael L. Nelson and our PhD students, Scott Ainsworth, Yasmin
AlNoamany, Ahmed AlSum, Justin Brunelle, Mat Kelly, Hany SalahEldeen

Southeast Women in Computing Conference
November 16, 2013
Outline
• What is a web archive?

• Why are archives important?
• What's my story?
• How can we help others tell their stories?

• Related WS-DL Projects
Southeast Women in Computing Conference - Nov 16, 2013

#SEWIC2013
What is a web archive?

Southeast Women in Computing Conference - Nov 16, 2013
What are some web archives?

Southeast Women in Computing Conference - Nov 16, 2013
How can I access the archives?
MementoFox

Memento for Chrome

http://www.mementoweb.org/

http://ws-dl.blogspot.com/2010/03/2010-03-19-mementofox-add-on-released.html
http://ws-dl.blogspot.com/2013/10/2013-10-14-right-click-to-past-memento.html

Southeast Women in Computing Conference - Nov 16, 2013
Outline
• What is a web archive?

• Why are archives important?
• What's my story?
• How can we help others tell their stories?

• Related WS-DL Projects
Southeast Women in Computing Conference - Nov 16, 2013
The Web holds our stories

Southeast Women in Computing Conference - Nov 16, 2013
But webpages can disappear

• Average lifespan of a webpage - 50-100 days
• A year after publication, about 11% of content
shared on social media will be gone.
SalahEldeen and Nelson, "Losing My Revolution: How Many Resources Shared on Social Media Have Been Lost?", TPDL 2012
http://ws-dl.blogspot.com/2012/02/2012-02-11-losing-my-revolution-year.html
Southeast Women in Computing Conference - Nov 16, 2013
But maybe it's archived

Ainsworth, AlSum, SalahEldeen, Weigle, and Nelson, "How Much of the Web is Archived?", JCDL 2011
http://ws-dl.blogspot.com/2011/06/2011-06-23-how-much-of-web-is-archived.html
Southeast Women in Computing Conference - Nov 16, 2013
But social media is hard to archive

Southeast Women in Computing Conference - Nov 16, 2013
Our Research Group Goals
• We believe that web archives are valuable
cultural resources, and we want everyone to
know about them.
• We want to make it easy for people to bridge
the gap between the live web and the archives.
• We believe that replaying the past is more
compelling than reading a summary.
Southeast Women in Computing Conference - Nov 16, 2013
vs.

Southeast Women in Computing Conference - Nov 16, 2013
Replaying the past can be
more compelling than just a
summary

Southeast Women in Computing Conference - Nov 16, 2013
Outline
• What is a web archive?

• Why are archives important?
• What's my story?
• How can we help others tell their stories?

• Related WS-DL Projects
Southeast Women in Computing Conference - Nov 16, 2013
What's My Story?
• As another illustration, I'll tell you a little bit
more about myself ...
• ... using the Internet Archive

Southeast Women in Computing Conference - Nov 16, 2013
NLU - 1997

Southeast Women in Computing Conference - Nov 16, 2013
UNC-CS - 1997

Southeast Women in Computing Conference - Nov 16, 2013
My CS Homepage - 1997

Southeast Women in Computing Conference - Nov 16, 2013
CS Student Assoc Pres - 1999

Southeast Women in Computing Conference - Nov 16, 2013
Teaching - 2000

Southeast Women in Computing Conference - Nov 16, 2013
Finding gems in the archive

Southeast Women in Computing Conference - Nov 16, 2013
My Research - 2002

Southeast Women in Computing Conference - Nov 16, 2013
Married, Graduated, and Teaching - 2003

Southeast Women in Computing Conference - Nov 16, 2013
Faculty Position at Clemson - 2004

Southeast Women in Computing Conference - Nov 16, 2013
Clemson missing captures

Southeast Women in Computing Conference - Nov 16, 2013
Proof I was there - 2006

Southeast Women in Computing Conference - Nov 16, 2013
Faculty Position at ODU - 2006

Southeast Women in Computing Conference - Nov 16, 2013
Vehicular Networks - 2006

Southeast Women in Computing Conference - Nov 16, 2013
1st PhD Student Graduated - 2010

Southeast Women in Computing Conference - Nov 16, 2013
InfoVis, Work with WS-DL - 2011

Southeast Women in Computing Conference - Nov 16, 2013
Telling My Story
• Going through the archive was a lot of fun.
• But, it wasn't always easy.
• Today, I might want to incorporate Facebook
and Twitter posts in my story. Not saved at
Internet Archive. =(

• Let's make this easy to do for everyone.
Southeast Women in Computing Conference - Nov 16, 2013
Outline
• What is a web archive?

• Why are archives important?
• What's my story?
• How can we help others tell their stories?

• Related WS-DL Projects
Southeast Women in Computing Conference - Nov 16, 2013
Project Overview
• Project forms the PhD work of Yasmin
AlNoamany, ideas in early stages
• Joins my interests in measurement, web
science, information visualization.
– measurement - how do people use web archives?
– web science - how can we analyze web archives to
find pages related to live web pages?
– info vis - how can we present the stories that we
have harvested from the archive?
Southeast Women in Computing Conference - Nov 16, 2013
How do people use web archives?
• We obtained a year's worth (2012) of requests
to the Internet Archive's Wayback Machine
– client IPs anonymized

Southeast Women in Computing Conference - Nov 16, 2013
How do people use web archives?
• First, there are a lot of robots (aka bots) who
access the archive
– 10 bot sessions for every 1 human session
– maybe people don't know about the archive?

• Typical human sessions are pretty short
– people aren't spending lots of time in the archive
– it took me over an hour of walking through the archive
to build my story
– maybe people who do know about the archive aren't
using it to build stories?
AlNoamany, Weigle, and Nelson, "Access Patterns for Robots and Humans in Web Archives", JCDL 2013
Southeast Women in Computing Conference - Nov 16, 2013
How do people use web archives?
• 65% of the requested archived pages no longer
exist on the live web
• People use the archive because the pages they
are interested in no longer exist
– like most of my examples from my story

AlNoamany, AlSum, Weigle, and Nelson, "Who and What Links to the Internet Archive", IJDL, to appear, 2013
Southeast Women in Computing Conference - Nov 16, 2013
Helping Others Tell Stories
• How can we use this information to help
people tell stories?
• How do people tell stories?
• What tools do they use today?

Southeast Women in Computing Conference - Nov 16, 2013
Egyptian Revolution on Storify

Southeast Women in Computing Conference - Nov 16, 2013
Bookmarking is not preserving

Southeast Women in Computing Conference - Nov 16, 2013
How do people tell stories?
• There are three levels of information:
– overview
– recent events
– story definition and replay

Southeast Women in Computing Conference - Nov 16, 2013
Overview

Southeast Women in Computing Conference - Nov 16, 2013
Overview

Southeast Women in Computing Conference - Nov 16, 2013
Recent Events

Southeast Women in Computing Conference - Nov 16, 2013
Recent Events

Southeast Women in Computing Conference - Nov 16, 2013
Story Replay

Southeast Women in Computing Conference - Nov 16, 2013
Story Replay

Not yet
addressed
Southeast Women in Computing Conference - Nov 16, 2013
Research Questions
How do we
• define the time frame of a story?
• define the individual events that make up
a story?
• identify, evaluate, and select candidate
archived web pages to support the events
of the story?
• visualize the resulting story?
Southeast Women in Computing Conference - Nov 16, 2013
Define the Time Frame of a Story
• People remember the name of the story, but not
the date
– Hurricane Katrina - Aug 29, 2005
– 2011 Egyptian Revolution - Jan 25, 2011
– Boston Marathon Bombing - April 15, 2013

• Some stories have no definitive beginning/ending
– BP Gulf Oil Spill - April 20 - September? 2010 effects, court cases still ongoing
– Egyptian Revolution - which one? (1952, 2011, 2013)
Southeast Women in Computing Conference - Nov 16, 2013
Define the Time Frame of a Story
• Propose candidate times based on user query

Southeast Women in Computing Conference - Nov 16, 2013
Define a Story's Events
• Consult hand-crafted
timelines
• User-provided timelines

• Detect themes in relevant
archived web pages

Southeast Women in Computing Conference - Nov 16, 2013
Identify Relevant Archived Web Pages
• Identify "seed URIs" and query the archive for
their existence during the appropriate time
– also query for URIs linked from the seed URIs

• How to identify seed URIs?
– wikipedia
– news sites
– social media (tweets, Facebook shares)
– Storify
Southeast Women in Computing Conference - Nov 16, 2013
Different sources will provide
different seed URIs

Southeast Women in Computing Conference - Nov 16, 2013
What about social media pages?

Southeast Women in Computing Conference - Nov 16, 2013
Create your own Facebook archive
• May need to
allow for usercontributed
content

Kelly, Nelson, and Weigle, "WARCreate and WAIL: WARC, Wayback, and Heritrix Made Easy," Demo at Digital Preservation 2013.
http://ws-dl.blogspot.com/2013/07/2013-07-10-warcreate-and-wail-warc.html
Southeast Women in Computing Conference - Nov 16, 2013
Suppose we found 100 relevant pages
for each event in the story

I’ll add here many copies from bbc, nytimes,
foxnews

Southeast Women in Computing Conference - Nov 16, 2013
Evaluate Relevant Archived Web Pages
• Are there duplicate accounts?
• What is the reputation, bias, or point of view
of the source?
• How well was the page archived?

Southeast Women in Computing Conference - Nov 16, 2013
Duplication

Southeast Women in Computing Conference - Nov 16, 2013
Reputation of Source

Southeast Women in Computing Conference - Nov 16, 2013
Quality of Archived Page

Southeast Women in Computing Conference - Nov 16, 2013
Select Relevant Archived Web Pages
• User will select pages to use in the final story
• But user needs to be presented with some
choices

Southeast Women in Computing Conference - Nov 16, 2013
Selecting Relevant Pages
Mubarak's Resignation

Southeast Women in Computing Conference - Nov 16, 2013
Visualize the Story
• Provide different interactive visualizations that
enable exploring the story easily
• Provide the user with the ability to modify the
story and specify the start and end dates

Southeast Women in Computing Conference - Nov 16, 2013
Using Storify

Southeast Women in Computing Conference - Nov 16, 2013
Interactive Timeline
Replaying Story of Egyptian Revolution

Southeast Women in Computing Conference - Nov 16, 2013
Slideshow
• Different View

Southeast Women in Computing Conference - Nov 16, 2013
Research Questions
How do we
• define the time frame of a story?
• define the individual events that make up
a story?
• identify, evaluate, and select candidate
archived web pages to support the events
of the story?
• visualize the resulting story?
Southeast Women in Computing Conference - Nov 16, 2013
Outline
• What is a web archive?

• Why are archives important?
• What's my story?
• How can we help others tell their stories?

• Related WS-DL Projects
Southeast Women in Computing Conference - Nov 16, 2013
User Access Patterns

AlNoamany, Weigle, and Nelson, "Access Patterns for Robots and Humans in Web Archives", JCDL 2013
Southeast Women in Computing Conference - Nov 16, 2013
Everybody Dips, Humans Dive, Robots Skim

Robots (34,203 sessions)

Humans (3,431 sessions)

AlNoamany, Weigle, and Nelson, "Access Patterns for Robots and Humans in Web Archives", JCDL 2013
Southeast Women in Computing Conference - Nov 16, 2013
What domains does each archive hold?

AlSum, Weigle, Nelson and Van de Sompel, "Profiling Web Archive Coverage for Top-Level Domain and Content Language," TPDL 2013.

Southeast Women in Computing Conference - Nov 16, 2013
What domains does each archive hold?

AlSum, Weigle, Nelson and Van de Sompel, "Profiling Web Archive Coverage for Top-Level Domain and Content Language," TPDL 2013.

Southeast Women in Computing Conference - Nov 16, 2013
Sometimes the live web "leaks" into
the archive
Sept 3, 2008

2012

http://ws-dl.blogspot.com/2012/10/2012-10-10-zombies-in-archives.html
Southeast Women in Computing Conference - Nov 16, 2013
ODU's WS-DL Group

ODU

You are here

Southeast Women in Computing Conference - Nov 16, 2013
ODU's WS-DL Group
• Our recent work has been featured in the popular press

• We're always looking for more great students!
Dr. Michele C. Weigle
Old Dominion University
Norfolk, VA
mweigle@cs.odu.edu
@weiglemc
http://www.cs.odu.edu/~mweigle/
http://ws-dl.blogspot.com/
Southeast Women in Computing Conference - Nov 16, 2013

Weitere ähnliche Inhalte

Was ist angesagt?

Improving Understanding of Web Archive Collections Through Storytelling - PhD...
Improving Understanding of Web Archive Collections Through Storytelling - PhD...Improving Understanding of Web Archive Collections Through Storytelling - PhD...
Improving Understanding of Web Archive Collections Through Storytelling - PhD...
Shawn Jones
 
Social Cards Probably Provide For Better Understanding Of Web Archive Collect...
Social Cards Probably Provide For Better Understanding Of Web Archive Collect...Social Cards Probably Provide For Better Understanding Of Web Archive Collect...
Social Cards Probably Provide For Better Understanding Of Web Archive Collect...
Shawn Jones
 

Was ist angesagt? (20)

Improving Understanding of Web Archive Collections Through Storytelling - PhD...
Improving Understanding of Web Archive Collections Through Storytelling - PhD...Improving Understanding of Web Archive Collections Through Storytelling - PhD...
Improving Understanding of Web Archive Collections Through Storytelling - PhD...
 
Where Can We Post Stories Summarizing Web Archive Collections
Where Can We Post Stories Summarizing Web Archive CollectionsWhere Can We Post Stories Summarizing Web Archive Collections
Where Can We Post Stories Summarizing Web Archive Collections
 
Social Cards Probably Provide For Better Understanding Of Web Archive Collect...
Social Cards Probably Provide For Better Understanding Of Web Archive Collect...Social Cards Probably Provide For Better Understanding Of Web Archive Collect...
Social Cards Probably Provide For Better Understanding Of Web Archive Collect...
 
WS-DL’s Work towards Enabling Personal Use of Web Archives
WS-DL’s Work towards Enabling Personal Use of Web ArchivesWS-DL’s Work towards Enabling Personal Use of Web Archives
WS-DL’s Work towards Enabling Personal Use of Web Archives
 
Characteristics of Social Media Stories
Characteristics of Social Media StoriesCharacteristics of Social Media Stories
Characteristics of Social Media Stories
 
Visualizing Digital Collections at Archive-It
Visualizing Digital Collections at Archive-ItVisualizing Digital Collections at Archive-It
Visualizing Digital Collections at Archive-It
 
Detecting Off-Topic Pages in Web Archives
Detecting Off-Topic Pages in Web ArchivesDetecting Off-Topic Pages in Web Archives
Detecting Off-Topic Pages in Web Archives
 
Detecting Off-Topic Pages in Web Archives
Detecting Off-Topic Pages in Web ArchivesDetecting Off-Topic Pages in Web Archives
Detecting Off-Topic Pages in Web Archives
 
Bootstrapping Web Archive Collections of Stories from Micro-collections in S...
Bootstrapping Web Archive Collections  of Stories from Micro-collections in S...Bootstrapping Web Archive Collections  of Stories from Micro-collections in S...
Bootstrapping Web Archive Collections of Stories from Micro-collections in S...
 
Storytelling for Summarizing Collections in Web Archives
Storytelling for Summarizing Collections in Web ArchivesStorytelling for Summarizing Collections in Web Archives
Storytelling for Summarizing Collections in Web Archives
 
Linked Data and Discovery with Steve Meyer
Linked Data and Discovery with Steve MeyerLinked Data and Discovery with Steve Meyer
Linked Data and Discovery with Steve Meyer
 
Summarizing archival collections using storytelling techniques
Summarizing archival collections using storytelling techniquesSummarizing archival collections using storytelling techniques
Summarizing archival collections using storytelling techniques
 
Using Web Archives to Enrich the Live Web Experience Through Storytelling
Using Web Archives to Enrich  the Live Web Experience Through StorytellingUsing Web Archives to Enrich  the Live Web Experience Through Storytelling
Using Web Archives to Enrich the Live Web Experience Through Storytelling
 
Wikipedia: Why? Who? and How?
Wikipedia: Why? Who? and How?Wikipedia: Why? Who? and How?
Wikipedia: Why? Who? and How?
 
From Frenemies to Friends: Embracing Wikipedia
From Frenemies to Friends: Embracing WikipediaFrom Frenemies to Friends: Embracing Wikipedia
From Frenemies to Friends: Embracing Wikipedia
 
Who, What, Where,Why and How
Who, What, Where,Why and HowWho, What, Where,Why and How
Who, What, Where,Why and How
 
Angela Dresselhaus
Angela DresselhausAngela Dresselhaus
Angela Dresselhaus
 
Interoperability and Its Role In Standardization, Plus A ResourceSync Overview
Interoperability and Its Role In Standardization, Plus A ResourceSync OverviewInteroperability and Its Role In Standardization, Plus A ResourceSync Overview
Interoperability and Its Role In Standardization, Plus A ResourceSync Overview
 
Robust Linking to Web Resources
Robust Linking to Web ResourcesRobust Linking to Web Resources
Robust Linking to Web Resources
 
An Institutional Perspective to Rescue Scholarly Orphans
An Institutional Perspective to Rescue Scholarly OrphansAn Institutional Perspective to Rescue Scholarly Orphans
An Institutional Perspective to Rescue Scholarly Orphans
 

Andere mochten auch (6)

Archive What I See Now - Archive-It Partner Meeting 2013 2013
Archive What I See Now - Archive-It Partner Meeting 2013 2013Archive What I See Now - Archive-It Partner Meeting 2013 2013
Archive What I See Now - Archive-It Partner Meeting 2013 2013
 
HATEOAS: The Confusing Bit from REST
HATEOAS: The Confusing Bit from RESTHATEOAS: The Confusing Bit from REST
HATEOAS: The Confusing Bit from REST
 
Fun with Archives (Victorian Edition)
Fun with Archives (Victorian Edition)Fun with Archives (Victorian Edition)
Fun with Archives (Victorian Edition)
 
Why HATEOAS
Why HATEOASWhy HATEOAS
Why HATEOAS
 
The time for Libraries is NOW
The time for Libraries is NOWThe time for Libraries is NOW
The time for Libraries is NOW
 
Improve Your Library: Using the 5 Phases of Project Management (February 2017)
Improve Your Library: Using the 5 Phases of Project Management (February 2017)Improve Your Library: Using the 5 Phases of Project Management (February 2017)
Improve Your Library: Using the 5 Phases of Project Management (February 2017)
 

Ähnlich wie Telling Stories with Web Archives

Charleston 2013: The Social Side of Research
Charleston 2013: The Social Side of ResearchCharleston 2013: The Social Side of Research
Charleston 2013: The Social Side of Research
William Gunn
 

Ähnlich wie Telling Stories with Web Archives (20)

Library Collection Development -- Class 2 -- Community Assessment
Library Collection Development -- Class 2 -- Community AssessmentLibrary Collection Development -- Class 2 -- Community Assessment
Library Collection Development -- Class 2 -- Community Assessment
 
Bits of Research
Bits of ResearchBits of Research
Bits of Research
 
Battle FUD* at Your Library
Battle FUD* at Your LibraryBattle FUD* at Your Library
Battle FUD* at Your Library
 
My Academic Story via Internet Archive
My Academic Story via Internet ArchiveMy Academic Story via Internet Archive
My Academic Story via Internet Archive
 
Niels Brügger's slides from Digital Conversations event on 26/09/2013
Niels Brügger's slides from Digital Conversations event on 26/09/2013Niels Brügger's slides from Digital Conversations event on 26/09/2013
Niels Brügger's slides from Digital Conversations event on 26/09/2013
 
Tech talk about iswc2013
Tech talk about iswc2013Tech talk about iswc2013
Tech talk about iswc2013
 
Introduction to the International Image Interoperability Framework
Introduction to the International Image Interoperability FrameworkIntroduction to the International Image Interoperability Framework
Introduction to the International Image Interoperability Framework
 
The Secret to Organizing and Maintaining a Successful Networking Group
The Secret to Organizing and Maintaining a Successful Networking GroupThe Secret to Organizing and Maintaining a Successful Networking Group
The Secret to Organizing and Maintaining a Successful Networking Group
 
MWDL as a Service Hub for the Digital Public Library of America: Updates and ...
MWDL as a Service Hub for the Digital Public Library of America: Updates and ...MWDL as a Service Hub for the Digital Public Library of America: Updates and ...
MWDL as a Service Hub for the Digital Public Library of America: Updates and ...
 
Implementing Open Source
Implementing Open SourceImplementing Open Source
Implementing Open Source
 
Crowdsourcing is for the tail
Crowdsourcing is for the tailCrowdsourcing is for the tail
Crowdsourcing is for the tail
 
Charleston 2013: The Social Side of Research
Charleston 2013: The Social Side of ResearchCharleston 2013: The Social Side of Research
Charleston 2013: The Social Side of Research
 
20130321 Putting the world's cultural heritage online with crowdsourcing [roo...
20130321 Putting the world's cultural heritage online with crowdsourcing [roo...20130321 Putting the world's cultural heritage online with crowdsourcing [roo...
20130321 Putting the world's cultural heritage online with crowdsourcing [roo...
 
The DPLA and NY Heritage for Tech Camp 2014
The DPLA and NY Heritage for Tech Camp 2014The DPLA and NY Heritage for Tech Camp 2014
The DPLA and NY Heritage for Tech Camp 2014
 
Crowd Sourcing of Library Services
Crowd Sourcing of Library ServicesCrowd Sourcing of Library Services
Crowd Sourcing of Library Services
 
Embedding Librarians in Virtual Communities
Embedding Librarians in Virtual CommunitiesEmbedding Librarians in Virtual Communities
Embedding Librarians in Virtual Communities
 
Library Collection Development -- Class 1 -- The purpose of libraries and lib...
Library Collection Development -- Class 1 -- The purpose of libraries and lib...Library Collection Development -- Class 1 -- The purpose of libraries and lib...
Library Collection Development -- Class 1 -- The purpose of libraries and lib...
 
Evaluer les nouvelles plates-formes de services web et leur impact sur les bi...
Evaluer les nouvelles plates-formes de services web et leur impact sur les bi...Evaluer les nouvelles plates-formes de services web et leur impact sur les bi...
Evaluer les nouvelles plates-formes de services web et leur impact sur les bi...
 
Islandora Webinar: Highlighting UMKC Digital Special Collections
Islandora Webinar: Highlighting UMKC Digital Special CollectionsIslandora Webinar: Highlighting UMKC Digital Special Collections
Islandora Webinar: Highlighting UMKC Digital Special Collections
 
Brock University TA day Library slide show September 10, 2016
Brock University TA  day Library slide show September 10, 2016Brock University TA  day Library slide show September 10, 2016
Brock University TA day Library slide show September 10, 2016
 

Mehr von Michele Weigle

Mehr von Michele Weigle (20)

Comparing the Archival Rate of Arabic, English, Danish, and Korean Language W...
Comparing the Archival Rate of Arabic, English, Danish, and Korean Language W...Comparing the Archival Rate of Arabic, English, Danish, and Korean Language W...
Comparing the Archival Rate of Arabic, English, Danish, and Korean Language W...
 
Intro to Web Archiving
Intro to Web ArchivingIntro to Web Archiving
Intro to Web Archiving
 
Enabling Personal Use of Web Archives
Enabling Personal Use of Web ArchivesEnabling Personal Use of Web Archives
Enabling Personal Use of Web Archives
 
Visualizing Webpage Changes Over Time
Visualizing Webpage Changes Over TimeVisualizing Webpage Changes Over Time
Visualizing Webpage Changes Over Time
 
How to Write an Academic Paper
How to Write an Academic PaperHow to Write an Academic Paper
How to Write an Academic Paper
 
How to Prepare and Give and Academic Presentation
How to Prepare and Give and Academic PresentationHow to Prepare and Give and Academic Presentation
How to Prepare and Give and Academic Presentation
 
A Retasking Framework For Wireless Sensor Networks
A Retasking Framework For Wireless Sensor NetworksA Retasking Framework For Wireless Sensor Networks
A Retasking Framework For Wireless Sensor Networks
 
Strategies for Sensor Data Aggregation in Support of Emergency Response
Strategies for Sensor Data Aggregation in Support of Emergency ResponseStrategies for Sensor Data Aggregation in Support of Emergency Response
Strategies for Sensor Data Aggregation in Support of Emergency Response
 
Detecting Off-Topic Web Pages at #CUWARC
Detecting Off-Topic Web Pages at #CUWARCDetecting Off-Topic Web Pages at #CUWARC
Detecting Off-Topic Web Pages at #CUWARC
 
Energy Harvesting-aware Design for Wireless Nanonetworks
Energy Harvesting-aware Design for Wireless NanonetworksEnergy Harvesting-aware Design for Wireless Nanonetworks
Energy Harvesting-aware Design for Wireless Nanonetworks
 
2015-capwic-gradschool
2015-capwic-gradschool2015-capwic-gradschool
2015-capwic-gradschool
 
2015-odu-ece-tools-for-past-web
2015-odu-ece-tools-for-past-web2015-odu-ece-tools-for-past-web
2015-odu-ece-tools-for-past-web
 
Tools for Managing the Past Web
Tools for Managing the Past WebTools for Managing the Past Web
Tools for Managing the Past Web
 
Archive What I See Now - 2014 NEH ODH Overview
Archive What I See Now - 2014 NEH ODH OverviewArchive What I See Now - 2014 NEH ODH Overview
Archive What I See Now - 2014 NEH ODH Overview
 
"Archive What I See Now" - NEH ODH overview
"Archive What I See Now" - NEH ODH overview"Archive What I See Now" - NEH ODH overview
"Archive What I See Now" - NEH ODH overview
 
TDMA Slot Reservation in Cluster-Based VANETs
TDMA Slot Reservation in Cluster-Based VANETsTDMA Slot Reservation in Cluster-Based VANETs
TDMA Slot Reservation in Cluster-Based VANETs
 
Communications and Energy-Harvesting in Nanosensor Networks
Communications and Energy-Harvesting in Nanosensor NetworksCommunications and Energy-Harvesting in Nanosensor Networks
Communications and Energy-Harvesting in Nanosensor Networks
 
A Framework for Dynamic Traffic Monitoring Using Vehicular Ad-Hoc Networks
A Framework for Dynamic Traffic Monitoring Using Vehicular Ad-Hoc NetworksA Framework for Dynamic Traffic Monitoring Using Vehicular Ad-Hoc Networks
A Framework for Dynamic Traffic Monitoring Using Vehicular Ad-Hoc Networks
 
A Framework for Incident Detection And Notification in Vehicular Ad Hoc Networks
A Framework for Incident Detection And Notification in Vehicular Ad Hoc NetworksA Framework for Incident Detection And Notification in Vehicular Ad Hoc Networks
A Framework for Incident Detection And Notification in Vehicular Ad Hoc Networks
 
Data Aggregation and Dissemination in Vehicular Ad-Hoc Networks
Data Aggregation and Dissemination in Vehicular Ad-Hoc NetworksData Aggregation and Dissemination in Vehicular Ad-Hoc Networks
Data Aggregation and Dissemination in Vehicular Ad-Hoc Networks
 

Kürzlich hochgeladen

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
Earley Information Science
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 

Kürzlich hochgeladen (20)

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
Evaluating the top large language models.pdf
Evaluating the top large language models.pdfEvaluating the top large language models.pdf
Evaluating the top large language models.pdf
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 

Telling Stories with Web Archives

  • 1. Telling Stories with Web Archives Dr. Michele C. Weigle Web Sciences and Digital Libraries (WS-DL) Lab Department of Computer Science Old Dominion University Norfolk, VA Includes joint work with Dr. Michael L. Nelson and our PhD students, Scott Ainsworth, Yasmin AlNoamany, Ahmed AlSum, Justin Brunelle, Mat Kelly, Hany SalahEldeen Southeast Women in Computing Conference November 16, 2013
  • 2. Outline • What is a web archive? • Why are archives important? • What's my story? • How can we help others tell their stories? • Related WS-DL Projects Southeast Women in Computing Conference - Nov 16, 2013 #SEWIC2013
  • 3. What is a web archive? Southeast Women in Computing Conference - Nov 16, 2013
  • 4. What are some web archives? Southeast Women in Computing Conference - Nov 16, 2013
  • 5. How can I access the archives? MementoFox Memento for Chrome http://www.mementoweb.org/ http://ws-dl.blogspot.com/2010/03/2010-03-19-mementofox-add-on-released.html http://ws-dl.blogspot.com/2013/10/2013-10-14-right-click-to-past-memento.html Southeast Women in Computing Conference - Nov 16, 2013
  • 6. Outline • What is a web archive? • Why are archives important? • What's my story? • How can we help others tell their stories? • Related WS-DL Projects Southeast Women in Computing Conference - Nov 16, 2013
  • 7. The Web holds our stories Southeast Women in Computing Conference - Nov 16, 2013
  • 8. But webpages can disappear • Average lifespan of a webpage - 50-100 days • A year after publication, about 11% of content shared on social media will be gone. SalahEldeen and Nelson, "Losing My Revolution: How Many Resources Shared on Social Media Have Been Lost?", TPDL 2012 http://ws-dl.blogspot.com/2012/02/2012-02-11-losing-my-revolution-year.html Southeast Women in Computing Conference - Nov 16, 2013
  • 9. But maybe it's archived Ainsworth, AlSum, SalahEldeen, Weigle, and Nelson, "How Much of the Web is Archived?", JCDL 2011 http://ws-dl.blogspot.com/2011/06/2011-06-23-how-much-of-web-is-archived.html Southeast Women in Computing Conference - Nov 16, 2013
  • 10. But social media is hard to archive Southeast Women in Computing Conference - Nov 16, 2013
  • 11. Our Research Group Goals • We believe that web archives are valuable cultural resources, and we want everyone to know about them. • We want to make it easy for people to bridge the gap between the live web and the archives. • We believe that replaying the past is more compelling than reading a summary. Southeast Women in Computing Conference - Nov 16, 2013
  • 12.
  • 13. vs. Southeast Women in Computing Conference - Nov 16, 2013
  • 14.
  • 15.
  • 16.
  • 17.
  • 18.
  • 19.
  • 20.
  • 21.
  • 22.
  • 23.
  • 24.
  • 25.
  • 26. Replaying the past can be more compelling than just a summary Southeast Women in Computing Conference - Nov 16, 2013
  • 27. Outline • What is a web archive? • Why are archives important? • What's my story? • How can we help others tell their stories? • Related WS-DL Projects Southeast Women in Computing Conference - Nov 16, 2013
  • 28. What's My Story? • As another illustration, I'll tell you a little bit more about myself ... • ... using the Internet Archive Southeast Women in Computing Conference - Nov 16, 2013
  • 29. NLU - 1997 Southeast Women in Computing Conference - Nov 16, 2013
  • 30. UNC-CS - 1997 Southeast Women in Computing Conference - Nov 16, 2013
  • 31. My CS Homepage - 1997 Southeast Women in Computing Conference - Nov 16, 2013
  • 32. CS Student Assoc Pres - 1999 Southeast Women in Computing Conference - Nov 16, 2013
  • 33. Teaching - 2000 Southeast Women in Computing Conference - Nov 16, 2013
  • 34. Finding gems in the archive Southeast Women in Computing Conference - Nov 16, 2013
  • 35. My Research - 2002 Southeast Women in Computing Conference - Nov 16, 2013
  • 36. Married, Graduated, and Teaching - 2003 Southeast Women in Computing Conference - Nov 16, 2013
  • 37. Faculty Position at Clemson - 2004 Southeast Women in Computing Conference - Nov 16, 2013
  • 38. Clemson missing captures Southeast Women in Computing Conference - Nov 16, 2013
  • 39. Proof I was there - 2006 Southeast Women in Computing Conference - Nov 16, 2013
  • 40. Faculty Position at ODU - 2006 Southeast Women in Computing Conference - Nov 16, 2013
  • 41. Vehicular Networks - 2006 Southeast Women in Computing Conference - Nov 16, 2013
  • 42. 1st PhD Student Graduated - 2010 Southeast Women in Computing Conference - Nov 16, 2013
  • 43. InfoVis, Work with WS-DL - 2011 Southeast Women in Computing Conference - Nov 16, 2013
  • 44. Telling My Story • Going through the archive was a lot of fun. • But, it wasn't always easy. • Today, I might want to incorporate Facebook and Twitter posts in my story. Not saved at Internet Archive. =( • Let's make this easy to do for everyone. Southeast Women in Computing Conference - Nov 16, 2013
  • 45. Outline • What is a web archive? • Why are archives important? • What's my story? • How can we help others tell their stories? • Related WS-DL Projects Southeast Women in Computing Conference - Nov 16, 2013
  • 46. Project Overview • Project forms the PhD work of Yasmin AlNoamany, ideas in early stages • Joins my interests in measurement, web science, information visualization. – measurement - how do people use web archives? – web science - how can we analyze web archives to find pages related to live web pages? – info vis - how can we present the stories that we have harvested from the archive? Southeast Women in Computing Conference - Nov 16, 2013
  • 47. How do people use web archives? • We obtained a year's worth (2012) of requests to the Internet Archive's Wayback Machine – client IPs anonymized Southeast Women in Computing Conference - Nov 16, 2013
  • 48. How do people use web archives? • First, there are a lot of robots (aka bots) who access the archive – 10 bot sessions for every 1 human session – maybe people don't know about the archive? • Typical human sessions are pretty short – people aren't spending lots of time in the archive – it took me over an hour of walking through the archive to build my story – maybe people who do know about the archive aren't using it to build stories? AlNoamany, Weigle, and Nelson, "Access Patterns for Robots and Humans in Web Archives", JCDL 2013 Southeast Women in Computing Conference - Nov 16, 2013
  • 49. How do people use web archives? • 65% of the requested archived pages no longer exist on the live web • People use the archive because the pages they are interested in no longer exist – like most of my examples from my story AlNoamany, AlSum, Weigle, and Nelson, "Who and What Links to the Internet Archive", IJDL, to appear, 2013 Southeast Women in Computing Conference - Nov 16, 2013
  • 50. Helping Others Tell Stories • How can we use this information to help people tell stories? • How do people tell stories? • What tools do they use today? Southeast Women in Computing Conference - Nov 16, 2013
  • 51. Egyptian Revolution on Storify Southeast Women in Computing Conference - Nov 16, 2013
  • 52. Bookmarking is not preserving Southeast Women in Computing Conference - Nov 16, 2013
  • 53. How do people tell stories? • There are three levels of information: – overview – recent events – story definition and replay Southeast Women in Computing Conference - Nov 16, 2013
  • 54. Overview Southeast Women in Computing Conference - Nov 16, 2013
  • 55. Overview Southeast Women in Computing Conference - Nov 16, 2013
  • 56. Recent Events Southeast Women in Computing Conference - Nov 16, 2013
  • 57. Recent Events Southeast Women in Computing Conference - Nov 16, 2013
  • 58. Story Replay Southeast Women in Computing Conference - Nov 16, 2013
  • 59. Story Replay Not yet addressed Southeast Women in Computing Conference - Nov 16, 2013
  • 60. Research Questions How do we • define the time frame of a story? • define the individual events that make up a story? • identify, evaluate, and select candidate archived web pages to support the events of the story? • visualize the resulting story? Southeast Women in Computing Conference - Nov 16, 2013
  • 61. Define the Time Frame of a Story • People remember the name of the story, but not the date – Hurricane Katrina - Aug 29, 2005 – 2011 Egyptian Revolution - Jan 25, 2011 – Boston Marathon Bombing - April 15, 2013 • Some stories have no definitive beginning/ending – BP Gulf Oil Spill - April 20 - September? 2010 effects, court cases still ongoing – Egyptian Revolution - which one? (1952, 2011, 2013) Southeast Women in Computing Conference - Nov 16, 2013
  • 62. Define the Time Frame of a Story • Propose candidate times based on user query Southeast Women in Computing Conference - Nov 16, 2013
  • 63. Define a Story's Events • Consult hand-crafted timelines • User-provided timelines • Detect themes in relevant archived web pages Southeast Women in Computing Conference - Nov 16, 2013
  • 64. Identify Relevant Archived Web Pages • Identify "seed URIs" and query the archive for their existence during the appropriate time – also query for URIs linked from the seed URIs • How to identify seed URIs? – wikipedia – news sites – social media (tweets, Facebook shares) – Storify Southeast Women in Computing Conference - Nov 16, 2013
  • 65. Different sources will provide different seed URIs Southeast Women in Computing Conference - Nov 16, 2013
  • 66. What about social media pages? Southeast Women in Computing Conference - Nov 16, 2013
  • 67. Create your own Facebook archive • May need to allow for usercontributed content Kelly, Nelson, and Weigle, "WARCreate and WAIL: WARC, Wayback, and Heritrix Made Easy," Demo at Digital Preservation 2013. http://ws-dl.blogspot.com/2013/07/2013-07-10-warcreate-and-wail-warc.html Southeast Women in Computing Conference - Nov 16, 2013
  • 68. Suppose we found 100 relevant pages for each event in the story I’ll add here many copies from bbc, nytimes, foxnews Southeast Women in Computing Conference - Nov 16, 2013
  • 69. Evaluate Relevant Archived Web Pages • Are there duplicate accounts? • What is the reputation, bias, or point of view of the source? • How well was the page archived? Southeast Women in Computing Conference - Nov 16, 2013
  • 70. Duplication Southeast Women in Computing Conference - Nov 16, 2013
  • 71. Reputation of Source Southeast Women in Computing Conference - Nov 16, 2013
  • 72. Quality of Archived Page Southeast Women in Computing Conference - Nov 16, 2013
  • 73. Select Relevant Archived Web Pages • User will select pages to use in the final story • But user needs to be presented with some choices Southeast Women in Computing Conference - Nov 16, 2013
  • 74. Selecting Relevant Pages Mubarak's Resignation Southeast Women in Computing Conference - Nov 16, 2013
  • 75. Visualize the Story • Provide different interactive visualizations that enable exploring the story easily • Provide the user with the ability to modify the story and specify the start and end dates Southeast Women in Computing Conference - Nov 16, 2013
  • 76. Using Storify Southeast Women in Computing Conference - Nov 16, 2013
  • 77. Interactive Timeline Replaying Story of Egyptian Revolution Southeast Women in Computing Conference - Nov 16, 2013
  • 78. Slideshow • Different View Southeast Women in Computing Conference - Nov 16, 2013
  • 79. Research Questions How do we • define the time frame of a story? • define the individual events that make up a story? • identify, evaluate, and select candidate archived web pages to support the events of the story? • visualize the resulting story? Southeast Women in Computing Conference - Nov 16, 2013
  • 80. Outline • What is a web archive? • Why are archives important? • What's my story? • How can we help others tell their stories? • Related WS-DL Projects Southeast Women in Computing Conference - Nov 16, 2013
  • 81. User Access Patterns AlNoamany, Weigle, and Nelson, "Access Patterns for Robots and Humans in Web Archives", JCDL 2013 Southeast Women in Computing Conference - Nov 16, 2013
  • 82. Everybody Dips, Humans Dive, Robots Skim Robots (34,203 sessions) Humans (3,431 sessions) AlNoamany, Weigle, and Nelson, "Access Patterns for Robots and Humans in Web Archives", JCDL 2013 Southeast Women in Computing Conference - Nov 16, 2013
  • 83. What domains does each archive hold? AlSum, Weigle, Nelson and Van de Sompel, "Profiling Web Archive Coverage for Top-Level Domain and Content Language," TPDL 2013. Southeast Women in Computing Conference - Nov 16, 2013
  • 84. What domains does each archive hold? AlSum, Weigle, Nelson and Van de Sompel, "Profiling Web Archive Coverage for Top-Level Domain and Content Language," TPDL 2013. Southeast Women in Computing Conference - Nov 16, 2013
  • 85. Sometimes the live web "leaks" into the archive Sept 3, 2008 2012 http://ws-dl.blogspot.com/2012/10/2012-10-10-zombies-in-archives.html Southeast Women in Computing Conference - Nov 16, 2013
  • 86. ODU's WS-DL Group ODU You are here Southeast Women in Computing Conference - Nov 16, 2013
  • 87. ODU's WS-DL Group • Our recent work has been featured in the popular press • We're always looking for more great students! Dr. Michele C. Weigle Old Dominion University Norfolk, VA mweigle@cs.odu.edu @weiglemc http://www.cs.odu.edu/~mweigle/ http://ws-dl.blogspot.com/ Southeast Women in Computing Conference - Nov 16, 2013

Hinweis der Redaktion

  1. We have seen machine readable lost of URIs, can we automatically create this list?
  2. Storify is a social network service that lets the user create stories or timelines using social media such as Twitter, Facebook andInstagram. Storify was launched in September 2010, and has been open to the public since April 2011.http://storify.com/nzherald/muhttp://storify.com/nzherald/mu
  3. The problem is that storify operate as bookmarking, it doesn’t preserve the links You have no clue of what the person is saying about the link
  4. Which brings overview from wikipedia as a first result
  5. Which brings overview from wikipedia as a first result
  6. Which brings overview from wikipedia as a first result
  7. Which brings overview from wikipedia as a first result
  8. But replaying the story as it captured in the news web sites???Three information needsThis one is unserved
  9. Three information needsThis one is unservedNow let me tell you a story of egyptian revolution, using a couple of screen shots which appeared in the time of revolution
  10. Can we satisfy the information need of rewinding/replaying the events as they appeared in the past?How do we integrate web archives into live web to support storytelling?How do we integrate web archives into live web for repalying news stories as they captured?The research aims to integrate the past with the presentby automatically creating, identifying, and linking storiesculled from the past web that are related to the contentof a live web page or a specic event. This raises some ofthe questions: Can we leverage the content of social mediaservices to discover stories? Can we extract stories basedon user access patterns of the Wayback Machine? Can weassociate the names that people give particular events withtheir datetimes in order to find them in web archives?
  11. If we look at different places we will get different URIs that express different prospective of the story Searching two places give us two results
  12. I bet that anyone here know the importance of this page. Trust me. This page is very important I know that Egyptian revolution started on this group, I was one of the first who joined this page which had been created in June 10, 2010This is one of the most important pages, I know it because I have background , trust me! This is an important page for the story even if we know that, the current status is not representing the story
  13. If we have time frame specified for the event/story, we will use deduping news collections
  14. http://www.bartamaha.com/egypts-mubarak-resigns-after-30-year-rule-42593/Handle the duplicates of the news
  15. http://web.archive.org/web/20110215202830/http://www.uscatholic.org/blog/2011/02/mubarak-steps-down-egypt
  16. http://wayback.archive-it.org/2358/20110204123721/http://abcnews.go.com/International/egypt-abc-news-christiane-amanpour-exclusive-interview-president/story?id=12833673
  17. Can we satisfy the information need of rewinding/replaying the events as they appeared in the past?How do we integrate web archives into live web to support storytelling?How do we integrate web archives into live web for repalying news stories as they captured?The research aims to integrate the past with the presentby automatically creating, identifying, and linking storiesculled from the past web that are related to the contentof a live web page or a specic event. This raises some ofthe questions: Can we leverage the content of social mediaservices to discover stories? Can we extract stories basedon user access patterns of the Wayback Machine? Can weassociate the names that people give particular events withtheir datetimes in order to find them in web archives?
  18. Archive-It create slides for the seed URIs which is not normally happened by Web archive users as we discovered from the data.Humans exhibit Dip and Dive, while robots exhibit Dip and Skim Combination that humans exhibit (slides and dives)