SlideShare ist ein Scribd-Unternehmen logo
1 von 29
Downloaden Sie, um offline zu lesen
Google Books: !
     The Metadata Mess!


      Google Book Settlement Conference!
                            UC Berkeley!
                       August 28, 2009!



                         Geoff Nunberg, !
                   School of Information!
                           1!
1!
The Last Library!
     "The cost of creating such a library and Google’s significant
     lead time advantage suggest that no other entity will create
     a competing digital library for the foreseeable future."
     Directors of ALA, ACRL, ARL in letter to DOJ Antitrust
     Division, July 29, 2009!
     There is no Moore's Law for capture…!
     Hence the urgency of concerns about pricing, access,
     exclusivity, privacy…and "quality""




2!
Whose interests determine!
                        "quality"?!
     Google Book Search is "a tremendous public
     good for students, for teachers, for scholars, for
     everyone." Derek Slater, Google!
        … but students, scholars and "everyone" may have
        different purposes for using GBS. !




3!
Three ways of using GBS!
     What "Googling" means: barrelling in sideways!




     GBS as a borough of Greater Google!
        "We just feel this is part of our core mission. There is
        fantastic information in books. Often when I do a
        search, what is in a book is miles ahead of what I find
        on a Web site." Sergey Brin!


4!
Three ways of using GBS!
       Seeking out works & editions: the
       "destination experience"!
          A particular edition of Leaves of Grass!
          A good edition of Tristram Shandy!
          18th-c. French editions of Don Quixote,
          etc.!



           The importance of metadata: Who,
           when, where etc. !




5!
Three ways of using GBS!
     "Batch processing": data mining and "
     "electronic philology"!
        "It's only reporters and computational linguists who
        care if [hit-count estimation] is really precise." Peter
        Norvig, Google!
     Text databases and the "new philologies": !
        The importance of language to social, intellectual, and
        political history & literary study!
        Coincides emergence of large-scale historical text
        databases…!
           When did happiness replace felicity in 17th c?!
           Plotting the rise & fall of propaganda!
           How did liberalism spread in the early nineteenth-century
6!         European context?. "
Good enough for scholarship?!
     Will GBS be an adequate resource for scholarly
     needs… now and in the future?!
     Depends on:!
        Quality of imaging!
        Reliability and robustness of search tools!
        Quality and reliability of metadata !
          e.g., date, edition history, author, subject classification,
          etc.!




7!
Good enough for scholarship?!
     Will GBS be an adequate resource for scholarly
     needs… now and in the future?!
     Depends on:!
        Quality of imaging!
        Reliability and robustness of search tools!
        Quality and reliability of metadata !
          e.g., date, edition history, author, subject classification,
          etc.!


     But GBS metadata are awful.!


8!
Quality Issues :!
     Botched Scans, OCR, &c.!




9!
Metadata Issues:!
      1899, annus mirabilis!




10!
Random Dates!


      1905!



               1848!




              1900!


               1888!


11!
The pervasiveness of
                    misdatings!
      1899!
                      527 hits returned for
      1905!           "Internet" before 1950 !
      1878 !


      1905!


      1946!


      1905!

       1905!


              1905!


        1939!


12!
Famous before their lifetime!
                          182 hits reported for "Charles
                          Dickens" before birthdate
                          (1812)!
              1878 !
                          Cf Jimi Hendrix, 81; Led
                1905!     Zeppelin, 59 etc.!

               1946!


                  1905!

              1905!




13!
Ego-surfing,
      Edgar Cayce
             Style!
      "Our reputation
       precedes us"!




14!
The frequency of misdatings!




                     Search on "candy bar" < 1920
                     yields 66 hits, 46 of them
                     misdated (70%)!



15!
Classification Errors!




16!
Classification Errors!




17!
The Pervasiveness of
           Misclassification!

               family and relationships (4)



               fiction (4)




               biography and autobiography (1)



                Unlabeled (1)
                (others classified as "music,"
                "history," "literary collections")

        Classifications of first 10 hits for !
        Tristram Shandy !
18!
The Pervasiveness of
           Misclassification!


               First 10 hits for Leaves of
                      Grass classify it as:"

                              Juvenile Nonfiction"
                                           Poetry!
                                           Fiction!
                                Literary Criticism!
                    Biography & Autobiography,!
                 Counterfeits and Counterfeiting !




19!
More bad metadata!




20!
More bad metadata!




  Reader, I
marketed him.




     21!
Other metadata issues!
      Books ascribed to authors of introductions, or
      given no author at all.!




22!
Other metadata issues!
      Titles linked to unrelated works.!




23!
Other metadata issues!
      Strange bedfellows!




24!
Who is to blame and what is
                     to be done?!
      "We got the metadata from the libraries": !
          yes, sometimes… but libraries didn't classify Hamlet as
          "antiques and collectibles" or Speculum as "Health & Fitness"!
          Libraries don't use BISAC headings like "Antiques and
          Collectibles" and "Health & Fitness" in the first place…!
          And publishers didn't assign BISAC codes to books
          published before the 1980's!




25!
The world according to BISAC!
      Making space for Bambi & Bullwinkle!




      … and Schiller, Petrarch & Verlaine!




26!
The world according to BISAC!
       Making shelf space for Bambi & Bullwinkle!




       … and scrunching together Schiller, Petrarch & Verlaine!




      Squeezing the universal library into a sububan bookstore!
27!
Correcting the Problem!
      Google: "We're on it (but it isn't a first priority)"!
         Correcting errors as noticed (like bad scans)?!
         Crowd Sourcing?!
         But errors/bad metadata affect 000,000's of records!
         "Error correction" doesn't address poor & missing
         metadata, inconsistent/confusing/inappropriate
         classification schemes!
         Why should the metadata decisions be left to Google
         engineers? !




28!
Correcting the Problem!
      HathiTrust to the rescue?!
         But HathiTrust makes available only out-of-copyright
         works, has (relatively) limited computational resources!
      Why should Google have no obligations to do
      GBS right? !
         Google Book Search is "a tremendous public good for
         students, for teachers, for scholars, for everyone."
         Derek Slater, Google!
         But a public good implies a public trust!




29!

Weitere ähnliche Inhalte

Andere mochten auch

The Science of Great Site Navigation: Online Card Sorting + Tree Testing
The Science of Great Site Navigation:  Online Card Sorting + Tree TestingThe Science of Great Site Navigation:  Online Card Sorting + Tree Testing
The Science of Great Site Navigation: Online Card Sorting + Tree Testing
UserZoom
 
40 Tools in 20 Minutes: Hacking your Marketing Career
40 Tools in 20 Minutes: Hacking your Marketing Career40 Tools in 20 Minutes: Hacking your Marketing Career
40 Tools in 20 Minutes: Hacking your Marketing Career
Eric Leist
 

Andere mochten auch (8)

Six safe fonts to use in your presentations
Six safe fonts to use in your presentationsSix safe fonts to use in your presentations
Six safe fonts to use in your presentations
 
The Science of Great Site Navigation: Online Card Sorting + Tree Testing
The Science of Great Site Navigation:  Online Card Sorting + Tree TestingThe Science of Great Site Navigation:  Online Card Sorting + Tree Testing
The Science of Great Site Navigation: Online Card Sorting + Tree Testing
 
10 PowerPoint Templates That Don't Suck
10 PowerPoint Templates That Don't Suck10 PowerPoint Templates That Don't Suck
10 PowerPoint Templates That Don't Suck
 
2015 Font Trends For Presentations
2015 Font Trends For Presentations2015 Font Trends For Presentations
2015 Font Trends For Presentations
 
40 Tools in 20 Minutes: Hacking your Marketing Career
40 Tools in 20 Minutes: Hacking your Marketing Career40 Tools in 20 Minutes: Hacking your Marketing Career
40 Tools in 20 Minutes: Hacking your Marketing Career
 
How to Craft Your Company's Storytelling Voice by Ann Handley of MarketingProfs
How to Craft Your Company's Storytelling Voice by Ann Handley of MarketingProfsHow to Craft Your Company's Storytelling Voice by Ann Handley of MarketingProfs
How to Craft Your Company's Storytelling Voice by Ann Handley of MarketingProfs
 
Pixar's 22 Rules to Phenomenal Storytelling
Pixar's 22 Rules to Phenomenal StorytellingPixar's 22 Rules to Phenomenal Storytelling
Pixar's 22 Rules to Phenomenal Storytelling
 
SMOKE - The Convenient Truth [1st place Worlds Best Presentation Contest] by ...
SMOKE - The Convenient Truth [1st place Worlds Best Presentation Contest] by ...SMOKE - The Convenient Truth [1st place Worlds Best Presentation Contest] by ...
SMOKE - The Convenient Truth [1st place Worlds Best Presentation Contest] by ...
 

Ähnlich wie Goog Books: The Metadata Mess

Gn brief history
Gn brief historyGn brief history
Gn brief history
hmfowler
 
Eng2 d tkm_intro
Eng2 d tkm_introEng2 d tkm_intro
Eng2 d tkm_intro
dcowley
 
Building a balanced collection 2003 version
Building a balanced collection 2003 versionBuilding a balanced collection 2003 version
Building a balanced collection 2003 version
Johan Koren
 
What i learned from the history of books
What i learned from the history of booksWhat i learned from the history of books
What i learned from the history of books
strateia8
 
Social tagging 663
Social tagging 663Social tagging 663
Social tagging 663
pkwhitford
 
Cubism Essay. Cubism essay pablo picasso
Cubism Essay. Cubism essay pablo picassoCubism Essay. Cubism essay pablo picasso
Cubism Essay. Cubism essay pablo picasso
Jessica Siewert
 

Ähnlich wie Goog Books: The Metadata Mess (20)

Calibrate
CalibrateCalibrate
Calibrate
 
What's New in Literature for Young Adults
What's New in Literature for Young AdultsWhat's New in Literature for Young Adults
What's New in Literature for Young Adults
 
Titles
TitlesTitles
Titles
 
Gn brief history
Gn brief historyGn brief history
Gn brief history
 
Publishing Trend @ Bologna Children Book Fair
Publishing Trend @ Bologna Children Book FairPublishing Trend @ Bologna Children Book Fair
Publishing Trend @ Bologna Children Book Fair
 
STAK: Serendipitous Tool for Augmenting Knowledge - Bridging gaps between dig...
STAK: Serendipitous Tool for Augmenting Knowledge - Bridging gaps between dig...STAK: Serendipitous Tool for Augmenting Knowledge - Bridging gaps between dig...
STAK: Serendipitous Tool for Augmenting Knowledge - Bridging gaps between dig...
 
Scientific Paper. Online assignment writing service.
Scientific Paper. Online assignment writing service.Scientific Paper. Online assignment writing service.
Scientific Paper. Online assignment writing service.
 
Example Of Politics (Critical Research)
Example Of Politics (Critical Research)Example Of Politics (Critical Research)
Example Of Politics (Critical Research)
 
Eng2 d tkm_intro
Eng2 d tkm_introEng2 d tkm_intro
Eng2 d tkm_intro
 
Building a balanced collection 2003 version
Building a balanced collection 2003 versionBuilding a balanced collection 2003 version
Building a balanced collection 2003 version
 
What i learned from the history of books
What i learned from the history of booksWhat i learned from the history of books
What i learned from the history of books
 
Hagar qim wicked comics presentation
Hagar qim   wicked comics presentationHagar qim   wicked comics presentation
Hagar qim wicked comics presentation
 
James Baldwin Essays Online.pdf
James Baldwin Essays Online.pdfJames Baldwin Essays Online.pdf
James Baldwin Essays Online.pdf
 
Essay Peshawar Attack In English
Essay Peshawar Attack In EnglishEssay Peshawar Attack In English
Essay Peshawar Attack In English
 
Intro to Digital Storytelling (shorter version)
Intro to Digital Storytelling (shorter version)Intro to Digital Storytelling (shorter version)
Intro to Digital Storytelling (shorter version)
 
Social tagging 663
Social tagging 663Social tagging 663
Social tagging 663
 
Redefining Libraries
Redefining LibrariesRedefining Libraries
Redefining Libraries
 
WARCs, WATs, and wgets: Opportunity and Challenge for a Historian Amongst Thr...
WARCs, WATs, and wgets: Opportunity and Challenge for a Historian Amongst Thr...WARCs, WATs, and wgets: Opportunity and Challenge for a Historian Amongst Thr...
WARCs, WATs, and wgets: Opportunity and Challenge for a Historian Amongst Thr...
 
What's New in Literature for Young Readers
What's New in Literature for Young ReadersWhat's New in Literature for Young Readers
What's New in Literature for Young Readers
 
Cubism Essay. Cubism essay pablo picasso
Cubism Essay. Cubism essay pablo picassoCubism Essay. Cubism essay pablo picasso
Cubism Essay. Cubism essay pablo picasso
 

Mehr von StreetLib

Grafici e dati stealth convention 2013
Grafici e dati stealth convention 2013Grafici e dati stealth convention 2013
Grafici e dati stealth convention 2013
StreetLib
 
Simplicissimus Web Wervices: Overview of the Simplicissimus Cloud Infrastructure
Simplicissimus Web Wervices: Overview of the Simplicissimus Cloud InfrastructureSimplicissimus Web Wervices: Overview of the Simplicissimus Cloud Infrastructure
Simplicissimus Web Wervices: Overview of the Simplicissimus Cloud Infrastructure
StreetLib
 
Ignite - Gli ebook in 5 minuti e 20 slide!
Ignite - Gli ebook in 5 minuti e 20 slide!Ignite - Gli ebook in 5 minuti e 20 slide!
Ignite - Gli ebook in 5 minuti e 20 slide!
StreetLib
 
Sbf Paperless Democracy (en)
Sbf Paperless Democracy (en)Sbf Paperless Democracy (en)
Sbf Paperless Democracy (en)
StreetLib
 

Mehr von StreetLib (20)

Il crowdfunding come mezzo di finanziamento e di comunicazione nel mondo dell...
Il crowdfunding come mezzo di finanziamento e di comunicazione nel mondo dell...Il crowdfunding come mezzo di finanziamento e di comunicazione nel mondo dell...
Il crowdfunding come mezzo di finanziamento e di comunicazione nel mondo dell...
 
Vendita e Distribuzione - Narcissus Vs DIY
Vendita e Distribuzione - Narcissus Vs DIYVendita e Distribuzione - Narcissus Vs DIY
Vendita e Distribuzione - Narcissus Vs DIY
 
"Immagina, scrivi, pubblica - Editore di te stesso con il self publishing"
"Immagina, scrivi, pubblica - Editore di te stesso con il self publishing""Immagina, scrivi, pubblica - Editore di te stesso con il self publishing"
"Immagina, scrivi, pubblica - Editore di te stesso con il self publishing"
 
Wonders of self publishing for journalists (and not only) - Arabic version
Wonders of self publishing for journalists (and not only) - Arabic versionWonders of self publishing for journalists (and not only) - Arabic version
Wonders of self publishing for journalists (and not only) - Arabic version
 
La question de l'autoédition pour les journalistes (mais pas que)
La question de l'autoédition pour les journalistes (mais pas que)La question de l'autoédition pour les journalistes (mais pas que)
La question de l'autoédition pour les journalistes (mais pas que)
 
Wonders of self publishing for journalists (and not only)
Wonders of self publishing for journalists (and not only)Wonders of self publishing for journalists (and not only)
Wonders of self publishing for journalists (and not only)
 
Maravillas de la AUTOPUBLICACIÓN para periodistas (y no sólo para ellos)
Maravillas de la  AUTOPUBLICACIÓN para periodistas (y no sólo para ellos)Maravillas de la  AUTOPUBLICACIÓN para periodistas (y no sólo para ellos)
Maravillas de la AUTOPUBLICACIÓN para periodistas (y no sólo para ellos)
 
Die Chancen des SELF-PUBLISHING Für Journalisten (und nicht nur die)
Die Chancen des SELF-PUBLISHING Für Journalisten (und nicht nur die)Die Chancen des SELF-PUBLISHING Für Journalisten (und nicht nur die)
Die Chancen des SELF-PUBLISHING Für Journalisten (und nicht nur die)
 
Le meraviglie del SELF PUBLISHING per giornalisti (e non solo)
Le meraviglie del SELF PUBLISHING per giornalisti (e non solo)Le meraviglie del SELF PUBLISHING per giornalisti (e non solo)
Le meraviglie del SELF PUBLISHING per giornalisti (e non solo)
 
Promuovere gli eBook - Parte 3
Promuovere gli eBook - Parte 3Promuovere gli eBook - Parte 3
Promuovere gli eBook - Parte 3
 
Promuovere gli eBook - Parte 1
Promuovere gli eBook - Parte 1Promuovere gli eBook - Parte 1
Promuovere gli eBook - Parte 1
 
Grafici e dati stealth convention 2013
Grafici e dati stealth convention 2013Grafici e dati stealth convention 2013
Grafici e dati stealth convention 2013
 
Simplicissimus Web Wervices: Overview of the Simplicissimus Cloud Infrastructure
Simplicissimus Web Wervices: Overview of the Simplicissimus Cloud InfrastructureSimplicissimus Web Wervices: Overview of the Simplicissimus Cloud Infrastructure
Simplicissimus Web Wervices: Overview of the Simplicissimus Cloud Infrastructure
 
Tutto su Simplicissimus in 30 minuti
Tutto su Simplicissimus in 30 minutiTutto su Simplicissimus in 30 minuti
Tutto su Simplicissimus in 30 minuti
 
Ignite - Gli ebook in 5 minuti e 20 slide!
Ignite - Gli ebook in 5 minuti e 20 slide!Ignite - Gli ebook in 5 minuti e 20 slide!
Ignite - Gli ebook in 5 minuti e 20 slide!
 
L'Ebook spiegato in 20 pagine
L'Ebook spiegato in 20 pagineL'Ebook spiegato in 20 pagine
L'Ebook spiegato in 20 pagine
 
SBF JWW (it)
SBF JWW (it)SBF JWW (it)
SBF JWW (it)
 
Sbf Paperless Democracy (en)
Sbf Paperless Democracy (en)Sbf Paperless Democracy (en)
Sbf Paperless Democracy (en)
 
SBF STEALTH (en)
SBF STEALTH (en)SBF STEALTH (en)
SBF STEALTH (en)
 
SBF Paperless Democracy (it)
SBF Paperless Democracy (it)SBF Paperless Democracy (it)
SBF Paperless Democracy (it)
 

Kürzlich hochgeladen

The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
heathfieldcps1
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
QucHHunhnh
 

Kürzlich hochgeladen (20)

Magic bus Group work1and 2 (Team 3).pptx
Magic bus Group work1and 2 (Team 3).pptxMagic bus Group work1and 2 (Team 3).pptx
Magic bus Group work1and 2 (Team 3).pptx
 
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17  How to Extend Models Using Mixin ClassesMixin Classes in Odoo 17  How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
 
Third Battle of Panipat detailed notes.pptx
Third Battle of Panipat detailed notes.pptxThird Battle of Panipat detailed notes.pptx
Third Battle of Panipat detailed notes.pptx
 
Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
 
Spatium Project Simulation student brief
Spatium Project Simulation student briefSpatium Project Simulation student brief
Spatium Project Simulation student brief
 
Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdf
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
Unit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptxUnit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptx
 
Micro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdfMicro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdf
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.
 
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptxSKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
 
psychiatric nursing HISTORY COLLECTION .docx
psychiatric  nursing HISTORY  COLLECTION  .docxpsychiatric  nursing HISTORY  COLLECTION  .docx
psychiatric nursing HISTORY COLLECTION .docx
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan Fellows
 
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
 

Goog Books: The Metadata Mess

  • 1. Google Books: ! The Metadata Mess! Google Book Settlement Conference! UC Berkeley! August 28, 2009! Geoff Nunberg, ! School of Information! 1! 1!
  • 2. The Last Library! "The cost of creating such a library and Google’s significant lead time advantage suggest that no other entity will create a competing digital library for the foreseeable future." Directors of ALA, ACRL, ARL in letter to DOJ Antitrust Division, July 29, 2009! There is no Moore's Law for capture…! Hence the urgency of concerns about pricing, access, exclusivity, privacy…and "quality"" 2!
  • 3. Whose interests determine! "quality"?! Google Book Search is "a tremendous public good for students, for teachers, for scholars, for everyone." Derek Slater, Google! … but students, scholars and "everyone" may have different purposes for using GBS. ! 3!
  • 4. Three ways of using GBS! What "Googling" means: barrelling in sideways! GBS as a borough of Greater Google! "We just feel this is part of our core mission. There is fantastic information in books. Often when I do a search, what is in a book is miles ahead of what I find on a Web site." Sergey Brin! 4!
  • 5. Three ways of using GBS! Seeking out works & editions: the "destination experience"! A particular edition of Leaves of Grass! A good edition of Tristram Shandy! 18th-c. French editions of Don Quixote, etc.! The importance of metadata: Who, when, where etc. ! 5!
  • 6. Three ways of using GBS! "Batch processing": data mining and " "electronic philology"! "It's only reporters and computational linguists who care if [hit-count estimation] is really precise." Peter Norvig, Google! Text databases and the "new philologies": ! The importance of language to social, intellectual, and political history & literary study! Coincides emergence of large-scale historical text databases…! When did happiness replace felicity in 17th c?! Plotting the rise & fall of propaganda! How did liberalism spread in the early nineteenth-century 6! European context?. "
  • 7. Good enough for scholarship?! Will GBS be an adequate resource for scholarly needs… now and in the future?! Depends on:! Quality of imaging! Reliability and robustness of search tools! Quality and reliability of metadata ! e.g., date, edition history, author, subject classification, etc.! 7!
  • 8. Good enough for scholarship?! Will GBS be an adequate resource for scholarly needs… now and in the future?! Depends on:! Quality of imaging! Reliability and robustness of search tools! Quality and reliability of metadata ! e.g., date, edition history, author, subject classification, etc.! But GBS metadata are awful.! 8!
  • 9. Quality Issues :! Botched Scans, OCR, &c.! 9!
  • 10. Metadata Issues:! 1899, annus mirabilis! 10!
  • 11. Random Dates! 1905! 1848! 1900! 1888! 11!
  • 12. The pervasiveness of misdatings! 1899! 527 hits returned for 1905! "Internet" before 1950 ! 1878 ! 1905! 1946! 1905! 1905! 1905! 1939! 12!
  • 13. Famous before their lifetime! 182 hits reported for "Charles Dickens" before birthdate (1812)! 1878 ! Cf Jimi Hendrix, 81; Led 1905! Zeppelin, 59 etc.! 1946! 1905! 1905! 13!
  • 14. Ego-surfing, Edgar Cayce Style! "Our reputation precedes us"! 14!
  • 15. The frequency of misdatings! Search on "candy bar" < 1920 yields 66 hits, 46 of them misdated (70%)! 15!
  • 18. The Pervasiveness of Misclassification! family and relationships (4) fiction (4) biography and autobiography (1) Unlabeled (1) (others classified as "music," "history," "literary collections") Classifications of first 10 hits for ! Tristram Shandy ! 18!
  • 19. The Pervasiveness of Misclassification! First 10 hits for Leaves of Grass classify it as:" Juvenile Nonfiction" Poetry! Fiction! Literary Criticism! Biography & Autobiography,! Counterfeits and Counterfeiting ! 19!
  • 21. More bad metadata! Reader, I marketed him. 21!
  • 22. Other metadata issues! Books ascribed to authors of introductions, or given no author at all.! 22!
  • 23. Other metadata issues! Titles linked to unrelated works.! 23!
  • 24. Other metadata issues! Strange bedfellows! 24!
  • 25. Who is to blame and what is to be done?! "We got the metadata from the libraries": ! yes, sometimes… but libraries didn't classify Hamlet as "antiques and collectibles" or Speculum as "Health & Fitness"! Libraries don't use BISAC headings like "Antiques and Collectibles" and "Health & Fitness" in the first place…! And publishers didn't assign BISAC codes to books published before the 1980's! 25!
  • 26. The world according to BISAC! Making space for Bambi & Bullwinkle! … and Schiller, Petrarch & Verlaine! 26!
  • 27. The world according to BISAC! Making shelf space for Bambi & Bullwinkle! … and scrunching together Schiller, Petrarch & Verlaine! Squeezing the universal library into a sububan bookstore! 27!
  • 28. Correcting the Problem! Google: "We're on it (but it isn't a first priority)"! Correcting errors as noticed (like bad scans)?! Crowd Sourcing?! But errors/bad metadata affect 000,000's of records! "Error correction" doesn't address poor & missing metadata, inconsistent/confusing/inappropriate classification schemes! Why should the metadata decisions be left to Google engineers? ! 28!
  • 29. Correcting the Problem! HathiTrust to the rescue?! But HathiTrust makes available only out-of-copyright works, has (relatively) limited computational resources! Why should Google have no obligations to do GBS right? ! Google Book Search is "a tremendous public good for students, for teachers, for scholars, for everyone." Derek Slater, Google! But a public good implies a public trust! 29!