Diese Präsentation wurde erfolgreich gemeldet.
Die SlideShare-Präsentation wird heruntergeladen. ×

Lifting the Lid on Linked Data

Wird geladen in …3

Hier ansehen

1 von 56 Anzeige

Weitere Verwandte Inhalte

Diashows für Sie (20)


Ähnlich wie Lifting the Lid on Linked Data (20)

Weitere von Jane Stevenson (17)


Aktuellste (20)

Lifting the Lid on Linked Data

  1. 1. Linked Data and the LOCAH project Jane Stevenson & Adrian Stevenson
  2. 2. Linked Data on the Hub & Copac Linked Open Copac and Archives Hub: Locah JISC funded project August 2010 – July 2011 Mimas UKOLN Eduserv
  3. 3. The goal of Linked Data is to enable people to share structured data on the Web as easily as they can share documents today. It is a space where people and organizations can post and consume data about anything. Bizer/Cyganiak/Heath Linked Data Tuturial, linkeddata.org
  4. 4. Core questions <ul><li>Is it achievable? </li></ul><ul><li>Will it bring substantial benefits? </li></ul><ul><li>“ It is the unexpected re-use of information which is the value added by the web” </li></ul>
  5. 5. What is Linked Data? <ul><li>4 ‘ rules ’ of for the web of data: </li></ul><ul><li>Use URIs as names for things </li></ul><ul><li>Use HTTP URIs so that people can look up those names. </li></ul><ul><li>When someone looks up a URI, provide useful information, using the standards (RDF, SPARQL) </li></ul><ul><li>Include links to other URIs. so that they can discover more things. </li></ul>http://www.w3.org/DesignIssues/LinkedData.html
  6. 6. Use URIs as Names <ul><li>We can make statements about things and establish relationships by assigning identifiers to them. </li></ul><ul><li>Uniform Resource Identifiers (URIs) are identifiers for entities (people, places, subjects, records, institutions). </li></ul><ul><li>They identify resources , and ideally allow you to access representations of those resources. </li></ul>author = http://archiveshub.ac.uk/janefoaf.rdf book = http://dbpedia.org/resource/manchester subject = English = http://lexvo.org/id/iso639-3/eng
  7. 7. Entities and Relationships
  8. 8. ProvidesAccessTo Subject: Bibliographic Resource Predicate: AccessProvidedBy Object: Library Subject > Predicate > Object AccessProvidedBy Triple statement Bibliographic Resource Library
  9. 9. describedBy heldAt encodedAs has An RDF Graph Bibliographic Resource Library Bibliographic Record MODS document Title
  10. 10. So...? <ul><li>If something is identified, it can be linked to </li></ul><ul><li>We can then t ake items from one dataset and link them to items from other datasets </li></ul>BBC VIAF DBPedia Archives Hub Copac GeoNames
  11. 11. The Linking benefits of Linked Data BBC:Cranford VIAF:Gaskell DBPedia: Gaskell Hub:Gaskell Copac:Cranford Geonames:Manchester DBPedia: Dickens Hub:Dickens
  12. 12. The Web of ‘ Documents ’ <ul><li>Global information space (for humans) </li></ul><ul><li>Document paradigm </li></ul><ul><li>Hyperlinks </li></ul><ul><li>Search engines index and infering relevance </li></ul><ul><li>Implicit relationships between documents </li></ul><ul><li>Lack of semantics </li></ul>
  13. 13. The Web of Linked Data <ul><li>Global data space (for humans and machines) </li></ul><ul><li>Making connections between entities across domains (people, books, films, music, genes, medicines, health, statistics...) </li></ul><ul><li>LD is not about searching for specific documents or visiting particular websites, it is about things - identifying and connecting them. </li></ul>
  14. 14. Copac model <ul><li>Groundwork done with Archives Hub. Then had to decide what we wanted to say about the data </li></ul><ul><li>Challenges over what a ‘record’ is – ‘Bleak House’ from each contributor? or one merged record? </li></ul><ul><li>In many ways simpler than archival data; but also can decide to create a simpler model </li></ul>
  15. 15. Copac Model (as at November 2010)
  16. 16. Copac specification <ul><li>Model = entities and relationships </li></ul><ul><li>Specification = means to specify these more exactly – programmer can create transform script </li></ul><ul><li>Iterative process – model – spec – RDF output </li></ul>
  17. 17. Cardinality Property URI/literal 1 1 dct:title literal 0 1 dct:extent literal 0 m bibo:isbn literal 0 m bibo:issn literal 0 m bibo:note literal 0 m dct:alternative literal 0 m copac:uniformtitle literal Node name MODS field Ontology BibliographicResource <modscollection> bibo
  18. 18. Node name MODS field Ontology BibliographicResource <modscollection> bibo cardinality property URI/literal ontology 0 1 copac:creator Creator URI dc 0 m copac:contributor Contributor URI coapc 0 1 event:producedIn Production Date URI event 0 1 dct:issued Production Date URI dc 0 m pode:publicationPlace Place URI pode 0 m isbd:P1016 Place URI isbd 0 m dct:publisher Publisher URI dc 0 1 dct:isPartOf Series URI dc 1 m copac:HeldBy Institution URI with Institution as subject 1 1 bibo:type Type URI bibo 0 m dct:subject Subject URI dc 0 m skos:subject subject URI skos 0 m dct:language Language URI dc 1 1 hub:encodedAs mods URI hub
  19. 19. cardinality property URI/literal URI 1 1 rdf:type URIs http://purl.org/dc/terms/Agenthttp://xmlns.com/foaf/0.1/Agent 1 1 rdfs:label literal {namePart} 1 1 skos:prefLabel literal {namePart} 1 1 isCreatorOf Bibliographic Resource URI root/id/bibliographicresource/{recordIdentifer} Node name MODS field URI namespace uri pattern Creator <name> <namePart></namePart>where <roleTerm>creator</roleTerm> copac root/id/agent/{BibID}{namePart}
  20. 20. Aggregated Data
  21. 21. Aggregated data <ul><li>Copac MODS record = an aggregated book record </li></ul><ul><li>e.g. ‘Bleak House’ held at 10 different libraries </li></ul><ul><li>Copac ‘merges’ the descriptions from 8 of them </li></ul><ul><li>2 are not consistent with the rest, so they remain as stand-alone descriptions </li></ul><ul><li>End result: have 3 records for ‘Bleak House’ </li></ul><ul><li>Not talking about ‘a book’ </li></ul>
  22. 22. Copac decisions <ul><li>Vocabularies: </li></ul><ul><ul><li>dcterms:creator </li></ul></ul><ul><ul><li>dcterms:contributor </li></ul></ul><ul><ul><li>copac:heldBy </li></ul></ul><ul><li>When to create URIs </li></ul><ul><ul><li>Title = literal </li></ul></ul><ul><ul><li>Publication place = URI </li></ul></ul><ul><li>How to deal with problematic/ambiguous data </li></ul><ul><ul><li>Date? = productionDate </li></ul></ul>
  23. 23. ‘ Creator’ <ul><ul><li>Copac ‘creator’ = author or editor </li></ul></ul><ul><li><copac:creator> <dcterms:creator> <biblioResource> </li></ul><ul><li>Alternative name = dct:alternative </li></ul><ul><li>Uniform name = copac:uniform </li></ul>6957115KNAPPF 6947115 <isCreatorOf>
  24. 24. ‘ Contributor’ <ul><li>Contributor = editor, illustrator, translator </li></ul><ul><li>Cannot specify role – has to be general </li></ul><ul><li><dcterms:contributor> </li></ul>
  25. 25. RDF Process
  26. 26. What is LOCAH doing? <ul><li>Part 1: Exposing the Linked Data </li></ul><ul><li>Part 2: Creating a prototype visualisation </li></ul><ul><li>Part 3: Reporting on opportunities and barriers </li></ul>
  27. 27. How are we exposing the Data? <ul><li>Model our ‘things’ into RDF </li></ul><ul><li>Transform the existing data into RDF/XML </li></ul><ul><li>Enhance the data </li></ul><ul><li>Load the RDF/XML into a triple store </li></ul><ul><li>Create Linked Data Views </li></ul><ul><li>Document the process, opportunities and barriers on LOCAH Blog </li></ul>
  28. 28. 1. Modelling ‘things’ into RDF <ul><li>Hub data in ‘Encoded Archival Description’ EAD XML form </li></ul><ul><li>Copac data in ‘Metadata Object Description Schema’ MODS XML form </li></ul><ul><li>Take a step back from the data format </li></ul><ul><ul><li>Think about your ‘things’ </li></ul></ul><ul><ul><li>What is EAD document “saying” about “things in the world”? </li></ul></ul><ul><ul><li>What questions do we want to answer about those “things”? </li></ul></ul>http://www.loc.gov/ead/ http://www.loc.gov/standards/mods/
  29. 29. 1. Modelling ‘things’ into RDF <ul><li>Need to decide on patterns for URIs we generate </li></ul><ul><li>Following guidance from W3C ‘ Cool URIs for the Semantic Web ’ and UK Cabinet Office ‘ Designing URI Sets for the UK Public Sector ’ </li></ul><ul><ul><li>http://data.archiveshub.ac.uk/ id /findingaid/gb1086skinner ‘thing’ URI </li></ul></ul><ul><ul><li>… is HTTP 303 ‘See Other’ redirected to … </li></ul></ul><ul><ul><li>http://data.archiveshub.ac.uk/ doc /findingaid/gb1086skinner document URI </li></ul></ul><ul><ul><li>… which is then content negotiated to … </li></ul></ul><ul><ul><li>http://data.archiveshub.ac.uk/doc/findingaid/gb1086skinner .html http://data.archiveshub.ac.uk/doc/findingaid/gb1086skinner .rdf http://data.archiveshub.ac.uk/doc/findingaid/gb1086skinner .turtle http://data.archiveshub.ac.uk/doc/findingaid/gb1086skinner .json </li></ul></ul><ul><ul><li>http://www.w3.org/TR/cooluris/ http://www.cabinetoffice.gov.uk/resource-library/designing-uri-sets-uk-public-sector </li></ul></ul>
  30. 30. 1. Modelling ‘things’ into RDF <ul><li>Using existing RDF vocabularies: </li></ul><ul><ul><li>DC, SKOS, FOAF, BIBO, WGS84 Geo, Lexvo, ORE, LODE, Event and Time Ontologies </li></ul></ul><ul><li>Define additional RDF terms where required, </li></ul><ul><ul><li>copac:BibiographicResource </li></ul></ul><ul><ul><li>copac:Creator </li></ul></ul><ul><li>It can be hard to know where to look for vocabs and ontologies </li></ul><ul><li>Decide on licence – CC BY-NC 2.0, CC0, ODC PDD </li></ul>
  31. 31. Vocabularies in Linked Data <ul><li>Common vocabularies to describe the data, e.g. ‘ title ’ ‘ author ’ ‘ contributor ’ mean the same thing </li></ul><ul><li>Adopt the same vocabularies for expressing meaning </li></ul><ul><li>Use semantics to link data </li></ul><ul><li>Want to avoid transformation, mapping, contracts between data providers </li></ul>
  32. 32. Commonly used vocabularies (ones we’ve used in bold) <ul><li>Friend-of-a-Friend (FOAF) , vocabulary for describing people. </li></ul><ul><li>Dublin Core (DC) defines general metadata attributes. See also their new domains and ranges draft . </li></ul><ul><li>Semantically-Interlinked Online Communities (SIOC) , vocabulary for representing online communities. </li></ul><ul><li>Description of a Project (DOAP) , vocabulary for describing projects. </li></ul><ul><li>Simple Knowledge Organization System (SKOS) , vocabulary for representing taxonomies and loosely structured knowledge. </li></ul><ul><li>Music Ontology provides terms for describing artists, albums and tracks. </li></ul><ul><li>Review Vocabulary , vocabulary for representing reviews. </li></ul><ul><li>Creative Commons (CC) , vocabulary for describing license terms. </li></ul><ul><li>Bibo, vocabulary for bibliographic data </li></ul>
  33. 33. Copac RDF DC foaf skos Copac bibo dcterms:title dcterms:identifier Shared use of vocabularies Hub RDF DC foaf skos Hub
  34. 34. 2. Transforming in RDF/XML <ul><li>Transform EAD and MODS to RDF/XML based on our models </li></ul><ul><li>Hub: created XSLT Stylesheet and used Saxon parser </li></ul><ul><ul><li>http://saxon.sourceforge.net/ </li></ul></ul><ul><ul><li>Saxon runs the XSLT against a set of EAD files and creates a set of RDF/XML files </li></ul></ul><ul><li>Copac: created in-house Java transformation program </li></ul>
  35. 35. 3. Enhancing our data <ul><ul><li>Language - lexvo.org </li></ul></ul><ul><ul><li>Time periods - reference.data.gov.uk </li></ul></ul><ul><ul><li>Geolocation - UK Postcodes URIs and Ordnance Survey URIs </li></ul></ul><ul><ul><li>Names - Virtual International Authority File </li></ul></ul><ul><ul><ul><li>Matches and links widely-used authority files - http://viaf.org/ </li></ul></ul></ul><ul><ul><li>Names (and subjects) - DBPedia </li></ul></ul><ul><ul><li>Subjects - Library of Congress Subject Headings </li></ul></ul>
  36. 36. Use of ‘SameAs’ <ul><li><sameAs> </li></ul><ul><li>Estelle Sylvia Pankhurst, 1882-1960: http://archiveshub.ac.uk/data/gb-106-7esp http://viaf.org/viaf/51731588/ </li></ul><ul><li>John William Bradley, fl. 1874: http://archiveshub.ac.uk/data/gb0096ms415 http://viaf.org/viaf/61047183/ </li></ul>
  37. 40. 4. Load RDF/XML into triple store <ul><li>Using the Talis Platform triple store </li></ul><ul><li>RDF/XML is HTTP POSTed </li></ul><ul><li>We’re using Pynappl </li></ul><ul><ul><li>Python client for the Talis Platform </li></ul></ul><ul><ul><li>http://code.google.com/p/pynappl/ </li></ul></ul><ul><li>Store provides us with a SPARQL query interface </li></ul>
  38. 41. 5. Create Linked Data Views <ul><li>Expose ‘bounded’ descriptions from the triple store over the Web </li></ul><ul><li>Make available as documents in both human-readable HTML and RDF formats (also JSON, Turtle, CSV) </li></ul><ul><li>Using Paget ‘Linked Data Publishing Framework’ </li></ul><ul><ul><li>http://code.google.com/p/paget/ </li></ul></ul><ul><ul><li>PHP scripts query Sparql endpoint </li></ul></ul>
  39. 42. http://data.archiveshub.ac.uk/id/archivalresource/gb1086skinner
  40. 43. http://data.archiveshub.ac.uk/
  41. 44. Accessing the Locah Linked Data <ul><li>Hub data released </li></ul><ul><li>Copac data release imminent </li></ul><ul><li>Include Linked Data views, Sparql endpoint details, example queries and supporting documentation </li></ul>
  42. 45. Reporting on opportunities and barriers <ul><li>Locah Blog (tags: ‘opportunities’ ‘barriers’) </li></ul><ul><li>Feed into #JiscEXPO programme evidence gathering </li></ul><ul><li>More at: </li></ul><ul><ul><li>http://blogs.ukoln.ac.uk/locah/2010/09/22/creating-linked-data-more-reflections-from-the-coal-face/ </li></ul></ul><ul><ul><li>http://blogs.ukoln.ac.uk/locah/2010/12/01/assessing-linked-data </li></ul></ul>
  43. 46. Feedback Requested! <ul><li>We would like feedback on the project </li></ul><ul><li>Via blog </li></ul><ul><ul><li>http://blogs.ukoln.ac.uk/locah/2010/09/28/model-a-first-cut/ </li></ul></ul><ul><ul><li>http://blogs.ukoln.ac.uk/locah/2010/11/08/some-more-things-some-extensions-to-the-hub-model/ </li></ul></ul><ul><ul><li>http://blogs.ukoln.ac.uk/locah/2010/10/07/modelling-copac-data/ </li></ul></ul><ul><li>Via email, twitter, in person </li></ul>
  44. 47. Creating a Visualisation Prototype <ul><li>Currently working on Hub visualisation </li></ul><ul><li>Data queried from Sparql endpoint </li></ul><ul><li>Use tools such as Simile, Many Eyes, Google Charts </li></ul><ul><li>Timemap visualisation </li></ul><ul><ul><li>Googlemaps and Simile </li></ul></ul><ul><ul><li>http://code.google.com/p/timemap/ </li></ul></ul>
  45. 48. Visualisation Prototype <ul><li>Using Timemap – </li></ul><ul><ul><li>Googlemaps and Simile </li></ul></ul><ul><ul><li>http://code.google.com/p/timemap / </li></ul></ul><ul><li>Early stages with this </li></ul><ul><li>Will give location and ‘extent’ of archive. </li></ul><ul><li>Will link through to Archives Hub </li></ul>
  46. 50. http://socialarchive.iath.virginia.edu/prototype.html
  47. 51. The learning process <ul><li>Model the data, not the description </li></ul><ul><li>The description is one of the entities </li></ul><ul><li>Understand the importance of URIs </li></ul><ul><li>Think about your world before others </li></ul><ul><li>… but external links are important </li></ul><ul><li>Try to get to grips with terminology </li></ul><ul><li>Be prepared for unexpected surprises! </li></ul>
  48. 52. Risks <ul><li>Can you rely on data sources long-term? </li></ul><ul><li>Persistence of persistent URIs? </li></ul><ul><li>New technologies </li></ul><ul><li>Investment of time – unsure of benefits </li></ul><ul><li>Licensing issues </li></ul>
  49. 53. Licensing <ul><li>Nature of Linked Data: each triple as a piece of data </li></ul><ul><li>‘ Ownership’ of data? </li></ul><ul><li>Data often already freely available (M2M interfaces) </li></ul>
  50. 54. Licensing <ul><li>Public Domain Licences: simple, explicit, and permit widest possible reuse. Waive all rights to the data </li></ul><ul><li>BL, British National Bibiography uses public domain licence </li></ul><ul><li>Limit commercial uses? </li></ul><ul><li>Build in community norms: attribution, share alike - to reinforce desire for acknowledgement </li></ul><ul><li>Legal situation? </li></ul>
  51. 55. Thank You
  52. 56. Sections of this presentation adapted from materials created by other members of the LOCAH Project This presentation available under creative commons Non Commercial-Share Alike: http://creativecommons.org/licenses/by-nc/2.0/uk/ Attribution and CC licence

Hinweis der Redaktion

  • Has been described as a ‘data commons’, or more usually a Web of Data.
  • Persitent URIs for names of things – http URIs are names, not addresses Provide information – properties and classes for a URI More links
  • In a data graph, there is no concept of roots (or a hierarchy). A graph consists of resources related to other resources, with no single resource having any particular intrinsic importance over another.
  • We have four ‘things’ here: unit of description; repostiory; finding aid; EAD document. We have given Unit of description a number of properties. Other things can also have properties (this is simplified) These properties are indicated in the green boxes. They are also called predicates.
  • In hypertext web sites it is considered generally rather bad etiquette not to link to related external material.  The value of your own information is very much a function of what it links to, as well as the inherent value of the information within the web page.  So it is also in the Semantic Web. Remember, this is about machines linking – machines need identifiers; humans generally know when something is a place or when it is a person. BBC + DBPedia + GeoNames + Archives Hub + Copac + VIAF = the Web as an exploratory space
  • Encoded Archival Description is an XML standard for encoding archival finding aids The Object Description Schema (MODS) is an XML -based bibliographic description schema MODS - Metadata Object Description Schema (MODS) is a schema for a bibliographic element set that may be used for a variety of purposes, and particularly for library applications. EAD - Things” include concepts and abstractions as well as material objects We want location – archives physical things so location important Also wanted event data, partly steered by the visualisation prototype Also ‘extent’ data – number of boxes
  • 303 and Content Neg from ‘Cool URIs for the Semantic Web’
  • Open Data Commons Public Domain Dedication Creative Commons CC0 license
  • Once you say that they are the same, the implication is that they share the same classes and properties.