Presentation for the EVENTS2017 workshop colocated with SEMANTICS2017

1. DIVE+ INTO THE EVENT-ENRICHED
LINKED OPEN CULTURAL HERITAGE
Victor de Boer

2. Support Event-centric browsing for Media Scholars

3. Access to Integrated Online Multimedia collections
using Linked Open Data to integrate metadata of
various heritage collections
Interactive Exploration & Discovery in Context
linking objects to events and entities
building automatic storylines (narratives)
DIVE+

4. OPENIMAGES.EU
3,220 news broadcasts
Netherlands Institute for Sound & Vision
GTAA thesaurus
DELPHER.NL
197,199 Scans of Radio
bulletins
1937 – 1984
AMSTERDAM MUSEUM
73,447 cultural heritage objects
AM Thesaurus
TROPENMUSEUM
78,270 cultural heritage objects
SVNC thesaurus
Collections and Vocabularies

5. Van Hage, W. R., Malaisé, V., Segers, R., Hollink, L., & Schreiber, G. (2011).
Design and use of the Simple Event Model (SEM). Web Semantics: Science,
Services and Agents on the World Wide Web, 9(2), 128-136.

6. sem:Event
sem:Actordive:MediaO
bject
dive:depictedBy
rdfs:label
dive:source
dive:placeholder
dc:identifier
dc:description
etc.
oa:Annotation
oa:hasBodyoa:hasTarget
sem:Place
sem:Time
skos:Concept
sem:hasActor,
sem:hasPlace
sem:hasTime
dive:isRelated
To
skos:broader,
skos:narrower etc.
dive:isRelatedTo
DIVE+ data model

7. Original Metadata
Interpretation of content
Named Entity Recognition
Human computation
Hybrid pipeline
Where do we get events from
- LIDO, CIDOC, EDM
- creationDateStart
- - Interpretation of object
- FROG, other pipelines
- - Crowdsourcing
- -Nichesourcing,

8. Original Metadata
am:Belgische opstand
am:besnijdenis
am:Beurs de Keyser
am:bevrijding
am:bezoekerscentrum
am:bibliotheken
am:Bijlmerramp
am:Boulevard of Broken Dreams
am:brand
am:brand van het oude stadhuis op de Dam
am:burgeroorlog
am:capitulatie
am:christendom geboorte van Christus
am:christendom kruisiging
am:christendom opstanding van Christus
am:christus aan het kruis
am:Christus schrijft op de grond
am:concert
"Fayence bord”

9. ENTITY EXTRACTION
CROWDTRUTH.ORG
ENTITY EXTRACTION
EVENTS CROWDSOURCING AND LINKING TO
CONCEPTS THROUGH CROWDTRUTH.ORG
SEGMENTATION & KEYFRAMES
LINKING EVENTS AND
CONCEPTS TO KEYFRAMES

10. Crowdsourcing for Events in Texts & Videos
CrowdTruth.org

11. Description Event
"Foto is genomen tijdens de Tweede Zuid
Nieuw-Guinea Expeditie"
Tweede Zuid Nieuw-Guinea
Expeditie
Foto is genomen tijdens de Eerste Zuid
Nieuw-Guinea Expeditie
Eerste Zuid Nieuw-Guinea
Expeditie
"Foto is genomen tijdens de Eerste- of de
Tweede Zuid Nieuw-Guinea Expeditie"
Tweede Zuid Nieuw-Guinea
Expeditie
"Masker gedragen tijdens oogstfeesten.
Het feest in kwestie is het Sokari spel dat
eenmaal per jaar wordt opgevoerd
gedurende zeven opeenvolgende
nachten na Nieuwjaar, medio april. …” Nieuwjaar
FROG NER Event extraction
Victor Kramer

12. Radio news bulletins: Every object 1 event

13. DIVE+ Enrichments
Enrichment
method
Media
Objects Actors Places Events Other Alignments
OI hybrid pipeline 3,204 1,249 1,412 1,916 185,846 623
NB Interpreted + NER 197,200 194,890 54,571 197,200 6,736 6,353
AM original thesaurus 73,447 66,966 5,973 148 28,047 6,865
TM
original thesaurus
+ FROG NER 78,226 27,829 3,896 23* 13,269 -
Total 352,077 290,934 65,852 199,264 233,898 -
*) more to come

14. DIVE:MediaObject
Nieuws uit Indonesië:
opheffing van het KNIL
dive:depictedBy
sem:hasTimestamp
sem:Event
ANP:1950-08-11:50
dive:isRelatedTo
dive:relatedPlace
sem:hasPlace
dive:isRelatedTo
dive:relatedActor
sem:hasActor
dive:isRelatedTo
dive:relatedPlace
sem:hasPlace
sem:Time
25 Juli 1950
dive:depictedBy
sem:hasTimestamp
DIVE:MediaObject
Mannen bij het huis van Paul Spies
aan de Parapattan 42, Djakarta
dive:depictedBy
dive:depictedBy
dive:depictedBy
DIVE:MediaObject
ANP:1950-08-11:50
DIVE:MediaObject
Schaal
sem:Time
11 Augustus 1950
sem:Event
ontbindingsceremonie
sem:Place
Djakarta
sem:Place
Indonesië
sem:Actor
Mohammad Hatta
Linking via common actors, places, objects

15. CLIOPATRIA TRIPLE STORE
2M TRIPLES (FOR NOW)
SPARQL ENDPOINT
DATA.DIVE.BEELDENGELUID.NL

16. (Common) Event thesaurus?
Februaristaking
WOII
Februaristaking
“De oproep 'Staakt!'
voor deelname aan
de februaristaking te
Amsterdam op 25 en
26 februari 1941. “
stakingen
Eduard Hellendoorn
"Joseph Eijl Eduard Hellendoorn
Hermanus Coenradi 13 maart 1941
gefusilleerd Waalsdorpervlakte"
Waalsdorpervlakte
Jessie Both & Didi de hooge

17. DIVE+ UI: INFINITY OF EXPLORATION
/ Support exploration and serendipity /
/ Visual inspection of media objects and entities /
/ Lets user build, save and share Proto-Narratives/

19. filters
results ordering

20. filter on media objects
order media
objects by date

21. filter on events

22. explore
event
related
entities

23. explore
event
event
related
entities

24. place entity
exploration

25. narrative

26. bookmarking

27. / Events as backbone for for deep exploration of
interconnected media collections by DH experts
/ Various data enrichment strategies to construct
explorable knowledge graphs
DIVE+

28. / http://diveproject.beeldengeluid.nl
/ http://diveplus.beeldengeluid.nl
/ v.de.boer@vu.nl
DIVE+

29. DIVE+