Presentation on WP4 (Aggregation and Indexing Plan) at Europeana Newspapers Annual Meeting in Vienna (Markus Muhr & Natasa Gassia)

1. Europeana Newspapers WP 4
Aggregation & Indexing Plan
Anastasia Gacia and Markus Muhr

2. Agenda
●
●
•
•
•
•
•
•
Customer Relationship Management
Aggregation Workflow - Metadata
Aggregation Workflow - Full-text and Images
Newspaper Content Browser Options
Viewing Images
Delivery to Europeana / Zeitschriftendatenbank
Aggregation and Indexing Plan
Questions
2

3. Customer Relationship Management
• SugarCRM
• Management of all administrative information
• Organisations, contacts, datasets, projects, etc.
• Important features for project handling
•
•
•
•
Newspaper collections
Cases per specific collection
Aggregation and Indexing Plan
Automatic reporting
3

4. Customer Relationship Management
4

5. Aggregation Workflow – Metadata
●
●
●
●
●
●
●
●
●
●
Scheduling of ingestion
Datasets ready for harvesting
Create case in CRM: case # to provider
Harvesting metadata (OAI-PMH, FTP, ...)
Enhance metadata (VIAF, Geonames, MACS,...)
Indexing in acceptance portal
E-mail to provider to accept dataset
Live index = live portal
Delivery to Europeana
Enhancing and publishing in Europeana
5

6. Aggregation Workflow - Full-text and Images
●
●
●
●
●
●
●
•
Hard-disk delivery by UIBK/CSS
Hard-disk delivery to ULCC
Ingestion and alignment of fulltext and images with
harvested metadata
JPEG 2000 generation for hosted IIP image server
Enrichment with named entities from KB – Not Yet
Indexing into content browser
Adaptations of image viewer for external image servers
E-mail to partner
6

7. Newspaper Content Browser Options
• Questionnaire to content providers determined how the content would
appear in newspaper content browser
• Option 1 - Images and full-text (NLL, NLF)
• Option 2 - Snippets of images and full-text (LFT)
• Option 3 - Full-text only – Not supported (Nobody selected)
• Option 4 - Metadata only – Not supported yet
• Option 5 - Option 1 via external image server (ONB)
• Option 6 - Option 2 via external image server – Not supported yet
7

8. Browser Option 1
8

9. Browser Option 2
9

10. Browser Option 5
10

11. Delivery to Europeana / Zeitschriftendatenbank
●
●
●
●
Metadata from Full and Associate Partners should go into
Newspapers content browser, Europeana portal and
Zeitschriftendatenbank / Union Catalogue of Serials
EDM to Europeana
Duplin Core to Zeitschriftendatenbank
Europeana Data Model delivery should be finalised soon
11

12. Europeana Data Model
12

13. Dublin Core
13

14. Aggregation and Indexing Plan – Q3 2013
14

15. Aggregation and Indexing Plan – Q3 2013
●
●
Österreichische Nationalbibliothek / Austrian National
Library – Option 5
Kansalliskirjasto / National Library of Finland – Option 1
(new)
●
Numbers are not matching hundred percent
15

16. Aggregation and Indexing Plan – Q4 2013
16

17. Aggregation and Indexing Plan – Q4 2013
17

18. Aggregation and Indexing Plan – Q4 2013
●
●
Landesbibliothek Dr. Friedrich Teßmann / Teßmann
Library – Option 2
●
Missing links to original at partner library
Österreichische Nationalbibliothek / Austrian National
Library – Option 5 and 4
●
Metadata only is missing
18

19. Aggregation and Indexing Plan – Q4 2014
●
●
Bibliotheque Nationale de France / National Library France
– Option 6
●
Moved to Q1 2014
Latvijas Nacionala Biblitoteka / National Library of Latvia –
Option 1
●
Missing links to original at partner library
19

20. Aggregation and Indexing Plan – Q4 2013
●
●
●
Landsbókasafn Íslands - Háskólabókasafn / National and
Univeristy Library of Iceland – Associated Partner
National Library of Spain – Associated Partner
Bibliothèque nationale de Luxembourg / National Library of
Luxembourg – Associated Partner
●
Working on it, problems with format
20

21. Aggregation and Indexing Plan – Q1 2014
●
●
●
Bibliotheque Nationale de France / National Library France
– Option 6
Eesti Rahvusraamatukogu / Estonian National Library –
Option 1
Milli Kutuphane Baskanligi / National Library of Turkey –
Option 4
21

22. Aggregation and Indexing Plan – Q1 2014
●
●
●
Staatsbibliothek zu Berlin / Berlin State Library – Option 1
Staats- und Universitätsbibliothek Hamburg / State and
University Library Hamburg – Option 1
Univerzitet u Beogradu / University Library of Belgrade –
Option 1
22

23. Aggregation and Indexing Plan – Q1 2014
●
●
National Library of Wales – Associated Partner
National Library and University Library in Zagreb –
Associated Partner
23

24. Aggregation and Indexing Plan – Q1 2014
●
●
St. Cyril and Methodius National Library / The National
Library of Bulgaria – Associated Partner
National Library of Czech Republic – Associated Partner
24

25. Aggregation and Indexing Plan – Q2 2014
●
●
Bibliotheque Nationale de France / National Library France
– Option 5
Eesti Rahvusraamatukogu / Estonian National Library –
Option 1
25

26. Aggregation and Indexing Plan – Q2 2014
●
●
●
Biblioteka Narodowa / National Library of Poland – Option
2
Staats- und Universitätsbibliothek Hamburg / State and
University Library Hamburg – Option 1
Koninklijke Bibliotheek / National Library of the
Netherlands – Option 5
26

27. Aggregation and Indexing Plan – Q2 2014
●
Narodna in univerzitetna knjižnica / National and University
Library of Slovenia – Associated Partner
●
National Library of Portugal – Associated Partner
●
National Library of Romania – Associated Partner
27

28. Aggregation and Indexing Plan – Q3 2014
●
●
Bibliotheque Nationale de France / National Library France
– Option 5
Eesti Rahvusraamatukogu / Estonian National Library –
Option 1
28

29. Aggregation and Indexing Plan – Q3 2014
●
●
Staatsbibliothek zu Berlin / Berlin State Library – Option 1
Staats- und Universitätsbibliothek Hamburg / State and
University Library Hamburg – Option 1
29

30. Aggregation and Indexing Plan – Q4 2014
●
●
Bibliotheque Nationale de France / National Library France
– Option 5
Eesti Rahvusraamatukogu / Estonian National Library –
Option 1
30

31. Aggregation and Indexing Plan – Q4 2014
●
●
●
Staatsbibliothek zu Berlin / Berlin State Library – Option 1
Staats- und Universitätsbibliothek Hamburg / State and
University Library Hamburg – Option 1
Kansalliskirjasto / National Library of Finland – Option 1
31

32. Operations Officer
Operations Mailbox: collections@theeuropeanlibrary.org
Anastasia Gasia
Junior Operations Officer
anastasia.gasia@kb.nl
32

33. Thank you for your attention!
Markus Muhr (markus.muhr@kb.nl)
www.europeana-newspapers.eu

34. Customer Relationship Management
34

35. Customer Relationship Management
35

36. Aggregation Workflow – Metadata
36

37. Viewing Images
●
●
●
●
●
●
●
●
The European Library hosts images for Option 1 and 2
IIP Image Server with JPEG 2000
Viewing images transformed into JPEG 2000
Ingestion workflow includes transformation step for tifs and
jpgs
Time-demanding operation
Image viewer is IIPMooViewer
Open source projects
Europeana Regia
http://www.theeuropeanlibrary.org/tel4/virtual/regia
37

38. Viewing Images
●
●
●
●
●
●
●
External image servers for Option 5 and 6
Current support of external viewers via iframe
●
Alignment and highlighting not available
Improved usage of content browser via integrated image
viewer
Adaptations for each different kind of image server
Time-demanding task
Existing viewer that can be easily embedded in the
Newspaper Content Browser are preferable
Technical support at partner libraries is necessary
38

39. Aggregation and Indexing Plan
●
●
●
●
●
Plan includes aggregation of partners and 11 associated
partners
Q3 first quarter with indexing work
Aggregation and indexing is aligned with deliveries from
UIBK/CCS
Deliveries to Europeana & Zeitschriftendatenbank from Q4
onwards
Aggregation and indexing is split over multiple quarters for
some partners
39