SlideShare ist ein Scribd-Unternehmen logo
1 von 27
Finding the Balance
An attempt at modeling differentiated storage for digitized collections : finding
the balance between storage, costs and preservation of digitized publications.
Trudie Stoutjesdijk, September 5th 2013
How to find the balance….
Digitization
•Multiple versions of a publication
•Which versions should be stored?
•What representation is the object of preservation?
•How can we reduce the need for storage?
Finding the balance Trudie Stoutjesdijk, September 5th 2013
Agenda
• Who we are
• What we have
• Finding the balance
Finding the balance Trudie Stoutjesdijk, September 5th 2013
Who we are
• National Library
• Strategic Plan 2010-2013
• We offer everyone access to
everything published in and about the
Netherlands
• We improve the national information
infrastructure
• We guarantee long-term storage of
digital information
• We maintain, present and strengthen
our collection
Finding the balance Trudie Stoutjesdijk, September 5th 2013
What we have
1. Collection Development
Programme
2. Collection Care Plan
3. Storage Management
4. Digital Preservation System
Finding the balance Trudie Stoutjesdijk, September 5th 2013
What we have
1. Collection development programme
(2010-2013)
• Collect and preserve everything published in and about
the Netherlands
• Transition from printed to digital format is key priority.
• Collect 50% of all Dutch digital born publications
• Harvest 10.000 websites
• Digitization of all the books, periodicals and
newspapers since 1470 (60 M pages before 2014)
Finding the balance Trudie Stoutjesdijk, September 5th 2013
Finding the balance Trudie Stoutjesdijk, September 5th 2013
Output:
•Digital objects in JPEG2000.
•Different versions of an object: master,
access, back-up, physical publication.
Rapid increase in the number of items and
total cost for storage
What we have
10% of all books, periodicals and newspapers
(since 1470), digitized before 2014.
1. Collection development programme : Digitization
What we have
2. Collection Care Plan
Integrated, efficient and effective collection care for both
physical and digital collections, based on the following principles:
•Integrated collection care for digital files and physical
objects
•Value assessment of collections
•Risk identification
•Differentiated levels of collection care
•Care redirected from the most valuable collections,
to those where the biggest loss of value is expected.
Finding the balance Trudie Stoutjesdijk, September 5th 2013
2. Collection Care
Finding the balance Trudie Stoutjesdijk, September 5th 2013
What we have
Differentiated collection care based on a
rational selection tool: value assessment
•Divide the collections in different collection lots or
categories
•Describe collection units
•Establish the definition of every criterion
•Rate every collection unit
•Calculate the average value
Result: The level and duration of collection care
Primary criteria Secondary criteria
Informational value Use
Aesthetic value Completeness
Historical value Condition
Social value Provenance
What we have
Hierarchical storage management (HSM)
Finding the balance Trudie Stoutjesdijk, September 5th
2013
• Using several tiers defining
different levels of storage
quality.
• Based on different needs.
• Use more than one type of
media (HDD, Magnetic Tape).
3. Storage strategy
What we have
4. Digital Preservation System
•e-Depot system (DIAS)
at the end of its natural life:
•New Digital Preservation System (DPS)
•2012 migration from DIAS to new DPS
•2013 new ingest workflows for
born digital publications.
•Next step: new ingest workflows
for all the digitized collections.
Finding the balance Trudie Stoutjesdijk, September 5th
2013
How to find the balance….
It is impossible to preserve all the versions at the
highest preservation level.
The value assessment provides insight in:
- The level and duration of collection care
- The relation between physical object and
digital counterparts.
- The relation between the state of the physical
object and the necessity of preservation
imaging and sustainable storage.
Finding the balance Trudie Stoutjesdijk, September 5th 2013
A differentiated storage policy has been applied on the
digitized collections; based on the following secondary
values:
• Use
- The availability of digital content for the
customer
• Condition
- The vulnerability of the physical resources
- Sustainability of digital storage
Finding the balance Trudie Stoutjesdijk, September 5th 2013
Finding the balance:
Differentiated storage model for digitized collections
In anticipation of the results of the value assessment we
tried to identify classification levels.
Finding the balance Trudie Stoutjesdijk, September 5th 2013
Collection Care: Classification levels
Preservation
level
1. 2. 3. 4. 5.
Representation available?
-Digital Master No No Master light Preservation
master
Preservation
master
- Access file No Yes Yes Yes Yes
- Physical
original
No Yes Yes Yes Yes
Preservation copy available?
  No No Physical
original
Preservation
master
- Physical original
- Preservation
master
Effort of conservation / preservation care
Active     Physical
original
preservation
master
Physical original
and digital master
Passive   physical
original;
access file
Master light physical
original
 
Finding the balance:
Differentiated storage model for digitized collections
Finding the balance Trudie Stoutjesdijk, September 5th 2013
Collection Care: Classification levels
Finding the balance:
Differentiated storage model for digitized collections
Preservation level 1.
Representation available?
-Digital Master No
- Access file No
- Physical original No
Preservation copy available?
  No
Effort of conservation /
preservation care
Active  
Passive  
Level 1:
-Lowest imaginable level.
-For use only.
-Contains no representations and
there’s nothing to preserve.
-Example: the reference collection
which is being transformed from
physical to digital.
Finding the balance Trudie Stoutjesdijk, September 5th 2013
Collection Care: Classification levels
Finding the balance:
Differentiated storage model for digitized collections
Level 2:
-Digitized for use.
-Contains publications that can be
digitized more than once.
-Condition is good and will continue
under the current circumstances.
-No need for a digital master unless
decay strikes
-Example: all foreign titles of the
Google project
Preservation
level
2.
Representation available?
-Digital Master No
- Access file Yes
- Physical original Yes
Preservation copy available?
  No
Effort of conservation /
preservation care
Active  
Passive physical
original;
access file
Finding the balance Trudie Stoutjesdijk, September 5th 2013
Collection Care: Classification levels
Finding the balance:
Differentiated storage model for digitized collections
Level 3:
-Digitization for use
-Contains objects that represents
multiple values
-Physical object is in a quite good
condition. Can be digitized
repeatedly
-No need for preservation image
-Active preservation: physical
original.
-Example: large parts of the special
collection (18th
century)
Preservation
level
3.
Representation available?
-Digital Master Master light
- Access file Yes
- Physical original Yes
Preservation copy available?
  Physical original
Effort of conservation /
preservation care
Active Physical original
Passive Master light
Finding the balance Trudie Stoutjesdijk, September 5th 2013
Collection Care: Classification levels
Finding the balance:
Differentiated storage model for digitized collections
Level 4:
-For use and preservation
-Objects with high information value,
hardly value as an object.
-The material can be fragile,
digitization can sometimes be done
only once
-Maintenance of the physical object
may not be possible in the future
-Create high quality preservation
master
-Example: Metamorfoze Nat.
program for the
Preservation of Paper Heritage
Preservation
level
4.
Representation available?
-Digital Master Preservation
master
- Access file Yes
- Physical
original
Yes
Preservation copy available?
  Preservation
master
Effort of conservation / preservation
care
Active preservation
master
Passive physical original
Finding the balance Trudie Stoutjesdijk, September 5th 2013
Collection Care: Classification levels
Finding the balance:
Differentiated storage model for digitized collections
Level 5:
-For use and preservation
-Contains fragile, precious
objects
-Physical object represents
primary values that might not be
reflected in the digital master
-Can only be digitized once
-High quality digital master
-Example: Bookbinding of
William the Silent
Preservation
level
5.
Representation available?
-Digital Master Preservation
master
- Access file Yes
- Physical original Yes
Preservation copy available?
  - Physical original
- Preservation
master
Effort of conservation / preservation
care
Active Physical original
and digital master
Passive  
Finding the balance Trudie Stoutjesdijk, September 5th 2013
Digitized collections and storage costs.
Finding the balance:
Differentiated storage model for digitized collections
Currently the output of digitization process is a digital master
and a digital access file.
Finding the balance Trudie Stoutjesdijk, September 5th 2013
Finding the balance:
Differentiated storage model for digitized collections
Type of publication Total costs
Books Storage/year Digitization / page
Master € 0,01 € 0,72
Access file € 0,008 € 0,56
Master & Access € 0,02 € 1,28
Newspapers Storage Digitization
Master € 0,02 € 1,08
Access file € 0,01 € 0,93
Master & Access € 0,05 € 2,01
Journals Storage Digitization
Master € 0,01 € 0,77
Access file € 0,009 € 0,61
Master & Access € 0,01 € 1,38
Costs based on TCO storage & digitization
Finding the balance Trudie Stoutjesdijk, September 5th 2013
Finding the balance:
Differentiated storage model for digitized collections
Classification levels & Cost savings
The application of the five level classification model reduce the
storage costs of digitized publications for 2 levels.
•level 2 will not contain digital master files. This could reduce
the costs with 30 – 40%.
•level 3 a digital master light will be created; a master light
could require less image quality than a preservation master
which could reduce the size of a digitized publication, less
storage costs.
Finding the balance Trudie Stoutjesdijk, September 5th 2013
Finding the balance:
Differentiated storage model for digitized collections
Alternatives for cost saving
New digital master or digital access files needed:
•The access file no longer meets the requirements of the
user,
•technologies offers new opportunities, possibly better and
smaller digital masters
•the original physical decay appears to be stronger than
expected...
Rescanning and/or conversion?
Finding the balance Trudie Stoutjesdijk, September 5th 2013
Finding the balance:
Differentiated storage model for digitized collections
Rescanning : i.e. re-digitization of (parts of) the collection.
•Level 1 has no objects.
•Level 2 when decay increases
•Level 3 has 2 digital copies, decay / obselescence
•Level 4 & 5 rescanning is undesirable / impossible.
Conversion: generate a digital access file from the digital
master.
•Can offer a solution, for level 4 and 5, (vulnerable physical
collections).
Conversion on the fly: generate a digital access file on
demand
•Suitable for level 3, 4 and 5, access files don’t need to be
stored.
Finding the balance Trudie Stoutjesdijk, September 5th 2013
Finding the balance:
Differentiated storage model for digitized collections
Conversion and/or on the fly conversion
Pro’s
•Appropriate and efficient method for permanent storage and
access of the collections.
•Good solution for the collections at level 4 & 5
•Probably cost saving on production
•Cost saving on storage
Con’s
•A system intensive activity that could create a bottleneck in
the delivery to the end user
•Insufficient knowledge about the technique
•No insight in the costs
Started research on conversion by the Research Department
Finding the balance Trudie Stoutjesdijk, September 5th 2013
Finding the balance:
Differentiated storage model for digitized collections
Wrap up: Tried to realise a model
Lessons learned:
•Value assessment helps to gain insight in the value of
collections
•USE and CONDITION of collections helps to find a balance
between permanent access and costs
•Transparency of the costs.
• Rescanning is not feasible for publications that are in
vulnerable state.
• Conversion might seem preferable to that of rescanning.
• Investigation of the conversion / on-the-fly conversion
technique is necessary to gain insight into the benefits of
this method. In particular with respect to applicability,
performance and efficiency.
Thank you!
Trudie Stoutjesdijk, September 5th 2013

Weitere ähnliche Inhalte

Ähnlich wie Finding the balance ipres2013

RDMRose 1.4 The research data lifecycle
RDMRose 1.4 The research data lifecycleRDMRose 1.4 The research data lifecycle
RDMRose 1.4 The research data lifecycleRDMRose
 
Small Solutions for Small Institutions – Steps Towards Archiving and Preserva...
Small Solutions for Small Institutions – Steps Towards Archiving and Preserva...Small Solutions for Small Institutions – Steps Towards Archiving and Preserva...
Small Solutions for Small Institutions – Steps Towards Archiving and Preserva...ariadnenetwork
 
Online Snack Workshop
Online Snack WorkshopOnline Snack Workshop
Online Snack Workshopdigiadvisors
 
A collaborative approach to "filling the digital preservation gap" for Resear...
A collaborative approach to "filling the digital preservation gap" for Resear...A collaborative approach to "filling the digital preservation gap" for Resear...
A collaborative approach to "filling the digital preservation gap" for Resear...Jenny Mitcham
 
Managing Digital Content Over Time: Identify and Select
Managing Digital Content Over Time: Identify and SelectManaging Digital Content Over Time: Identify and Select
Managing Digital Content Over Time: Identify and SelectRecollection Wisconsin
 
AAAI Documentation Subcommittee
AAAI Documentation SubcommitteeAAAI Documentation Subcommittee
AAAI Documentation SubcommitteeAviationArchives1
 
A collaborative approach to "filling the digital preservation gap" for Resear...
A collaborative approach to "filling the digital preservation gap" for Resear...A collaborative approach to "filling the digital preservation gap" for Resear...
A collaborative approach to "filling the digital preservation gap" for Resear...Jenny Mitcham
 
A collaborative approach to filling the digital preservation gap for RDM
A collaborative approach to filling the digital preservation gap for RDMA collaborative approach to filling the digital preservation gap for RDM
A collaborative approach to filling the digital preservation gap for RDMnortherncollaboration
 
Bulk disposal november 2013
Bulk disposal november 2013Bulk disposal november 2013
Bulk disposal november 2013Agnes Vugts
 
Best Practices for Linked Data Education
Best Practices for Linked Data EducationBest Practices for Linked Data Education
Best Practices for Linked Data EducationAlexander Mikroyannidis
 
Discovery event stuart lee (the humanities researcher)
Discovery event stuart lee (the humanities researcher)Discovery event stuart lee (the humanities researcher)
Discovery event stuart lee (the humanities researcher)RDTF-Discovery
 
Introduction to digital curation
Introduction to digital curationIntroduction to digital curation
Introduction to digital curationGarethKnight
 
Dianne Dahlitz - Community Heritage Grants_case studies
Dianne Dahlitz - Community Heritage Grants_case studiesDianne Dahlitz - Community Heritage Grants_case studies
Dianne Dahlitz - Community Heritage Grants_case studiesMuseum & Gallery Services Qld
 
Introducingthe anu datacommons
Introducingthe anu datacommonsIntroducingthe anu datacommons
Introducingthe anu datacommonsDoug Moncur
 
RDMRose 2.3 Institutional data repository policies
RDMRose 2.3 Institutional data repository policiesRDMRose 2.3 Institutional data repository policies
RDMRose 2.3 Institutional data repository policiesRDMRose
 

Ähnlich wie Finding the balance ipres2013 (19)

RDMRose 1.4 The research data lifecycle
RDMRose 1.4 The research data lifecycleRDMRose 1.4 The research data lifecycle
RDMRose 1.4 The research data lifecycle
 
Archives in museums
Archives in museumsArchives in museums
Archives in museums
 
From Open Access to Open Data: collaborative work in the university libraries...
From Open Access to Open Data: collaborative work in the university libraries...From Open Access to Open Data: collaborative work in the university libraries...
From Open Access to Open Data: collaborative work in the university libraries...
 
Small Solutions for Small Institutions – Steps Towards Archiving and Preserva...
Small Solutions for Small Institutions – Steps Towards Archiving and Preserva...Small Solutions for Small Institutions – Steps Towards Archiving and Preserva...
Small Solutions for Small Institutions – Steps Towards Archiving and Preserva...
 
Online Snack Workshop
Online Snack WorkshopOnline Snack Workshop
Online Snack Workshop
 
In brief oer
In brief oerIn brief oer
In brief oer
 
A collaborative approach to "filling the digital preservation gap" for Resear...
A collaborative approach to "filling the digital preservation gap" for Resear...A collaborative approach to "filling the digital preservation gap" for Resear...
A collaborative approach to "filling the digital preservation gap" for Resear...
 
Managing Digital Content Over Time: Identify and Select
Managing Digital Content Over Time: Identify and SelectManaging Digital Content Over Time: Identify and Select
Managing Digital Content Over Time: Identify and Select
 
AAAI Documentation Subcommittee
AAAI Documentation SubcommitteeAAAI Documentation Subcommittee
AAAI Documentation Subcommittee
 
A collaborative approach to "filling the digital preservation gap" for Resear...
A collaborative approach to "filling the digital preservation gap" for Resear...A collaborative approach to "filling the digital preservation gap" for Resear...
A collaborative approach to "filling the digital preservation gap" for Resear...
 
A collaborative approach to filling the digital preservation gap for RDM
A collaborative approach to filling the digital preservation gap for RDMA collaborative approach to filling the digital preservation gap for RDM
A collaborative approach to filling the digital preservation gap for RDM
 
Ariadne: Lifecycles
Ariadne: LifecyclesAriadne: Lifecycles
Ariadne: Lifecycles
 
Bulk disposal november 2013
Bulk disposal november 2013Bulk disposal november 2013
Bulk disposal november 2013
 
Best Practices for Linked Data Education
Best Practices for Linked Data EducationBest Practices for Linked Data Education
Best Practices for Linked Data Education
 
Discovery event stuart lee (the humanities researcher)
Discovery event stuart lee (the humanities researcher)Discovery event stuart lee (the humanities researcher)
Discovery event stuart lee (the humanities researcher)
 
Introduction to digital curation
Introduction to digital curationIntroduction to digital curation
Introduction to digital curation
 
Dianne Dahlitz - Community Heritage Grants_case studies
Dianne Dahlitz - Community Heritage Grants_case studiesDianne Dahlitz - Community Heritage Grants_case studies
Dianne Dahlitz - Community Heritage Grants_case studies
 
Introducingthe anu datacommons
Introducingthe anu datacommonsIntroducingthe anu datacommons
Introducingthe anu datacommons
 
RDMRose 2.3 Institutional data repository policies
RDMRose 2.3 Institutional data repository policiesRDMRose 2.3 Institutional data repository policies
RDMRose 2.3 Institutional data repository policies
 

Kürzlich hochgeladen

Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...EduSkills OECD
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104misteraugie
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityGeoBlogs
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Krashi Coaching
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfJayanti Pande
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxVishalSingh1417
 
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...PsychoTech Services
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactdawncurless
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdfQucHHunhnh
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactPECB
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Sapana Sha
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfciinovamais
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingTechSoup
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAssociation for Project Management
 
social pharmacy d-pharm 1st year by Pragati K. Mahajan
social pharmacy d-pharm 1st year by Pragati K. Mahajansocial pharmacy d-pharm 1st year by Pragati K. Mahajan
social pharmacy d-pharm 1st year by Pragati K. Mahajanpragatimahajan3
 
General AI for Medical Educators April 2024
General AI for Medical Educators April 2024General AI for Medical Educators April 2024
General AI for Medical Educators April 2024Janet Corral
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingTeacherCyreneCayanan
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)eniolaolutunde
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfagholdier
 
Interactive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationInteractive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationnomboosow
 

Kürzlich hochgeladen (20)

Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activity
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdf
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptx
 
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impact
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy Consulting
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across Sectors
 
social pharmacy d-pharm 1st year by Pragati K. Mahajan
social pharmacy d-pharm 1st year by Pragati K. Mahajansocial pharmacy d-pharm 1st year by Pragati K. Mahajan
social pharmacy d-pharm 1st year by Pragati K. Mahajan
 
General AI for Medical Educators April 2024
General AI for Medical Educators April 2024General AI for Medical Educators April 2024
General AI for Medical Educators April 2024
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writing
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
Interactive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationInteractive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communication
 

Finding the balance ipres2013

  • 1. Finding the Balance An attempt at modeling differentiated storage for digitized collections : finding the balance between storage, costs and preservation of digitized publications. Trudie Stoutjesdijk, September 5th 2013
  • 2. How to find the balance…. Digitization •Multiple versions of a publication •Which versions should be stored? •What representation is the object of preservation? •How can we reduce the need for storage? Finding the balance Trudie Stoutjesdijk, September 5th 2013
  • 3. Agenda • Who we are • What we have • Finding the balance Finding the balance Trudie Stoutjesdijk, September 5th 2013
  • 4. Who we are • National Library • Strategic Plan 2010-2013 • We offer everyone access to everything published in and about the Netherlands • We improve the national information infrastructure • We guarantee long-term storage of digital information • We maintain, present and strengthen our collection Finding the balance Trudie Stoutjesdijk, September 5th 2013
  • 5. What we have 1. Collection Development Programme 2. Collection Care Plan 3. Storage Management 4. Digital Preservation System Finding the balance Trudie Stoutjesdijk, September 5th 2013
  • 6. What we have 1. Collection development programme (2010-2013) • Collect and preserve everything published in and about the Netherlands • Transition from printed to digital format is key priority. • Collect 50% of all Dutch digital born publications • Harvest 10.000 websites • Digitization of all the books, periodicals and newspapers since 1470 (60 M pages before 2014) Finding the balance Trudie Stoutjesdijk, September 5th 2013
  • 7. Finding the balance Trudie Stoutjesdijk, September 5th 2013 Output: •Digital objects in JPEG2000. •Different versions of an object: master, access, back-up, physical publication. Rapid increase in the number of items and total cost for storage What we have 10% of all books, periodicals and newspapers (since 1470), digitized before 2014. 1. Collection development programme : Digitization
  • 8. What we have 2. Collection Care Plan Integrated, efficient and effective collection care for both physical and digital collections, based on the following principles: •Integrated collection care for digital files and physical objects •Value assessment of collections •Risk identification •Differentiated levels of collection care •Care redirected from the most valuable collections, to those where the biggest loss of value is expected. Finding the balance Trudie Stoutjesdijk, September 5th 2013
  • 9. 2. Collection Care Finding the balance Trudie Stoutjesdijk, September 5th 2013 What we have Differentiated collection care based on a rational selection tool: value assessment •Divide the collections in different collection lots or categories •Describe collection units •Establish the definition of every criterion •Rate every collection unit •Calculate the average value Result: The level and duration of collection care Primary criteria Secondary criteria Informational value Use Aesthetic value Completeness Historical value Condition Social value Provenance
  • 10. What we have Hierarchical storage management (HSM) Finding the balance Trudie Stoutjesdijk, September 5th 2013 • Using several tiers defining different levels of storage quality. • Based on different needs. • Use more than one type of media (HDD, Magnetic Tape). 3. Storage strategy
  • 11. What we have 4. Digital Preservation System •e-Depot system (DIAS) at the end of its natural life: •New Digital Preservation System (DPS) •2012 migration from DIAS to new DPS •2013 new ingest workflows for born digital publications. •Next step: new ingest workflows for all the digitized collections. Finding the balance Trudie Stoutjesdijk, September 5th 2013
  • 12. How to find the balance…. It is impossible to preserve all the versions at the highest preservation level. The value assessment provides insight in: - The level and duration of collection care - The relation between physical object and digital counterparts. - The relation between the state of the physical object and the necessity of preservation imaging and sustainable storage. Finding the balance Trudie Stoutjesdijk, September 5th 2013
  • 13. A differentiated storage policy has been applied on the digitized collections; based on the following secondary values: • Use - The availability of digital content for the customer • Condition - The vulnerability of the physical resources - Sustainability of digital storage Finding the balance Trudie Stoutjesdijk, September 5th 2013 Finding the balance: Differentiated storage model for digitized collections In anticipation of the results of the value assessment we tried to identify classification levels.
  • 14. Finding the balance Trudie Stoutjesdijk, September 5th 2013 Collection Care: Classification levels Preservation level 1. 2. 3. 4. 5. Representation available? -Digital Master No No Master light Preservation master Preservation master - Access file No Yes Yes Yes Yes - Physical original No Yes Yes Yes Yes Preservation copy available?   No No Physical original Preservation master - Physical original - Preservation master Effort of conservation / preservation care Active     Physical original preservation master Physical original and digital master Passive   physical original; access file Master light physical original   Finding the balance: Differentiated storage model for digitized collections
  • 15. Finding the balance Trudie Stoutjesdijk, September 5th 2013 Collection Care: Classification levels Finding the balance: Differentiated storage model for digitized collections Preservation level 1. Representation available? -Digital Master No - Access file No - Physical original No Preservation copy available?   No Effort of conservation / preservation care Active   Passive   Level 1: -Lowest imaginable level. -For use only. -Contains no representations and there’s nothing to preserve. -Example: the reference collection which is being transformed from physical to digital.
  • 16. Finding the balance Trudie Stoutjesdijk, September 5th 2013 Collection Care: Classification levels Finding the balance: Differentiated storage model for digitized collections Level 2: -Digitized for use. -Contains publications that can be digitized more than once. -Condition is good and will continue under the current circumstances. -No need for a digital master unless decay strikes -Example: all foreign titles of the Google project Preservation level 2. Representation available? -Digital Master No - Access file Yes - Physical original Yes Preservation copy available?   No Effort of conservation / preservation care Active   Passive physical original; access file
  • 17. Finding the balance Trudie Stoutjesdijk, September 5th 2013 Collection Care: Classification levels Finding the balance: Differentiated storage model for digitized collections Level 3: -Digitization for use -Contains objects that represents multiple values -Physical object is in a quite good condition. Can be digitized repeatedly -No need for preservation image -Active preservation: physical original. -Example: large parts of the special collection (18th century) Preservation level 3. Representation available? -Digital Master Master light - Access file Yes - Physical original Yes Preservation copy available?   Physical original Effort of conservation / preservation care Active Physical original Passive Master light
  • 18. Finding the balance Trudie Stoutjesdijk, September 5th 2013 Collection Care: Classification levels Finding the balance: Differentiated storage model for digitized collections Level 4: -For use and preservation -Objects with high information value, hardly value as an object. -The material can be fragile, digitization can sometimes be done only once -Maintenance of the physical object may not be possible in the future -Create high quality preservation master -Example: Metamorfoze Nat. program for the Preservation of Paper Heritage Preservation level 4. Representation available? -Digital Master Preservation master - Access file Yes - Physical original Yes Preservation copy available?   Preservation master Effort of conservation / preservation care Active preservation master Passive physical original
  • 19. Finding the balance Trudie Stoutjesdijk, September 5th 2013 Collection Care: Classification levels Finding the balance: Differentiated storage model for digitized collections Level 5: -For use and preservation -Contains fragile, precious objects -Physical object represents primary values that might not be reflected in the digital master -Can only be digitized once -High quality digital master -Example: Bookbinding of William the Silent Preservation level 5. Representation available? -Digital Master Preservation master - Access file Yes - Physical original Yes Preservation copy available?   - Physical original - Preservation master Effort of conservation / preservation care Active Physical original and digital master Passive  
  • 20. Finding the balance Trudie Stoutjesdijk, September 5th 2013 Digitized collections and storage costs. Finding the balance: Differentiated storage model for digitized collections Currently the output of digitization process is a digital master and a digital access file.
  • 21. Finding the balance Trudie Stoutjesdijk, September 5th 2013 Finding the balance: Differentiated storage model for digitized collections Type of publication Total costs Books Storage/year Digitization / page Master € 0,01 € 0,72 Access file € 0,008 € 0,56 Master & Access € 0,02 € 1,28 Newspapers Storage Digitization Master € 0,02 € 1,08 Access file € 0,01 € 0,93 Master & Access € 0,05 € 2,01 Journals Storage Digitization Master € 0,01 € 0,77 Access file € 0,009 € 0,61 Master & Access € 0,01 € 1,38 Costs based on TCO storage & digitization
  • 22. Finding the balance Trudie Stoutjesdijk, September 5th 2013 Finding the balance: Differentiated storage model for digitized collections Classification levels & Cost savings The application of the five level classification model reduce the storage costs of digitized publications for 2 levels. •level 2 will not contain digital master files. This could reduce the costs with 30 – 40%. •level 3 a digital master light will be created; a master light could require less image quality than a preservation master which could reduce the size of a digitized publication, less storage costs.
  • 23. Finding the balance Trudie Stoutjesdijk, September 5th 2013 Finding the balance: Differentiated storage model for digitized collections Alternatives for cost saving New digital master or digital access files needed: •The access file no longer meets the requirements of the user, •technologies offers new opportunities, possibly better and smaller digital masters •the original physical decay appears to be stronger than expected... Rescanning and/or conversion?
  • 24. Finding the balance Trudie Stoutjesdijk, September 5th 2013 Finding the balance: Differentiated storage model for digitized collections Rescanning : i.e. re-digitization of (parts of) the collection. •Level 1 has no objects. •Level 2 when decay increases •Level 3 has 2 digital copies, decay / obselescence •Level 4 & 5 rescanning is undesirable / impossible. Conversion: generate a digital access file from the digital master. •Can offer a solution, for level 4 and 5, (vulnerable physical collections). Conversion on the fly: generate a digital access file on demand •Suitable for level 3, 4 and 5, access files don’t need to be stored.
  • 25. Finding the balance Trudie Stoutjesdijk, September 5th 2013 Finding the balance: Differentiated storage model for digitized collections Conversion and/or on the fly conversion Pro’s •Appropriate and efficient method for permanent storage and access of the collections. •Good solution for the collections at level 4 & 5 •Probably cost saving on production •Cost saving on storage Con’s •A system intensive activity that could create a bottleneck in the delivery to the end user •Insufficient knowledge about the technique •No insight in the costs Started research on conversion by the Research Department
  • 26. Finding the balance Trudie Stoutjesdijk, September 5th 2013 Finding the balance: Differentiated storage model for digitized collections Wrap up: Tried to realise a model Lessons learned: •Value assessment helps to gain insight in the value of collections •USE and CONDITION of collections helps to find a balance between permanent access and costs •Transparency of the costs. • Rescanning is not feasible for publications that are in vulnerable state. • Conversion might seem preferable to that of rescanning. • Investigation of the conversion / on-the-fly conversion technique is necessary to gain insight into the benefits of this method. In particular with respect to applicability, performance and efficiency.
  • 27. Thank you! Trudie Stoutjesdijk, September 5th 2013