Overview on digital archiving projects at Zurich University of the Arts (ZHDK, 2008)

1. Juergen Enge 1
media/art/library
media/art/library
content, structure and use of digital media libraries
Dipl. Inform. Jürgen Enge
juergen@info-age.net

2. Juergen Enge 2
media/art/library
Arndt, Olaf; Moonen, Rob
Camera Silens (1994)
Where is the wisdom we have lost in
knowledge?
Where is the knowledge we have lost
in information?
T.S. Eliot, The Rock
(1934)

3. Juergen Enge 3
media/art/library
Björk
All is Full of Love
(2000)

4. Juergen Enge 4
media/art/library
Bubbles (2000)
Wolfgang Münch
Kiyochi Furukawa

5. Juergen Enge 5
media/art/library
Interactive Plant Growing (1993)
Christa Sommerer
Laurent Mignonneau

6. Juergen Enge 6
media/art/library
Cathartic user interface (1995)
Perry Hoberman

7. Juergen Enge 7
media/art/library
Traditional Institutions for Archiving
• Libraries
• books
• atlas, maps and cartographical drawings
• Museums
• plaster mold collections
• collection of prints and drawings
• collection of photography

8. Juergen Enge 8
media/art/library
Aby Warburg:
Mnemosyne Atlas (1925-29)

9. Juergen Enge 9
media/art/library
Aby Warburg:
File-Card Box System

10. Juergen Enge 10
media/art/library
The Rumbling of Archives
Order from Disorder (2002)

11. Juergen Enge 11
media/art/library
“The archive is no longer a matter of discrete objects
(files, books, art works, etc.) stored and retrieved in
specific places (libraries, museums, etc.). Now the
archive is also a continuous stream of data, without
geography or container, continuously transmitted and
therefore without temporal restriction (always available in
the here and now).”
(Geoffrey Batchen, "The Art of Archiving")

12. Juergen Enge 12
media/art/library
Challenges for Contemporary
Archives

13. Juergen Enge 13
media/art/library
Digital Media Collections @ ZHdK (excerpt)
• Medien- und Informationszentrum MIZ
• Several thousand TV recordings
• Institute for Computer Music and Sound Technology
•IDEAMA archive
•Bourges festival archive
• ZHdK Collections for Teaching and Research
• Image archive
• Diploma archives
• Additional collections

14. Juergen Enge 14
media/art/library
IDEAMA

15. Juergen Enge 15
media/art/library
Karlheinz Stockhausen,
»Mikrophonie I«, 1966
Presentation of Mikrophonie 1 at WDR
Cologne,
June 1965; VLNR: Johannes Fritsch, Aloys
Kontarsky, Bernhard Kontarsky, Alfred Alings

16. Juergen Enge 16
media/art/library
IDEAMA

17. Juergen Enge 17
media/art/library
IDEAMA

18. Juergen Enge 18
media/art/library
Work
Composer
Bio [fr]
Bio [de]
Bio [en]
Set 1
Set n
Track 1 Track n
Desc [fr]
Desc [de]
Desc [en]

19. Juergen Enge 19
media/art/library
IMEB Institut de Musique Electroacoustique de Bourges

20. Juergen Enge 20
media/art/library
IMEB Institut de Musique Electroacoustique de Bourges

21. Juergen Enge 21
media/art/library
IMEB
Institut de Musique
Electroacoustique de Bourges

22. Juergen Enge 22
media/art/library
Biography
Work 1
Work n
Description
Medium 1 Medium n
Digital Master

23. Juergen Enge 23
media/art/library
MIZ Medien- und Informationszentrum

24. Juergen Enge 24
media/art/library
MIZ – TV Recordings

25. Juergen Enge 25
media/art/library
Modern Times (1936)
Charlie Chaplin
Ingest

26. Juergen Enge 26
media/art/library
Modern Times (1936)
Charlie Chaplin

27. Juergen Enge 27
media/art/library
Painting and Drawings
Sculpture
Photography
Design Objects
Audio and Video
etc.
Painting and Drawings
Sculpture
Photography
Design Objects
Audio and Video
etc.
Stream of data
Images
Text
Audio and Video
Animation and 3D Graphics
Software
etc.
Images
Text
Audio and Video
Animation and 3D Graphics
Software
etc.
Digital
Master
Digital
Master
Physical Object
Born Digital Data
DigitisationCopy
ArchiveArchive
Ingest
MetadataMetadata
Context
Technical
Metadata

28. Juergen Enge 28
media/art/library
Digitisation
Sign in Korean TV Station SBS (Seoul)

29. Juergen Enge 29
media/art/library
Digitising - Video

30. Juergen Enge 30
media/art/library
Johannes Gfeller - AktiveArchive

31. Juergen Enge 31
media/art/library
Cleaning Process
Fotos: Patricia Falcao / Tabea Lurk

32. Juergen Enge 32
media/art/library
Time Base Correctors and
Video Player
Foto: Johannes Gfeller

33. Juergen Enge 33
media/art/library
Software Interface
AJA IO Box

34. Juergen Enge 34
media/art/library
Player
TBC
A/D
Converter
V
i
d
e
o
Digital
Tape
Recorder
Computer
+ Film
Editing
ProgramA
u
d
i
o
Audio
Mixer
Tape
Digital File
Storage
System
Digitisation Process
Diagram: Patricia Falcao

35. Juergen Enge 35
media/art/library
Digital Preservation
• Long-term, error-free storage of digital information
• “long enough to be concerned with the impacts of changing technologies,
including support for new media and data formats, or with a changing user
community. Long Term may extend indefinitely” (Consultative Committee
for Space Data Systems. OAIS, 2002)
• Preservation metadata
• Preservation metadata stores technical details on the format, structure and
use of the digital content, the history of all actions performed on the
resource including changes and decisions, the authenticity information such
as technical features or custody history, and the responsibilities and rights
information applicable to preservation actions (National Library of Australia.
Preserving Acces to Digital Information)

36. Juergen Enge 36
media/art/library
Storage Systems

37. Juergen Enge 37
media/art/library
Artistic Concept of Preservation
Pickled Film (1973/2005)
Tony Conrad

38. Juergen Enge 38
media/art/library
Ingest

39. Juergen Enge 39
media/art/library
Ingest Process
• Transfer of digital master to long-term-storage
• Creation of transcoded derivates
• Connection of digital master and its derivates with metadata
• Insertion of metadata
• Technical metadata (automatic)
• Content based indexing (automatic)
• Preservation metadata
• Edited metadata (based on predefined conventions)

40. Juergen Enge 40
media/art/library
Sync. Ingest Process

41. Juergen Enge 41
media/art/library
Async. Ingest Process
• ACID
• Atomicity
• Consistency
• Isolation
• Durability

42. Juergen Enge 42
media/art/library
ZHdK Video Transcoding Grid
2008-02-17: 122 Transcodings (Gesamtlänge: 78:52, Durchschnitt: 00:38, Speedup/CPU: 5.46, CPU time: 431:04)
2008-02-16: 126 Transcodings (Gesamtlänge: 124:01, Durchschnitt: 00:59, Speedup/CPU: 5.39, CPU time: 668:21)
2007-12-13: 233 Transcodings (Gesamtlänge: 148:52, Durchschnitt: 00:38, Speedup/CPU: 4.07, CPU time: 605:38)
2007-12-09: 57 Transcodings (Gesamtlänge: 75:43, Durchschnitt: 01:19, Speedup/CPU: 3.81, CPU time: 288:49)
2007-12-08: 191 Transcodings (Gesamtlänge: 104:07, Durchschnitt: 00:32, Speedup/CPU: 3.98, CPU time: 414:34)
2007-12-07: 271 Transcodings (Gesamtlänge: 156:56, Durchschnitt: 00:34, Speedup/CPU: 4.03, CPU time: 632:37)
2007-12-06: 227 Transcodings (Gesamtlänge: 203:39, Durchschnitt: 00:53, Speedup/CPU: 3.92, CPU time: 797:26)
2007-12-05: 163 Transcodings (Gesamtlänge: 157:24, Durchschnitt: 00:57, Speedup/CPU: 3.94, CPU time: 619:28)
2007-12-04: 168 Transcodings (Gesamtlänge: 213:55, Durchschnitt: 01:16, Speedup/CPU: 3.88, CPU time: 829:31)
2007-12-03: 143 Transcodings (Gesamtlänge: 192:13, Durchschnitt: 01:20, Speedup/CPU: 3.82, CPU time: 733:55)
2007-12-02: 139 Transcodings (Gesamtlänge: 177:34, Durchschnitt: 01:16, Speedup/CPU: 3.88, CPU time: 689:41)
2007-12-01: 98 Transcodings (Gesamtlänge: 121:33, Durchschnitt: 01:14, Speedup/CPU: 3.97, CPU time: 482:28)
2007-11-30: 157 Transcodings (Gesamtlänge: 192:48, Durchschnitt: 01:13, Speedup/CPU: 3.92, CPU time: 756:25)
2007-11-29: 89 Transcodings (Gesamtlänge: 108:13, Durchschnitt: 01:12, Speedup/CPU: 3.87, CPU time: 419:00)
2007-11-28: 118 Transcodings (Gesamtlänge: 158:24, Durchschnitt: 01:20, Speedup/CPU: 4.64, CPU time: 735:32)
2007-11-27: 110 Transcodings (Gesamtlänge: 141:19, Durchschnitt: 01:17, Speedup/CPU: 4.71, CPU time: 665:25)
2007-11-26: 71 Transcodings (Gesamtlänge: 85:02, Durchschnitt: 01:11, Speedup/CPU: 4.87, CPU time: 414:07)
2007-11-25: 125 Transcodings (Gesamtlänge: 123:59, Durchschnitt: 00:59, Speedup/CPU: 4.92, CPU time: 610:20)
2007-11-24: 104 Transcodings (Gesamtlänge: 123:31, Durchschnitt: 01:11, Speedup/CPU: 4.79, CPU time: 591:13)

43. Juergen Enge 43
media/art/library

44. Juergen Enge 44
media/art/library
Metadata

45. Juergen Enge 45
media/art/library
Metadata – Dublin Core

46. Juergen Enge 46
media/art/library
Metadata – IFLA

47. Juergen Enge 47
media/art/library
Archival Systems @ ZHdK
• DILPS - Distributed Image Library
Processing System (Open Source)
• Wiki Based Systems
• Audio Archives
• Specialised Systems
• Video Library

48. Juergen Enge 48
media/art/library
DILPS 2.0

49. Juergen Enge 49
media/art/library
• Item centric
• Structural
elements
– Collection
– Item
– Resource
– Media
• Variable
metadata set
Collection
Item

50. Juergen Enge 50
media/art/library
Item Resource

51. Juergen Enge 51
media/art/library
Resource
Main Medium
URN
Preview
URN
(Thumbnail)
Preview
URN
(QVGA)
Preview
URN
(VGA)
URN:
urn:zhdk:library/2789/00:00:05/master
urn:zhdk:library/2789/00:00:05/thumb
…

52. Juergen Enge 52
media/art/library
Arrangement by groups
Group Resource

53. Juergen Enge 53
media/art/library
Metadata
• Core metadata set (fixed)
• Extended metadata set (free, depends on
object type)
• Versioning (no changes to metadata. Only
new sets will be attached and old ones will
reside on database)
• Metadata view depends on object type
(label and fields)

54. Juergen Enge 54
media/art/library
• Special data type: Date
– Every date is an interval
– Datestrings are parsed with predefined regular
expressions
• „Around 1950“
• „17th century“
• „Middle ages“
• „2007-11-04“
• „1973-1977“
– Searching means interval search on two intervals

55. Juergen Enge 55
media/art/library
URN / Storage
• URN resolves to URL based on
– Location
– Access protocol
– urn:hgkz:design/8:2332/9014/thumb
• file:///data/dilps/design/lib01/d/c/120x90_9014.jpg
(direct file system access)
• http://media3.hgkz.ch/dilps2/resource.php/design/li
b01/d/c/120x90_9014.jpg?__SID__ (access via
http protocol)

56. Juergen Enge 56
media/art/library
Authentication
• Domain based authentication model
• Every domain uses its own authentication
subsystem
• Authentication Entities
• User (z.B. zhdk/enge)
• Group (z.B. zhdk/DDE_ITE.dozierende)
• Location (z.B. 192.168.10.12)

57. Juergen Enge 57
media/art/library
AAI Integration
• The DILPS backend is able to accept users from Switch
AAI domain
• Granularity of group information sufficient for many
cases
• Web2.0 Interface doesn‘t allow seemless AAI login (due
to redirect)
• Excellent possibility for cooperation projects with other
institution based on shared media storage
• Eventually additional need for group management tool

58. Juergen Enge 58
media/art/library
• Access Control Lists are
available for all structural
elements
– Collection
– Item
– Resource
– URN
– Group
• Rights
– Read
– Write
– Execute
– Create
– Permission
– Revoke
Authorisation

59. Juergen Enge 59
media/art/library
Playout of digital Media

60. Juergen Enge 60
media/art/library

61. Juergen Enge 61
media/art/library

62. Juergen Enge 62
media/art/library

63. Juergen Enge 63
media/art/library

64. Juergen Enge 64
media/art/library
Eigenwelt der Apparatewelt.
The Net Edition (1992/2006)
Vasulka/Dunn/Weibel/Enge

65. Juergen Enge 65
media/art/library
Infoscreen Playout

66. Juergen Enge 66
media/art/library
Fallende Scheibe 3 (1986)
Dieter Kiessling
Denis_Beaubois___Amnesia_.flv

67. Juergen Enge 67
media/art/library
Amnesia (2002)
Denis Boubeaubois

68. Juergen Enge 68
media/art/library
Amnesia (2002), Denis Beaubois