IIIF: International Image Interoperability Framework @ DLF2012
1. Tom Cramer
Chief Technology Strategist
Stanford University Libraries
Digital Library Federation (DLF) Forum
Denver, Colorado * 4 November 2012
2.
3. Image
$, Mellon?, interoperable Bodeguita del
JISC, CLIR framework Medio 3/19/11
Sean Neil Tom
Web services
djatoka Rich Clients + API
Html 5
Consortial
development
Oxford, BnF, NPDL, LoC, Small donation
Stanford, KB?, Europeana, BL,
Norway?, JHU Free-for- academic
license?
5. Because Digital Image Delivery isâŚ
âŚtoo hard
âŚtoo slow
âŚtoo expensive
âŚtoo disjointed
âŚtoo ugly
âŚand we <repositories, software developers,
users, funders> suffer because of it.
6. Consider
âŚa paleographer who would like to compare
scribal hands from manuscripts at two different
repositories
âŚan art & architecture instructor who would like
to assemble a teaching collection of images from
multiple sources
âŚa humanities scholar who would like to
annotate a high resolution image of an historical
map (but her preferred annotation tool only is
deployed against other sites)
7. Consider
âŚa repository manager who would like to
drop a newspaper viewer with deep zoom
into his site with no development or
customization required
âŚa funder who would like to underwrite the
digitization of a new scholarly resource, but
doesnât want to pay for the development of
yet another, stand-alone, digital collection
web site from scratch
8. IIIF Participants*
⢠Bibliothèque nationale de
France
⢠The British Library
⢠Cornell University
⢠Los Alamos National Library
⢠National Library of Norway
⢠Oxford University
⢠Stanford University
with latter day contributions from
⢠ARTStor
⢠The National Archives
(UK)
* With support from the Andrew J. Mellon Foundation
19. Digital Medieval Manuscripts Today:
A World of Silos & Duplication
Parker App Rose App Gallica St. Gall App App X
Parker Rose BnF St. Gall X
Data Store Data Store Data Store Data Store Data Store
⢠Every repo a silo (ď no interoperability)
⢠Every app a one-off (ď overhead to code and keep)
⢠Every user forced to cope (ď many UIs, little
integration)
20. Distinct Concerns
Build useful
tools and apps
Scholars Want: Users &
resources
Find, Use, Tool
Analyze, Annotate Makers
Want: Mix &
Match, Best of
Breed
Repositories
Host, Preserve (and Enrich) Resources
Want: Use of Resources, Enriching
services, Enriched content
21. APIâs Enable Reuse
Applications Dictionary of TPEN
Parker App
User interfaces Old English Transcription Tool
present DMS data
with specialized Image Image Image Trans-
Des- Des-
tools and contexts Delivery Delivery Search Delivery criptions
cription cription
Import & Export
DMS apps and tools can both
API's consume and contribute data
I' s
AP
RESTful via common web services. E.g.,
Web Services transcriptions or annotations
can be deposited in the source
repository, enriching the corpus
Repository Parker Data
for future researchers.
Canonical Data Store
for Images, Description,
and TechMD
Images MD Annot.
22. APIâs -> Framework -> Ecosystem
Annotation & Cross Repository Search
Transcription Tools & Delivery Environments
Parker App Gallica
Image Trans- Image
Delivery criptions Delivery Search
Image Des- Image Des-
Delivery Search cription Delivery Search cription
's
I's
I's
I' s
I
AP
AP
AP
AP
Parker Data Oxford Data Rose Data BnF Data
Images MD Annot. Images MD Annot. Images MD Annot. Images MD Annot.
23. IIIF Objectives
⢠Define APIs for
â Image Delivery
â Metadata (to drive image presentation)
â Search (to drive image-based interactions)
⢠Trial API adoption (for proof of concept)
⢠Catalyze software development
â Zoomers, Viewers, Page Turners, Anno tools
â Figure out what to do with Djatoka
⢠Establish an ongoing effort
26. IIIF Metadata
⢠Just enough metadata to drive interoperable image
delivery
â labels, title, sequence, attribution, etc.
⢠Based on http://shared-canvas.org
â Synthesis of OAC (Open Anno. Collab.) and DMS
⢠Relate parts of image-based resources
â Images, Text, Annotations, Transcriptions, Sequence /
Structure
⢠Good URIâs for linking data
⢠Support for annotation tools & initiatives
â Open Annotation Collaboration
27. IIIF Search
⢠Scope = Search within an object
⢠Enough functionality to drive an interoperable
viewing environment
⢠Support for full text hits with coordinates for
hit-highlighting
⢠Work in progress: substantial overlap with
metadata API
28. Software Tiers from a IIIF View
Tier Functionality Implementations
⢠Page Turners, ⢠IIP Client
Domain &
⢠Scroll Viewers ⢠MediaInfo (Norway)
Modality-specific ⢠Gallery Views, Cover Flow ⢠IA BookReader
Delivery Apps ⢠Show All & Zoom ⢠Etc.
⢠(Deep) Zoom ⢠IIP Client
Image Clients ⢠Pan ⢠SeaDragon / SeaJax
⢠Rotate ⢠MediaInfo (Norway)
⢠ZPR (Stanford)
Authentication & Authorization
IIIF Image API
⢠(Tiled) Image Delivery ⢠Djatoka
Image Server
29. IIIF Software Wishlist
⢠Performant, community-supported djatoka (or
equivalent)
⢠Super-slippy suite of zoom-pan-rotate clients
⢠âNext generationâ page turners, cover flow &
gallery view clients
⢠Comparative and analytic tools
â multi-up, annotation, transcription
⢠Open source AND Commercial solutions
30. Resource Interop: Images
Web Application â Institution A
âVirtualâ Collection of
Distributed Resources, e.g.,
Image 1 Image 2 Image 3 ⢠Teaching Collection
Institution A Institution B Institution C ⢠Cross-Repository Search
⢠Personal Research
Resources Collected from
the Web
Image 4 Image 5 Image 6 DescMD & Deep
Institution D Institution A Institution D Link for Resource 6
via IIIF MD API
Web App â Institution A
31. Resource Interop: Viewers
Web Application â Institution A
+
_
MS Image 1
Institution D
MS Image 2
Institution B
S Image 1
stitution D
Book Reader Software - Tool Maker X Deep Zoom Client -- Tool Maker Y
Web App â Institution A
32. Resource Interop: Analytic SW
Web Application â Institution A
Annotation Tool
Map Image 1 Map Image 2
Institution D Institution E Xcription Tool
Georeferencing
Tool
Map Image 3 Map Image 4 Image Analytics
Institution B Institution D Tools
MultiUp Comparison Viewer - Tool Maker X
Web App â Institution A
33. Timeframe
⢠One year planning effort: Sept 2011 â Aug 2012
⢠3 workshops (Sept, Apr, July)
⢠Dissemination events
⢠Next steps
â Deploy it
â Test / Prove it
â Develop software that leverages it
â Expand it
â Sustain it
34. So whatâs the IIIF?
⢠Spec some APIâs
⢠Expose some resources
⢠Build some software
⢠Establish a community
35. IIIF and You
⢠Deploy the image API
⢠Help spec/test the metadata & search APIâs
⢠Work with us on API-compliant software
â Djatoka (or replacement), Zoomers, Viewers
⢠Share use cases
⢠Join the group for the next phase of workâŚ
An idea is born at dinner after DMS Tech Meeting #3 among the BL, Oxford and Stanford: if it works for Manuscripts, why canât the same principles and some of the same tools also work for all image based resources. Idea is diagrammed on the (paper) tablecloth.
An idea is born at dinner after DMS Tech Meeting #3 among the BL, Oxford and Stanford: if it works for Manuscripts, why canât the same principles and some of the same tools also work for all image based resources. Idea is diagrammed on the (paper) tablecloth.
There are bright spots: SeaDragon, Deep Zoom, ChronoZoom, Djatoka, GoogleArt
There are bright spots: SeaDragon, Deep Zoom, ChronoZoom, Djatoka, Google Art Project, Gallica, National Library of Norway newspaper viewer
DMS Tech is a Mellon Funded project
DMS Tech is a Mellon Funded project
Stanfordâs Book Reader (based on the Internet Archive book reader).
Stanford map viewer.
Cornell map viewer.
Cornell book reader (based on DLXS)
Cornell annotated art collection, hosted in Luna.
Oxford one-off manuscript viewer.
Oxford one off viewer.
Gallica from BnF
MediaInfo newspaper viewer from Natâl Library of Norway.
British Library MSS viewer.
The repositories and applications providing access to Digital Medieval Manuscripts in todayâs environment are heavily siloâed, with access to each repository provided through one off applications. This is a microcosm of the wider world of access to image based scholarly resources.
The repositories and applications providing access to Digital Medieval Manuscripts in todayâs environment are heavily siloâed, with access to each repository provided through one off applications. This is a microcosm of the wider world of access to image based scholarly resources.
APIâs to access image and description from a repository enable access to content from other applications and systems for viewing or analytics (transcription, annotation, e.g.) Some of this data could be reimported to the repository for reuse by others (e.g., transcriptions).
If multiple repositories supported the same APIâs for access to images, metadata and annotations, one can envision the beginnings of a framework with shared application code across different sites, and interoperable image-based resources, enabling simultaneous access to multiple scholarly repositories through a single interface.