SlideShare ist ein Scribd-Unternehmen logo
1 von 29
Downloaden Sie, um offline zu lesen
Interoperability 
A quick chat, a few war stories...
The OPF team 
Community Manager 
● Events (face-to-face/virtual) 
● Training (staff development) 
● Comms (web/email/social) 
Executive Director 
● Membership (engagement/value) 
● Open preservation advocacy 
● Operational management 
Technical Lead 
● Infrastructure (host/test) 
● Software stewardship (roadmap/maturity/packaging) 
● Data corpora
About OPF 
Trying to help institutions create robust 
digital preservation workflows by: 
● sharing knowledge and best 
practise; 
● improving the quality of digital 
preservation software.
Introduction 
Here to set the scene by: 
● Defining interoperability 
● Providing a personal perspective 
● Covering a few engineering fundamentals 
● Looking for an easier way
Interoperability 
“is the ability of making systems and 
organisations work together (inter-operate).” 
straight from Wikipedia
Origins? 
Coined in IT and system services to allow for 
information exchange.
But it’s not just an IT thing 
A broader definition also considers: 
● social issues 
● political & organisational factors 
that “impact system to system performance”
Another “definition” 
“Task of building coherent services for users 
when the individual components are technically 
difficult and managed by different 
organisations.” 
Wikipedia again
Who’s in the interoperability game? 
● Information professionals 
● Software engineers 
● Staff who work on distributed projects 
● People dealing with complexity
Sound like anyone we know? 
So those of us lucky enough to work in IT for 
Information professionals on collaborative projects 
it’s welcome to interoperability X 3…..
It’s an older problem than IT 
=?
Old and international...
But IT does it better... 
The UK NHS National Program for IT 
● biggest civilian IT project of its kind 
● “mashups” for health records 
● in theory 2003 - 2007 costing £2.4 billion 
● in reality 2003 - 2011 costing £13 billion 
● incidentally it didn’t work…….
But it’s possible in real life
And it’s possible in IT….. 
Think of a system that is: 
● decentralised 
● fault tolerant 
● built on simple building blocks
What would that look like?
Things to think about 
● simplicity 
● standards 
● clarity 
● test early 
● test often
Small is beautiful 
● small parts can build beautiful robust wholes 
● it’s one way of tackling complexity 
● BUT the parts need testable, tested and reliable
Standards are your friends 
It’s always worth checking if there’s a standard 
available and in use but: 
● there’s often more than one 
● they’re not always easy to understand 
● they’re hostage to commercial interests
Be clear in your intentions 
Again simplicity / small size helps here 
● Document clearly and publicly 
● Keep it up to date 
● If you’re not willing to explain how it works….
Test early and often 
And test the parts together rather than as well as 
separately 
Technologies to automate testing: 
● virtualisation 
● online public continuous integration
Interoperability is the future 
The Internet of Things is gathering pace 
Information exchange happening between more 
and more devices, more regularly. 
REST, XML, Json
But it’s NEVER finished 
Two aspects of interoperability: 
● Syntactically interoperable 
● Semantically interoperable 
That’s to say speaking the same language is one 
thing, understanding what the other is saying is 
another…..
Why data is a special problem 
In the cultural heritage sector 
● shared data == shared problems 
● legal issues (IPR) means we don’t share as we 
should
Moving the mountain 
Moving the large volume takes way too long…. 
● If I want to move > 5 TB for processing 
● THEN move the results back…..
A better way….. 
It’s now MUCH easier to move the application to 
the data: 
● It’s more secure 
● virtual machines are approx. 300 MB 
● Docker - application containers
So the oldest interoperability story? 
● It might not be the oldest but it’s close, 
● about old school integration issues. 
● Something of a cautionary tale, 
● it didn’t end well…..
The Tower of Babel
My Details 
● Carl Wilson 
● Technical Lead 
● Open Planets Foundation 
● Email : carl@openplanetsfoundation.org 
● Skype : carl.f.wilson 
● GitHub : carlwilson 
● Twitter : @openplanets 
● Google+ : carl@openplanetsfoundation.org

Weitere ähnliche Inhalte

Was ist angesagt?

Blockchain Technology and Its Application in Artificial Intelligence and Mach...
Blockchain Technology and Its Application in Artificial Intelligence and Mach...Blockchain Technology and Its Application in Artificial Intelligence and Mach...
Blockchain Technology and Its Application in Artificial Intelligence and Mach...Dr. Kotrappa Sirbi
 
COMIT Community Day Spring 2019 - Blockchain
COMIT Community Day Spring 2019 - BlockchainCOMIT Community Day Spring 2019 - Blockchain
COMIT Community Day Spring 2019 - BlockchainComit Projects Ltd
 
ICT - data, information and knowledge
ICT - data, information and knowledgeICT - data, information and knowledge
ICT - data, information and knowledgeElliot Mackness
 
Introduction to Internet of Things
Introduction to Internet of ThingsIntroduction to Internet of Things
Introduction to Internet of ThingsNikhil Patankar
 
Artificial intelligence 2.0 on blockchain
Artificial intelligence 2.0 on blockchainArtificial intelligence 2.0 on blockchain
Artificial intelligence 2.0 on blockchainEvent Horizons
 
Log Mining: Beyond Log Analysis
Log Mining: Beyond Log AnalysisLog Mining: Beyond Log Analysis
Log Mining: Beyond Log AnalysisAnton Chuvakin
 
Blockchain abstract
Blockchain abstractBlockchain abstract
Blockchain abstractManiDeepak10
 
P14 towards using blockchain technology for e health
P14 towards using blockchain technology for e healthP14 towards using blockchain technology for e health
P14 towards using blockchain technology for e healthdevid8
 
Has Internet of Things really happened?
Has Internet of Things really happened? Has Internet of Things really happened?
Has Internet of Things really happened? Opher Etzion
 
In Search of Simplicity: Redesigning the Digital Bleek and Lloyd
In Search of Simplicity: Redesigning the Digital Bleek and LloydIn Search of Simplicity: Redesigning the Digital Bleek and Lloyd
In Search of Simplicity: Redesigning the Digital Bleek and LloydLighton Phiri
 
Unit & Ubiquitous IoT for securing cyberentities
Unit & Ubiquitous IoT for securing cyberentitiesUnit & Ubiquitous IoT for securing cyberentities
Unit & Ubiquitous IoT for securing cyberentitiesDikShaant Kripalani
 
Thomas Zakrzewski, EgisData. What is missing in blockchain to achieve scalabi...
Thomas Zakrzewski, EgisData. What is missing in blockchain to achieve scalabi...Thomas Zakrzewski, EgisData. What is missing in blockchain to achieve scalabi...
Thomas Zakrzewski, EgisData. What is missing in blockchain to achieve scalabi...IT Arena
 
Artificial Intelligence 2.0: Cognitive Mesh with Blockchain
Artificial Intelligence 2.0: Cognitive Mesh with BlockchainArtificial Intelligence 2.0: Cognitive Mesh with Blockchain
Artificial Intelligence 2.0: Cognitive Mesh with BlockchainBICA Labs
 
Eris Industries - An Introduction at BitcoinNYC Meetup
Eris Industries - An Introduction at BitcoinNYC MeetupEris Industries - An Introduction at BitcoinNYC Meetup
Eris Industries - An Introduction at BitcoinNYC MeetupJan Hendrik Scheufen
 
Future (ICT) Technologies
Future (ICT) TechnologiesFuture (ICT) Technologies
Future (ICT) TechnologiesLeo Gaggl
 

Was ist angesagt? (16)

Blockchain Technology and Its Application in Artificial Intelligence and Mach...
Blockchain Technology and Its Application in Artificial Intelligence and Mach...Blockchain Technology and Its Application in Artificial Intelligence and Mach...
Blockchain Technology and Its Application in Artificial Intelligence and Mach...
 
COMIT Community Day Spring 2019 - Blockchain
COMIT Community Day Spring 2019 - BlockchainCOMIT Community Day Spring 2019 - Blockchain
COMIT Community Day Spring 2019 - Blockchain
 
Presentation1
Presentation1Presentation1
Presentation1
 
ICT - data, information and knowledge
ICT - data, information and knowledgeICT - data, information and knowledge
ICT - data, information and knowledge
 
Introduction to Internet of Things
Introduction to Internet of ThingsIntroduction to Internet of Things
Introduction to Internet of Things
 
Artificial intelligence 2.0 on blockchain
Artificial intelligence 2.0 on blockchainArtificial intelligence 2.0 on blockchain
Artificial intelligence 2.0 on blockchain
 
Log Mining: Beyond Log Analysis
Log Mining: Beyond Log AnalysisLog Mining: Beyond Log Analysis
Log Mining: Beyond Log Analysis
 
Blockchain abstract
Blockchain abstractBlockchain abstract
Blockchain abstract
 
P14 towards using blockchain technology for e health
P14 towards using blockchain technology for e healthP14 towards using blockchain technology for e health
P14 towards using blockchain technology for e health
 
Has Internet of Things really happened?
Has Internet of Things really happened? Has Internet of Things really happened?
Has Internet of Things really happened?
 
In Search of Simplicity: Redesigning the Digital Bleek and Lloyd
In Search of Simplicity: Redesigning the Digital Bleek and LloydIn Search of Simplicity: Redesigning the Digital Bleek and Lloyd
In Search of Simplicity: Redesigning the Digital Bleek and Lloyd
 
Unit & Ubiquitous IoT for securing cyberentities
Unit & Ubiquitous IoT for securing cyberentitiesUnit & Ubiquitous IoT for securing cyberentities
Unit & Ubiquitous IoT for securing cyberentities
 
Thomas Zakrzewski, EgisData. What is missing in blockchain to achieve scalabi...
Thomas Zakrzewski, EgisData. What is missing in blockchain to achieve scalabi...Thomas Zakrzewski, EgisData. What is missing in blockchain to achieve scalabi...
Thomas Zakrzewski, EgisData. What is missing in blockchain to achieve scalabi...
 
Artificial Intelligence 2.0: Cognitive Mesh with Blockchain
Artificial Intelligence 2.0: Cognitive Mesh with BlockchainArtificial Intelligence 2.0: Cognitive Mesh with Blockchain
Artificial Intelligence 2.0: Cognitive Mesh with Blockchain
 
Eris Industries - An Introduction at BitcoinNYC Meetup
Eris Industries - An Introduction at BitcoinNYC MeetupEris Industries - An Introduction at BitcoinNYC Meetup
Eris Industries - An Introduction at BitcoinNYC Meetup
 
Future (ICT) Technologies
Future (ICT) TechnologiesFuture (ICT) Technologies
Future (ICT) Technologies
 

Andere mochten auch

5. The European Library and Europeana. Alastair Dunning and Pavel Kats
5. The European Library and Europeana. Alastair Dunning and Pavel Kats5. The European Library and Europeana. Alastair Dunning and Pavel Kats
5. The European Library and Europeana. Alastair Dunning and Pavel KatsIMPACT Centre of Competence
 
8. (Semantic Interoperability in the CLARIN infrastructure. Menzo Windhouwer....
8. (Semantic Interoperability in the CLARIN infrastructure. Menzo Windhouwer....8. (Semantic Interoperability in the CLARIN infrastructure. Menzo Windhouwer....
8. (Semantic Interoperability in the CLARIN infrastructure. Menzo Windhouwer....IMPACT Centre of Competence
 
6. Digital Humanities Innovation Lab (LINHD). Clara Martínez Cantón
6.  Digital Humanities Innovation Lab (LINHD). Clara Martínez Cantón6.  Digital Humanities Innovation Lab (LINHD). Clara Martínez Cantón
6. Digital Humanities Innovation Lab (LINHD). Clara Martínez CantónIMPACT Centre of Competence
 
9. 'Quick summary of answers'. Rafael Carrasco-Succeed.
9. 'Quick summary of answers'. Rafael Carrasco-Succeed. 9. 'Quick summary of answers'. Rafael Carrasco-Succeed.
9. 'Quick summary of answers'. Rafael Carrasco-Succeed. IMPACT Centre of Competence
 
2. Interoperability framework and Taverna. Enrique Molla, Succeed Project.
2. Interoperability framework and Taverna. Enrique Molla, Succeed Project. 2. Interoperability framework and Taverna. Enrique Molla, Succeed Project.
2. Interoperability framework and Taverna. Enrique Molla, Succeed Project. IMPACT Centre of Competence
 
7. Technical development at the Meertens Institute. Marc Kemps Snijders.
7. Technical development at the Meertens Institute. Marc Kemps Snijders.7. Technical development at the Meertens Institute. Marc Kemps Snijders.
7. Technical development at the Meertens Institute. Marc Kemps Snijders.IMPACT Centre of Competence
 

Andere mochten auch (7)

3. The Preforma PCP. Bert Lemmens
3. The Preforma PCP. Bert Lemmens 3. The Preforma PCP. Bert Lemmens
3. The Preforma PCP. Bert Lemmens
 
5. The European Library and Europeana. Alastair Dunning and Pavel Kats
5. The European Library and Europeana. Alastair Dunning and Pavel Kats5. The European Library and Europeana. Alastair Dunning and Pavel Kats
5. The European Library and Europeana. Alastair Dunning and Pavel Kats
 
8. (Semantic Interoperability in the CLARIN infrastructure. Menzo Windhouwer....
8. (Semantic Interoperability in the CLARIN infrastructure. Menzo Windhouwer....8. (Semantic Interoperability in the CLARIN infrastructure. Menzo Windhouwer....
8. (Semantic Interoperability in the CLARIN infrastructure. Menzo Windhouwer....
 
6. Digital Humanities Innovation Lab (LINHD). Clara Martínez Cantón
6.  Digital Humanities Innovation Lab (LINHD). Clara Martínez Cantón6.  Digital Humanities Innovation Lab (LINHD). Clara Martínez Cantón
6. Digital Humanities Innovation Lab (LINHD). Clara Martínez Cantón
 
9. 'Quick summary of answers'. Rafael Carrasco-Succeed.
9. 'Quick summary of answers'. Rafael Carrasco-Succeed. 9. 'Quick summary of answers'. Rafael Carrasco-Succeed.
9. 'Quick summary of answers'. Rafael Carrasco-Succeed.
 
2. Interoperability framework and Taverna. Enrique Molla, Succeed Project.
2. Interoperability framework and Taverna. Enrique Molla, Succeed Project. 2. Interoperability framework and Taverna. Enrique Molla, Succeed Project.
2. Interoperability framework and Taverna. Enrique Molla, Succeed Project.
 
7. Technical development at the Meertens Institute. Marc Kemps Snijders.
7. Technical development at the Meertens Institute. Marc Kemps Snijders.7. Technical development at the Meertens Institute. Marc Kemps Snijders.
7. Technical development at the Meertens Institute. Marc Kemps Snijders.
 

Ähnlich wie Interoperability challenges and opportunities in digital preservation

State of the art in Natural Language Processing (March 2019)
State of the art in Natural Language Processing (March 2019)State of the art in Natural Language Processing (March 2019)
State of the art in Natural Language Processing (March 2019)Liad Magen
 
The network as a design material: Interaction 16 workshop
The network as a design material: Interaction 16 workshopThe network as a design material: Interaction 16 workshop
The network as a design material: Interaction 16 workshopHelen Le Voi
 
The network as a design material: Interaction 16 workshop
The network as a design material: Interaction 16 workshopThe network as a design material: Interaction 16 workshop
The network as a design material: Interaction 16 workshopClaire Rowland
 
How Did We End up Here?
 How Did We End up Here? How Did We End up Here?
How Did We End up Here?C4Media
 
D.3.1: State of the Art - Linked Data and Digital Preservation
D.3.1: State of the Art - Linked Data and Digital PreservationD.3.1: State of the Art - Linked Data and Digital Preservation
D.3.1: State of the Art - Linked Data and Digital PreservationPRELIDA Project
 
Python enterprise vento di liberta
Python enterprise vento di libertaPython enterprise vento di liberta
Python enterprise vento di libertaSimone Federici
 
AMW43 - Unba.se, Distributed database for human interaction
AMW43 - Unba.se, Distributed database for human interactionAMW43 - Unba.se, Distributed database for human interaction
AMW43 - Unba.se, Distributed database for human interactionDaniel Norman
 
Data Collaboration Stack
Data Collaboration StackData Collaboration Stack
Data Collaboration StackPierre Brunelle
 
2021 Trends from the Trenches
2021 Trends from the Trenches2021 Trends from the Trenches
2021 Trends from the TrenchesChris Dagdigian
 
Bringing it all together
Bringing it all togetherBringing it all together
Bringing it all togetherMelissaMcKay15
 
Rapid Data Analytics @ Netflix
Rapid Data Analytics @ NetflixRapid Data Analytics @ Netflix
Rapid Data Analytics @ NetflixMonisha Kanoth
 
Rapid Data Analytics @ Netflix
Rapid Data Analytics @ NetflixRapid Data Analytics @ Netflix
Rapid Data Analytics @ NetflixData Con LA
 
unba.se - ACM CSCW 2017 - IWCES15
unba.se - ACM CSCW 2017 - IWCES15unba.se - ACM CSCW 2017 - IWCES15
unba.se - ACM CSCW 2017 - IWCES15Daniel Norman
 
FAIR data_ Superior data visibility and reuse without warehousing.pdf
FAIR data_ Superior data visibility and reuse without warehousing.pdfFAIR data_ Superior data visibility and reuse without warehousing.pdf
FAIR data_ Superior data visibility and reuse without warehousing.pdfAlan Morrison
 
Simply Business' Data Platform
Simply Business' Data PlatformSimply Business' Data Platform
Simply Business' Data PlatformDani Solà Lagares
 
Big Data & Social Analytics presentation
Big Data & Social Analytics presentationBig Data & Social Analytics presentation
Big Data & Social Analytics presentationgustavosouto
 
The working architecture of NodeJS applications, Виктор Турский
The working architecture of NodeJS applications, Виктор ТурскийThe working architecture of NodeJS applications, Виктор Турский
The working architecture of NodeJS applications, Виктор ТурскийSigma Software
 
The working architecture of node js applications open tech week javascript ...
The working architecture of node js applications   open tech week javascript ...The working architecture of node js applications   open tech week javascript ...
The working architecture of node js applications open tech week javascript ...Viktor Turskyi
 
Agile Development Overview (with a bit about builds)
Agile Development Overview (with a bit about builds)Agile Development Overview (with a bit about builds)
Agile Development Overview (with a bit about builds)David Benjamin
 

Ähnlich wie Interoperability challenges and opportunities in digital preservation (20)

State of the art in Natural Language Processing (March 2019)
State of the art in Natural Language Processing (March 2019)State of the art in Natural Language Processing (March 2019)
State of the art in Natural Language Processing (March 2019)
 
The network as a design material: Interaction 16 workshop
The network as a design material: Interaction 16 workshopThe network as a design material: Interaction 16 workshop
The network as a design material: Interaction 16 workshop
 
The network as a design material: Interaction 16 workshop
The network as a design material: Interaction 16 workshopThe network as a design material: Interaction 16 workshop
The network as a design material: Interaction 16 workshop
 
How Did We End up Here?
 How Did We End up Here? How Did We End up Here?
How Did We End up Here?
 
D.3.1: State of the Art - Linked Data and Digital Preservation
D.3.1: State of the Art - Linked Data and Digital PreservationD.3.1: State of the Art - Linked Data and Digital Preservation
D.3.1: State of the Art - Linked Data and Digital Preservation
 
Python enterprise vento di liberta
Python enterprise vento di libertaPython enterprise vento di liberta
Python enterprise vento di liberta
 
AMW43 - Unba.se, Distributed database for human interaction
AMW43 - Unba.se, Distributed database for human interactionAMW43 - Unba.se, Distributed database for human interaction
AMW43 - Unba.se, Distributed database for human interaction
 
Legal Engineering
Legal EngineeringLegal Engineering
Legal Engineering
 
Data Collaboration Stack
Data Collaboration StackData Collaboration Stack
Data Collaboration Stack
 
2021 Trends from the Trenches
2021 Trends from the Trenches2021 Trends from the Trenches
2021 Trends from the Trenches
 
Bringing it all together
Bringing it all togetherBringing it all together
Bringing it all together
 
Rapid Data Analytics @ Netflix
Rapid Data Analytics @ NetflixRapid Data Analytics @ Netflix
Rapid Data Analytics @ Netflix
 
Rapid Data Analytics @ Netflix
Rapid Data Analytics @ NetflixRapid Data Analytics @ Netflix
Rapid Data Analytics @ Netflix
 
unba.se - ACM CSCW 2017 - IWCES15
unba.se - ACM CSCW 2017 - IWCES15unba.se - ACM CSCW 2017 - IWCES15
unba.se - ACM CSCW 2017 - IWCES15
 
FAIR data_ Superior data visibility and reuse without warehousing.pdf
FAIR data_ Superior data visibility and reuse without warehousing.pdfFAIR data_ Superior data visibility and reuse without warehousing.pdf
FAIR data_ Superior data visibility and reuse without warehousing.pdf
 
Simply Business' Data Platform
Simply Business' Data PlatformSimply Business' Data Platform
Simply Business' Data Platform
 
Big Data & Social Analytics presentation
Big Data & Social Analytics presentationBig Data & Social Analytics presentation
Big Data & Social Analytics presentation
 
The working architecture of NodeJS applications, Виктор Турский
The working architecture of NodeJS applications, Виктор ТурскийThe working architecture of NodeJS applications, Виктор Турский
The working architecture of NodeJS applications, Виктор Турский
 
The working architecture of node js applications open tech week javascript ...
The working architecture of node js applications   open tech week javascript ...The working architecture of node js applications   open tech week javascript ...
The working architecture of node js applications open tech week javascript ...
 
Agile Development Overview (with a bit about builds)
Agile Development Overview (with a bit about builds)Agile Development Overview (with a bit about builds)
Agile Development Overview (with a bit about builds)
 

Mehr von IMPACT Centre of Competence

Mehr von IMPACT Centre of Competence (20)

Session6 01.helmut schmid
Session6 01.helmut schmidSession6 01.helmut schmid
Session6 01.helmut schmid
 
Session1 03.hsian-an wang
Session1 03.hsian-an wangSession1 03.hsian-an wang
Session1 03.hsian-an wang
 
Session7 03.katrien depuydt
Session7 03.katrien depuydtSession7 03.katrien depuydt
Session7 03.katrien depuydt
 
Session7 02.peter kiraly
Session7 02.peter kiralySession7 02.peter kiraly
Session7 02.peter kiraly
 
Session6 04.giuseppe celano
Session6 04.giuseppe celanoSession6 04.giuseppe celano
Session6 04.giuseppe celano
 
Session6 03.sandra young
Session6 03.sandra youngSession6 03.sandra young
Session6 03.sandra young
 
Session6 02.jeremi ochab
Session6 02.jeremi ochabSession6 02.jeremi ochab
Session6 02.jeremi ochab
 
Session5 04.evangelos varthis
Session5 04.evangelos varthisSession5 04.evangelos varthis
Session5 04.evangelos varthis
 
Session5 03.george rehm
Session5 03.george rehmSession5 03.george rehm
Session5 03.george rehm
 
Session5 02.tom derrick
Session5 02.tom derrickSession5 02.tom derrick
Session5 02.tom derrick
 
Session5 01.rutger vankoert
Session5 01.rutger vankoertSession5 01.rutger vankoert
Session5 01.rutger vankoert
 
Session4 04.senka drobac
Session4 04.senka drobacSession4 04.senka drobac
Session4 04.senka drobac
 
Session3 04.arnau baro
Session3 04.arnau baroSession3 04.arnau baro
Session3 04.arnau baro
 
Session3 03.christian clausner
Session3 03.christian clausnerSession3 03.christian clausner
Session3 03.christian clausner
 
Session3 02.kimmo ketunnen
Session3 02.kimmo ketunnenSession3 02.kimmo ketunnen
Session3 02.kimmo ketunnen
 
Session3 01.clemens neudecker
Session3 01.clemens neudeckerSession3 01.clemens neudecker
Session3 01.clemens neudecker
 
Session2 04.ashkan ashkpour
Session2 04.ashkan ashkpourSession2 04.ashkan ashkpour
Session2 04.ashkan ashkpour
 
Session2 03.juri opitz
Session2 03.juri opitzSession2 03.juri opitz
Session2 03.juri opitz
 
Session2 02.christian reul
Session2 02.christian reulSession2 02.christian reul
Session2 02.christian reul
 
Session2 01.emad mohamed
Session2 01.emad mohamedSession2 01.emad mohamed
Session2 01.emad mohamed
 

Kürzlich hochgeladen

Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embeddingZilliz
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostZilliz
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Wonjun Hwang
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxNavinnSomaal
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
The Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfThe Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfSeasiaInfotech2
 
Vector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector DatabasesVector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector DatabasesZilliz
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piececharlottematthew16
 

Kürzlich hochgeladen (20)

Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embedding
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptx
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
The Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfThe Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdf
 
Vector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector DatabasesVector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector Databases
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
 

Interoperability challenges and opportunities in digital preservation

  • 1. Interoperability A quick chat, a few war stories...
  • 2. The OPF team Community Manager ● Events (face-to-face/virtual) ● Training (staff development) ● Comms (web/email/social) Executive Director ● Membership (engagement/value) ● Open preservation advocacy ● Operational management Technical Lead ● Infrastructure (host/test) ● Software stewardship (roadmap/maturity/packaging) ● Data corpora
  • 3. About OPF Trying to help institutions create robust digital preservation workflows by: ● sharing knowledge and best practise; ● improving the quality of digital preservation software.
  • 4. Introduction Here to set the scene by: ● Defining interoperability ● Providing a personal perspective ● Covering a few engineering fundamentals ● Looking for an easier way
  • 5. Interoperability “is the ability of making systems and organisations work together (inter-operate).” straight from Wikipedia
  • 6. Origins? Coined in IT and system services to allow for information exchange.
  • 7. But it’s not just an IT thing A broader definition also considers: ● social issues ● political & organisational factors that “impact system to system performance”
  • 8. Another “definition” “Task of building coherent services for users when the individual components are technically difficult and managed by different organisations.” Wikipedia again
  • 9. Who’s in the interoperability game? ● Information professionals ● Software engineers ● Staff who work on distributed projects ● People dealing with complexity
  • 10. Sound like anyone we know? So those of us lucky enough to work in IT for Information professionals on collaborative projects it’s welcome to interoperability X 3…..
  • 11. It’s an older problem than IT =?
  • 13. But IT does it better... The UK NHS National Program for IT ● biggest civilian IT project of its kind ● “mashups” for health records ● in theory 2003 - 2007 costing £2.4 billion ● in reality 2003 - 2011 costing £13 billion ● incidentally it didn’t work…….
  • 14. But it’s possible in real life
  • 15. And it’s possible in IT….. Think of a system that is: ● decentralised ● fault tolerant ● built on simple building blocks
  • 16. What would that look like?
  • 17. Things to think about ● simplicity ● standards ● clarity ● test early ● test often
  • 18. Small is beautiful ● small parts can build beautiful robust wholes ● it’s one way of tackling complexity ● BUT the parts need testable, tested and reliable
  • 19. Standards are your friends It’s always worth checking if there’s a standard available and in use but: ● there’s often more than one ● they’re not always easy to understand ● they’re hostage to commercial interests
  • 20. Be clear in your intentions Again simplicity / small size helps here ● Document clearly and publicly ● Keep it up to date ● If you’re not willing to explain how it works….
  • 21. Test early and often And test the parts together rather than as well as separately Technologies to automate testing: ● virtualisation ● online public continuous integration
  • 22. Interoperability is the future The Internet of Things is gathering pace Information exchange happening between more and more devices, more regularly. REST, XML, Json
  • 23. But it’s NEVER finished Two aspects of interoperability: ● Syntactically interoperable ● Semantically interoperable That’s to say speaking the same language is one thing, understanding what the other is saying is another…..
  • 24. Why data is a special problem In the cultural heritage sector ● shared data == shared problems ● legal issues (IPR) means we don’t share as we should
  • 25. Moving the mountain Moving the large volume takes way too long…. ● If I want to move > 5 TB for processing ● THEN move the results back…..
  • 26. A better way….. It’s now MUCH easier to move the application to the data: ● It’s more secure ● virtual machines are approx. 300 MB ● Docker - application containers
  • 27. So the oldest interoperability story? ● It might not be the oldest but it’s close, ● about old school integration issues. ● Something of a cautionary tale, ● it didn’t end well…..
  • 28. The Tower of Babel
  • 29. My Details ● Carl Wilson ● Technical Lead ● Open Planets Foundation ● Email : carl@openplanetsfoundation.org ● Skype : carl.f.wilson ● GitHub : carlwilson ● Twitter : @openplanets ● Google+ : carl@openplanetsfoundation.org