Rewrapping your data – Providing a tech savvy interface to your data

•Als KEY, PDF herunterladen•

0 gefällt mir•228 views

Markus Sköld

Presentation for ELAG 2010

Technologie Bildung

Rewrapping your data –
Providing a tech savvy interface
to your catalogue
Helsinki June 11 2010
Markus Sköld
Senior Developer, Dept. of Audiovisual Media
National Library of Sweden
markus.skold@kb.se

Audiovisual
Media
• National Archive for Audiovisual
Material
• 1.5 TB ingested daily
• ~3 million hours digitally
available
• ~5 million hours available via
on-demand digitization

Starting point
• Functional, but not intuitive
• No searchengine indexing
• Difficult to find
• Proprietary code
• Mountains of update requests

What did we want?
• Clean and simple
• Like Google….
• Open Source
• Tiered architecture
• Ability to link directly to records

Rebuilding

Web application

Proprietary
code

Rebuilding
EW
N Web application

XML
SMDB-BUS

Socket

Why XML?
• Reformat data
• Complex structure
• Easy to handle
• Keep all nuances

photo: http://www.flickr.com/photos/intvgene/370973576/

Query Translator

BRS Query: ”Inglourious Basterds”.TIT.

Query Translator

”Google-Like”: title:”Inglourious Basterds”

BRS Query: ”Inglourious Basterds”.TIT.

Query Translator
CQL: dc.title = ”Inglourious Basterds”

”Google-Like”: title:”Inglourious Basterds”

BRS Query: ”Inglourious Basterds”.TIT.

Sorting Filter results

Statistics on your search

Tips
Discovery.

Scrollable results

Cool URIs don’t change
–Tim Berners-Lee

http://smdb.kb.se/resource/id/<number>

One unique URI for every record

> 55% traffic from Google
> 20% from referral (e.g.Wikipedia)

Open APIs
•SOAP
•REST
‣ XML
‣ JSON/JSONP
•SRU
http://www.ﬂickr.com/photos/loﬁnk/4344960203/

Content Negotiation
http://smdb.kb.se/resource/id/002573900
=>HTTP 303

http://smdb.kb.se/catalog/id/002573900.rdf

Simplicity is the ultimate
sophistication
— Leonardo da Vinci

Weitere ähnliche Inhalte

Ähnlich wie Rewrapping your data – Providing a tech savvy interface to your data

A Semantic Web of Things (SWoT) brings together the Semantic Web and the Web of Things (WoT), associating semantically annotated information to web-enabled physical devices, services and their data, towards seamless data integration and better understanding of real-world information. A missing element in order to realize SWoT is a standardized, scalable and flexible way to globally discover in (near) real time web-connected embedded devices, as well as their semantic data. To address this gap, we propose WOT Semantic Search Engine (WOTS2E), which is a search engine for the SWoT, based on web crawling, being able to discover Linked Data endpoints and, through them, WoT-enabled devices and their services. In this presentation, we describe the design, development and implementation of WOTS2E, as well as an evaluation procedure showing its operation and performance across the web.

WOTS2E: A Search Engine for a Semantic Web of Things

Andreas Kamilaris

Skb web2.0

animove

The promise of Linked Data is not that it is another way of aggregating data. For too long have library data been trapped within data-silos only accessible through obscure protocols. Why is access to library data still an issue? Letting everyone access and link to library data lets anyone build the next killer app. LIBRIS, the Swedish Union Catalogue is, since the beginning of this year, available as Linked Data. We discuss how and why. -- Martin Malmsten & Anders Söderbäck, National Library of Sweden

Why libraries should embrace Linked Data

eby

Devoxx 2010 | LAB : ReST in Java

NGDATA

全てのエンジニアのためのWeb標準技術とのつきあい方 OSC福岡 2011版

Rikkyo University

Webofdata

Bill Roberts

History and Background of the USEWOD Data Challenge

Knud Möller

MongoDB NoSQL DBMS

Vlad Vega

IBM Cloud Day January 2021 Data Lake Deep Dive

Torsten Steinbach

Ambry : Linkedin's Scalable Geo-Distributed Object Store

Sivabalan Narayanan

Contextual Computing - Knowledge Graphs & Web of Entities

Richard Wallis

Introduction to Apache Solr

Andy Jackson

Bibliographic metadata forms have evolved over centuries, the last 50 years in machine readable formats. The library community appears to be evolving from records, towards describing real-world entities using an agreed form of linked data. Is that step a step far enough to satisfy the ever-present need to aid discovery? Discovery in the environment of the approaching twenty first century’s 3rd decade. Or do we need to include a move into the landscape of globally understood structured data and knowledge graphs? The millennial environment of answer engines, mobile/local search and voice assistants. #cilipconf19

CILIP Conference - x metadata evolution the final mile - Richard Wallis

CILIP

ESWC SS 2012 - Wednesday Tutorial Barry Norton: Building (Production) Semanti...

eswcsummerschool

Metadata - Linked Data

Richard Wallis

オープンソースカンファレンス2011 Tokyo/ Fall 講演資料「Web技術の現状と将来」

Rikkyo University

Publishing Linked Data from RDB

Boris Villazón-Terrazas

Contextual Computing: Laying a Global Data Foundation

Richard Wallis

Butler - Security Lessons Learned from an Ezproxy Admin

National Information Standards Organization (NISO)

The web is now firmly established as the primary communication and publication platform for sharing and accessing social and cultural materials. This networked world has created both opportunities and pitfalls for libraries and archives in their mission to preserve and provide ongoing access to knowledge. How can the affordances of the web be leveraged to drastically extend the plurality of representation in the archive? What challenges are imposed by the intrinsic ephemerality and mutability of online information? What methodological reorientations are demanded by the scale and dynamism of machine-generated cultural artifacts? This talk will explore the interplay of the web, contemporary historical records, and the programs, technologies, and approaches by which libraries and archives are working to extend their mission to preserve and provide access to the evidence of human activity in a world distinguished by the ubiquity of born-digital materials. Information Science Brown Bag talks, hosted by the Program on Information Science, consists of regular discussions and brainstorming sessions on all aspects of information science and uses of information science and technology to assess and solve institutional, social and research problems. These are informal talks. Discussions are often inspired by real-world problems being faced by the lead discussant.

SAFETY NETS: RESCUE AND REVIVAL FOR ENDANGERED BORN-DIGITAL RECORDS- Program ...

Micah Altman

Ähnlich wie Rewrapping your data – Providing a tech savvy interface to your data (20)

WOTS2E: A Search Engine for a Semantic Web of Things

Skb web2.0

Why libraries should embrace Linked Data

Devoxx 2010 | LAB : ReST in Java

全てのエンジニアのためのWeb標準技術とのつきあい方 OSC福岡 2011版

Webofdata

History and Background of the USEWOD Data Challenge

MongoDB NoSQL DBMS

IBM Cloud Day January 2021 Data Lake Deep Dive

Ambry : Linkedin's Scalable Geo-Distributed Object Store

Contextual Computing - Knowledge Graphs & Web of Entities

Introduction to Apache Solr

CILIP Conference - x metadata evolution the final mile - Richard Wallis

ESWC SS 2012 - Wednesday Tutorial Barry Norton: Building (Production) Semanti...

Metadata - Linked Data

オープンソースカンファレンス2011 Tokyo/ Fall 講演資料「Web技術の現状と将来」

Publishing Linked Data from RDB

Contextual Computing: Laying a Global Data Foundation

Butler - Security Lessons Learned from an Ezproxy Admin

SAFETY NETS: RESCUE AND REVIVAL FOR ENDANGERED BORN-DIGITAL RECORDS- Program ...

Kürzlich hochgeladen

Understanding the FAA Part 107 License ..

Christopher Logan Kennedy

💥 You’re lucky! We’ve found two different (lead) developers that are willing to share their valuable lessons learned about using UiPath Document Understanding! Based on recent implementations in appealing use cases at Partou and SPIE. Don’t expect fancy videos or slide decks, but real and practical experiences that will help you with your own implementations. 📕 Topics that will be addressed: • Training the ML-model by humans: do or don't? • Rule-based versus AI extractors • Tips for finding use cases • How to start 👨‍🏫👨‍💻 Speakers: o Dion Morskieft, RPA Product Owner @Partou o Jack Klein-Schiphorst, Automation Developer @Tacstone Technology

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

UiPathCommunity

Accelerating FinTech Innovation: Unleashing API Economy and GenAI Vasa Krishnan, Chief Technology Officer - FinResults Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...

apidays

The value of a flexible API Management solution for Open Banking Steve Melan, Manager for IT Innovation and Architecture - State's and Saving's Bank of Luxembourg Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The value of a flexible API Management solution for O...

apidays

How to Troubleshoot Apps for the Modern Connected Worker

ThousandEyes

Six Myths about Ontologies: The Basics of Formal Ontology

johnbeverley2021

Whatsapp Number Escorts Call girls 8617370543 Available 24x7 Mcleodganj Call Girls Service Offer Genuine VIP Model Escorts Call Girls in Your Budget. Mcleodganj Call Girls Service Provide Real Call Girls Number. Make Your Sexual Pleasure Memorable with Our Mcleodganj Call Girls at Affordable Price. Top VIP Escorts Call Girls, High Profile Independent Escorts Call Girls, Housewife Women Escorts Call Girl, College Girls Escorts Call Girls, Russian Escorts Call girls Service in Your Budget.

Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Deepika Singh

Angeliki Cooney has spent over twenty years at the forefront of the life sciences industry, working out of Wynantskill, NY. She is highly regarded for her dedication to advancing the development and accessibility of innovative treatments for chronic diseases, rare disorders, and cancer. Her professional journey has centered on strategic consulting for biopharmaceutical companies, facilitating digital transformation, enhancing omnichannel engagement, and refining strategic commercial practices. Angeliki's innovative contributions include pioneering several software-as-a-service (SaaS) products for the life sciences sector, earning her three patents. As the Senior Vice President of Life Sciences at Avenga, Angeliki orchestrated the firm's strategic entry into the U.S. market. Avenga, a renowned digital engineering and consulting firm, partners with significant entities in the pharmaceutical and biotechnology fields. Her leadership was instrumental in expanding Avenga's client base and establishing its presence in the competitive U.S. market.

Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...

Angeliki Cooney

AWS Community Day CPH - Three problems of Terraform

Andrey Devyatkin

Exploring Multimodal Embeddings with Milvus

Zilliz

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

MadyBayot

Following the popularity of "Cloud Revolution: Exploring the New Wave of Serverless Spatial Data," we're thrilled to announce this much-anticipated encore webinar. In this sequel, we'll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you're building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Safe Software

DBX First Quarter 2024 Investor Presentation

Dropbox

Scaling API-first – The story of a global engineering organization Ian Reasor, Senior Computer Scientist - Adobe Radu Cotescu, Senior Computer Scientist - Adobe Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

apidays

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

Product Anonymous

Architecting Cloud Native Applications

WSO2

Elevate Developer Efficiency & build GenAI Application with Amazon Q

Bhuvaneswari Subramani

Webinar Recording: https://www.panagenda.com/webinars/why-teams-call-analytics-is-critical-to-your-entire-business Nothing is as frustrating and noticeable as being in an important call and being unable to see or hear the other person. Not surprising then, that issues with Teams calls are among the most common problems users call their helpdesk for. Having in depth insight into everything relevant going on at the user’s device, local network, ISP and Microsoft itself during the call is crucial for good Microsoft Teams Call quality support. To ensure a quick and adequate solution and to ensure your users get the most out of their Microsoft 365. But did you know that ‘bad calls’ are also an excellent indicator of other problems arising? Precisely because it is so noticeable!? Like the canary in the mine, bad calls can be early indicators of problems. Problems that might otherwise not have been noticed for a while but can have a big impact on productivity and satisfaction. Join this session by Christoph Adler to learn how true Microsoft Teams call quality analytics helped other organizations troubleshoot bad calls and identify and fix problems that impacted Teams calls or the use of Microsoft365 in general. See what it can do to keep your users happy and productive! In this session we will cover - Why CQD data alone is not enough to troubleshoot call problems - The importance of attributing call problems to the right call participant - What call quality analytics can do to help you quickly find, fix-, and prevent problems - Why having retrospective detailed insights matters - Real life examples of how others have used Microsoft Teams call quality monitoring to problem shoot problems with their ISP, network, device health and more.

Why Teams call analytics are critical to your entire business

panagenda

Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows. We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases. This video focuses on the deployment of external web forms using Jotform for Bonterra Impact Management. This solution can be customized to your organization’s needs and deployed to support the common use cases below: - Intake and consent - Assessments - Surveys - Applications - Program registration Interested in deploying web form automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Jeffrey Haguewood

Strategies for Landing an Oracle DBA Job as a Fresher

Remote DBA Services

Kürzlich hochgeladen (20)

Understanding the FAA Part 107 License ..

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...

Apidays New York 2024 - The value of a flexible API Management solution for O...

How to Troubleshoot Apps for the Modern Connected Worker

Six Myths about Ontologies: The Basics of Formal Ontology

Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...

AWS Community Day CPH - Three problems of Terraform

Exploring Multimodal Embeddings with Milvus

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

DBX First Quarter 2024 Investor Presentation

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

Architecting Cloud Native Applications

Elevate Developer Efficiency & build GenAI Application with Amazon Q

Why Teams call analytics are critical to your entire business

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Strategies for Landing an Oracle DBA Job as a Fresher

Rewrapping your data – Providing a tech savvy interface to your data

1. Rewrapping your data – Providing a tech savvy interface to your catalogue Helsinki June 11 2010 Markus Sköld Senior Developer, Dept. of Audiovisual Media National Library of Sweden markus.skold@kb.se

2. Audiovisual Media • National Archive for Audiovisual Material • 1.5 TB ingested daily • ~3 million hours digitally available • ~5 million hours available via on-demand digitization

3. Starting point • Functional, but not intuitive • No searchengine indexing • Difficult to find • Proprietary code • Mountains of update requests

4. What did we want? • Clean and simple • Like Google…. • Open Source • Tiered architecture • Ability to link directly to records

5. Rebuilding Web application Proprietary code

6. Rebuilding Web application

7. Rebuilding Web application SMDB-BUS

8. Rebuilding EW N Web application XML SMDB-BUS Socket

9. Why XML? • Reformat data • Complex structure • Easy to handle • Keep all nuances photo: http://www.flickr.com/photos/intvgene/370973576/

10. Query Translator BRS Query: ”Inglourious Basterds”.TIT.

11. Query Translator ”Google-Like”: title:”Inglourious Basterds” BRS Query: ”Inglourious Basterds”.TIT.

12. Query Translator CQL: dc.title = ”Inglourious Basterds” ”Google-Like”: title:”Inglourious Basterds” BRS Query: ”Inglourious Basterds”.TIT.

13. One response XML

14. One response XML +XSLT

15. One response XML +XSLT =whatever

16.

17. Sorting Filter results Statistics on your search Tips Discovery. Scrollable results

18. Cool URIs don’t change –Tim Berners-Lee http://smdb.kb.se/resource/id/<number> One unique URI for every record

19.

20. > 55% traffic from Google > 20% from referral (e.g.Wikipedia)

21. Open APIs •SOAP •REST ‣ XML ‣ JSON/JSONP •SRU http://www.ﬂickr.com/photos/loﬁnk/4344960203/

22. Linked Open Data

23. Harvesting links through open APIs

24. Harvesting links through open APIs

25.

26. Content Negotiation http://smdb.kb.se/resource/id/002573900 =>HTTP 303

27. http://smdb.kb.se/catalog/id/002573900

28. http://smdb.kb.se/catalog/id/002573900.rdf

29. Simplicity is the ultimate sophistication — Leonardo da Vinci

Rewrapping your data – Providing a tech savvy interface to your data

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Ähnlich wie Rewrapping your data – Providing a tech savvy interface to your data

Ähnlich wie Rewrapping your data – Providing a tech savvy interface to your data (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

Rewrapping your data – Providing a tech savvy interface to your data

Hinweis der Redaktion