SlideShare ist ein Scribd-Unternehmen logo
1 von 17
An Automated
Cataloging Workflow
with SkyRiver
Jim Novy and Steve Ohs
Lakeshores Library System
1
The presenters…
Jim Novy
• System Services Technician
• Primary IT expertise at LLS
• Automation Coordinator of SHARE Consortium
Steve Ohs
• Library Development Coordinator at LLS
• Supports Jim in IT & ILS administration
• Partial cataloging background
2
Outline for this session…
1. Challenges we face in our consortium
2. Background of our choice to move to SkyRiver
3. Our old work flow
4. Our new work flow (and the benefits as we see
them)
5. Some code examples
**Please feel free to ask questions as we move
through the presentation!** 3
Our Challenges…
• Lots of libraries (50 Public & K-12s). Huge
variance in onsite cataloging expertise
• Historically a free-for-all. No formal agreement
to govern cataloging practices or quality
• Ongoing duplicate problem & lots of coding
inconsistencies
• Staffers lost through attrition not being replaced
• 2 original catalogers in the entire consortium
4
Our choice to move to
SkyRiver…
• SHARE was an OCLC customer since its inception
until 2010
• Utilized a working group of catalogers to “test
drive” the SkyRiver database
• Record quality acceptable
• Database coverage acceptable
• Main motivation was cost savings
• An additional bonus (for us): responsiveness to
our needs
5
SkyRiver isn’t perfect…
• We tend to find more records of a less-than-full
nature. We find more oddball Elvl records than
we’re used to
• A few publishers weren’t initially well-
represented
• Fewer “individual disc” or “split” records for
certain video and sound recordings (though in
our case we’re trying to move away from that)
• Longer wait times for a record to appear
6
Our *OLD* work flow…
7
That work flow didn’t cut it…
The imperfections of SkyRiver…
• Certain materials harder to find
• Certain publishers not initially well-represented
• More records of less-than-full quality being
incorrectly imported into the ILS
• Generally longer wait times until a full level record
became available
…translated into longer periods of time for items
to get into the hands of patrons.
 This was a problem(for us) 8
So there we were…
• Pressure was mounting to come up with some sort
of a solution
• Implementing an effective program of staff training
& uniform application of learned standards was not
an option.
• It was at this point we remembered we had direct
z39.50 access to SkyRiver’s server 9
Snapping the pieces together…
We cobbled together a new, automated, work flow
using a few different parts:
1. SirsiDynix Symphony ILS API tools
2. The Perl programming language & some extra Perl
code libraries
3. An algorithm that Jim previously designed to rank,
select and overlay records based on quality
4. A “brief record” model we gleaned from SAILS
consortium (CT)
5. Our existing model of using the two original
catalogers to mediate the original cataloging
situation 10
Our *NEW* work flow…
11
MARC-BRIEFNightly Processing(Detail)…
For each MARC-BRIEF record:
1. Duplicate check against our catalog. If duplicate found,
the MARC-BRIEF holdings & items are merged into
existing record.
2. Initiate z39.50 connection. Search for & extract a
matching record set. Process records through ranking
algorithm. Winning record overlays onto MARC-BRIEF.
If no matching records retrieved, automatically
constructs & emails SkySearchPlus record request for
the title.
3. If MARC-BRIEF record is not overlaid within 4 weeks, a
hold is created on that item for the nearest Original
Cataloger. Patron holds prioritized. Item then follows
normal intra-system transit flow, is originally cataloged,
and returned to owning library.
12
RankingAlgorithm (Detail)…
What determines the best record score of a given
set? Some elements are:
• Elvl leader byte
• Contents of 040
• Number of 5XX notes
• Number of 6XX headings with 1st indicator 0 or 1
• Presence of 6XX headings with juvenile form
subdivisions
13
Local Record Improvements
For each record added in a day, we process it through the
following improvements:
• Convert 440 to 490
• Add 007 if not present or invalid
• Add local GMD
• Fix subfield v values in 490
14
Additionalprojects(Detail)…
• Weekly “Brief Record Update” scripts to upgrade
non MARC-BRIEF records brought in.
• Daily scripts to collect possible duplicates &
present to catalogers.
• Developing agnostic vendor record loader. So
any library that wants to can load vendor records
directly as MARC-BRIEF, including pre-processing
information (holdings codes, call numbers,
barcodes, prices)
15
Analysis…
Benefits
• It’s a much simpler copy
cataloging work flow
• Extra duplicate checks are
built-in
• We leverage the ‘perks’ of
z39.50 and SkySearchPlus
• Items can circulate
immediately
• Items in need of OC’ing
integrate seamlessly into
the normal ‘hold picking’
process
Drawbacks
• Reliant on ISBN
matching, so older items
or split dvd’sare still
sometimes a pain
• Significant up-front
development &
debugging time
• Initially made some staff
fearful
16
Code & Questions…
Thanks!!
Jim  jnovy@lakeshores.lib.wi.us
Steve  sohs@lakeshores.lib.wi.us
17

Weitere ähnliche Inhalte

Was ist angesagt?

Markup languages and warp-speed documentation
Markup languages and warp-speed documentationMarkup languages and warp-speed documentation
Markup languages and warp-speed documentationLois Patterson
 
Welcome to Production
Welcome to ProductionWelcome to Production
Welcome to ProductionGraeme Foster
 
Building a Modern Website for Scale (QCon NY 2013)
Building a Modern Website for Scale (QCon NY 2013)Building a Modern Website for Scale (QCon NY 2013)
Building a Modern Website for Scale (QCon NY 2013)Sid Anand
 
From java to scala at crowd mix
From java to scala at crowd mixFrom java to scala at crowd mix
From java to scala at crowd mixStefano Galarraga
 
Apache Zeppelin & Cluster
Apache Zeppelin & ClusterApache Zeppelin & Cluster
Apache Zeppelin & ClusterJongyoul Lee
 
Control and monitor_microservices_with_microprofile
Control and monitor_microservices_with_microprofileControl and monitor_microservices_with_microprofile
Control and monitor_microservices_with_microprofileRudy De Busscher
 
Building High-Throughput, Low-Latency Pipelines in Kafka
Building High-Throughput, Low-Latency Pipelines in KafkaBuilding High-Throughput, Low-Latency Pipelines in Kafka
Building High-Throughput, Low-Latency Pipelines in Kafkaconfluent
 
Apache BookKeeper Distributed Store- a Salesforce use case
Apache BookKeeper Distributed Store- a Salesforce use caseApache BookKeeper Distributed Store- a Salesforce use case
Apache BookKeeper Distributed Store- a Salesforce use caseSalesforce Engineering
 
The Evolution of Testing Methodology at AWS: From Status Quo to Formal Method...
The Evolution of Testing Methodology at AWS: From Status Quo to Formal Method...The Evolution of Testing Methodology at AWS: From Status Quo to Formal Method...
The Evolution of Testing Methodology at AWS: From Status Quo to Formal Method...C4Media
 
Transactions in micro-services (fall 2019)
Transactions in micro-services (fall 2019)Transactions in micro-services (fall 2019)
Transactions in micro-services (fall 2019)Rudy De Busscher
 
The new OSGi LogService 1.4 and integrating with SLF4J
The new OSGi LogService 1.4 and integrating with SLF4JThe new OSGi LogService 1.4 and integrating with SLF4J
The new OSGi LogService 1.4 and integrating with SLF4Jbjhargrave
 
Integrating SLF4J and the new OSGi LogService 1.4 - BJ Hargrave (IBM)
Integrating SLF4J and the new OSGi LogService 1.4 - BJ Hargrave (IBM)Integrating SLF4J and the new OSGi LogService 1.4 - BJ Hargrave (IBM)
Integrating SLF4J and the new OSGi LogService 1.4 - BJ Hargrave (IBM)mfrancis
 
Putting Kafka In Jail – Best Practices To Run Kafka On Kubernetes & DC/OS
Putting Kafka In Jail – Best Practices To Run Kafka On Kubernetes & DC/OSPutting Kafka In Jail – Best Practices To Run Kafka On Kubernetes & DC/OS
Putting Kafka In Jail – Best Practices To Run Kafka On Kubernetes & DC/OSLightbend
 
What’s expected in Spring 5
What’s expected in Spring 5What’s expected in Spring 5
What’s expected in Spring 5Gal Marder
 
Scala adoption by enterprises
Scala adoption by enterprisesScala adoption by enterprises
Scala adoption by enterprisesMike Slinn
 
Revitalizing Enterprise Integration with Reactive Streams
Revitalizing Enterprise Integration with Reactive StreamsRevitalizing Enterprise Integration with Reactive Streams
Revitalizing Enterprise Integration with Reactive StreamsLightbend
 
Pulsar Summit Asia - Structured Data Stream with Apache Pulsar
Pulsar Summit Asia - Structured Data Stream with Apache PulsarPulsar Summit Asia - Structured Data Stream with Apache Pulsar
Pulsar Summit Asia - Structured Data Stream with Apache PulsarShivji Kumar Jha
 
Pakk Your Alpakka: Reactive Streams Integrations For AWS, Azure, & Google Cloud
Pakk Your Alpakka: Reactive Streams Integrations For AWS, Azure, & Google CloudPakk Your Alpakka: Reactive Streams Integrations For AWS, Azure, & Google Cloud
Pakk Your Alpakka: Reactive Streams Integrations For AWS, Azure, & Google CloudLightbend
 
Upgrade to IPA Made Easy
Upgrade to IPA Made EasyUpgrade to IPA Made Easy
Upgrade to IPA Made EasyNogalis Inc
 

Was ist angesagt? (20)

Markup languages and warp-speed documentation
Markup languages and warp-speed documentationMarkup languages and warp-speed documentation
Markup languages and warp-speed documentation
 
Welcome to Production
Welcome to ProductionWelcome to Production
Welcome to Production
 
Building a Modern Website for Scale (QCon NY 2013)
Building a Modern Website for Scale (QCon NY 2013)Building a Modern Website for Scale (QCon NY 2013)
Building a Modern Website for Scale (QCon NY 2013)
 
From java to scala at crowd mix
From java to scala at crowd mixFrom java to scala at crowd mix
From java to scala at crowd mix
 
Apache Zeppelin & Cluster
Apache Zeppelin & ClusterApache Zeppelin & Cluster
Apache Zeppelin & Cluster
 
Control and monitor_microservices_with_microprofile
Control and monitor_microservices_with_microprofileControl and monitor_microservices_with_microprofile
Control and monitor_microservices_with_microprofile
 
Building High-Throughput, Low-Latency Pipelines in Kafka
Building High-Throughput, Low-Latency Pipelines in KafkaBuilding High-Throughput, Low-Latency Pipelines in Kafka
Building High-Throughput, Low-Latency Pipelines in Kafka
 
Apache BookKeeper Distributed Store- a Salesforce use case
Apache BookKeeper Distributed Store- a Salesforce use caseApache BookKeeper Distributed Store- a Salesforce use case
Apache BookKeeper Distributed Store- a Salesforce use case
 
Music streams
Music streamsMusic streams
Music streams
 
The Evolution of Testing Methodology at AWS: From Status Quo to Formal Method...
The Evolution of Testing Methodology at AWS: From Status Quo to Formal Method...The Evolution of Testing Methodology at AWS: From Status Quo to Formal Method...
The Evolution of Testing Methodology at AWS: From Status Quo to Formal Method...
 
Transactions in micro-services (fall 2019)
Transactions in micro-services (fall 2019)Transactions in micro-services (fall 2019)
Transactions in micro-services (fall 2019)
 
The new OSGi LogService 1.4 and integrating with SLF4J
The new OSGi LogService 1.4 and integrating with SLF4JThe new OSGi LogService 1.4 and integrating with SLF4J
The new OSGi LogService 1.4 and integrating with SLF4J
 
Integrating SLF4J and the new OSGi LogService 1.4 - BJ Hargrave (IBM)
Integrating SLF4J and the new OSGi LogService 1.4 - BJ Hargrave (IBM)Integrating SLF4J and the new OSGi LogService 1.4 - BJ Hargrave (IBM)
Integrating SLF4J and the new OSGi LogService 1.4 - BJ Hargrave (IBM)
 
Putting Kafka In Jail – Best Practices To Run Kafka On Kubernetes & DC/OS
Putting Kafka In Jail – Best Practices To Run Kafka On Kubernetes & DC/OSPutting Kafka In Jail – Best Practices To Run Kafka On Kubernetes & DC/OS
Putting Kafka In Jail – Best Practices To Run Kafka On Kubernetes & DC/OS
 
What’s expected in Spring 5
What’s expected in Spring 5What’s expected in Spring 5
What’s expected in Spring 5
 
Scala adoption by enterprises
Scala adoption by enterprisesScala adoption by enterprises
Scala adoption by enterprises
 
Revitalizing Enterprise Integration with Reactive Streams
Revitalizing Enterprise Integration with Reactive StreamsRevitalizing Enterprise Integration with Reactive Streams
Revitalizing Enterprise Integration with Reactive Streams
 
Pulsar Summit Asia - Structured Data Stream with Apache Pulsar
Pulsar Summit Asia - Structured Data Stream with Apache PulsarPulsar Summit Asia - Structured Data Stream with Apache Pulsar
Pulsar Summit Asia - Structured Data Stream with Apache Pulsar
 
Pakk Your Alpakka: Reactive Streams Integrations For AWS, Azure, & Google Cloud
Pakk Your Alpakka: Reactive Streams Integrations For AWS, Azure, & Google CloudPakk Your Alpakka: Reactive Streams Integrations For AWS, Azure, & Google Cloud
Pakk Your Alpakka: Reactive Streams Integrations For AWS, Azure, & Google Cloud
 
Upgrade to IPA Made Easy
Upgrade to IPA Made EasyUpgrade to IPA Made Easy
Upgrade to IPA Made Easy
 

Andere mochten auch

Wils reorganization update 2013 1-9
Wils reorganization update 2013 1-9Wils reorganization update 2013 1-9
Wils reorganization update 2013 1-9WiLS
 
Library buildings project
Library buildings projectLibrary buildings project
Library buildings projectWiLS
 
Learning from Failure: A Support Group
Learning from Failure:  A Support GroupLearning from Failure:  A Support Group
Learning from Failure: A Support GroupWiLS
 
Wordpressrefreshnew2013
Wordpressrefreshnew2013Wordpressrefreshnew2013
Wordpressrefreshnew2013WiLS
 
Data 101 Workshop
Data 101 WorkshopData 101 Workshop
Data 101 WorkshopWiLS
 
Workflow session wla 2012
Workflow session wla 2012Workflow session wla 2012
Workflow session wla 2012WiLS
 
Building digitalcollectionsworkshop
Building digitalcollectionsworkshopBuilding digitalcollectionsworkshop
Building digitalcollectionsworkshopWiLS
 
Museum Websites
Museum WebsitesMuseum Websites
Museum WebsitesWiLS
 
Wi ls worldwho talk
Wi ls worldwho talkWi ls worldwho talk
Wi ls worldwho talkWiLS
 

Andere mochten auch (9)

Wils reorganization update 2013 1-9
Wils reorganization update 2013 1-9Wils reorganization update 2013 1-9
Wils reorganization update 2013 1-9
 
Library buildings project
Library buildings projectLibrary buildings project
Library buildings project
 
Learning from Failure: A Support Group
Learning from Failure:  A Support GroupLearning from Failure:  A Support Group
Learning from Failure: A Support Group
 
Wordpressrefreshnew2013
Wordpressrefreshnew2013Wordpressrefreshnew2013
Wordpressrefreshnew2013
 
Data 101 Workshop
Data 101 WorkshopData 101 Workshop
Data 101 Workshop
 
Workflow session wla 2012
Workflow session wla 2012Workflow session wla 2012
Workflow session wla 2012
 
Building digitalcollectionsworkshop
Building digitalcollectionsworkshopBuilding digitalcollectionsworkshop
Building digitalcollectionsworkshop
 
Museum Websites
Museum WebsitesMuseum Websites
Museum Websites
 
Wi ls worldwho talk
Wi ls worldwho talkWi ls worldwho talk
Wi ls worldwho talk
 

Ähnlich wie Peer council 2013_presentation

Just the Job: Employing Solr for Recruitment Search -Charlie Hull
Just the Job: Employing Solr for Recruitment Search -Charlie Hull Just the Job: Employing Solr for Recruitment Search -Charlie Hull
Just the Job: Employing Solr for Recruitment Search -Charlie Hull lucenerevolution
 
A Case Study of NoSQL Adoption: What Drove Wordnik Non-Relational?
A Case Study of NoSQL Adoption: What Drove Wordnik Non-Relational?A Case Study of NoSQL Adoption: What Drove Wordnik Non-Relational?
A Case Study of NoSQL Adoption: What Drove Wordnik Non-Relational?DATAVERSITY
 
Backing Data Silo Atack: Alfresco sharding, SOLR for non-flat objects
Backing Data Silo Atack: Alfresco sharding, SOLR for non-flat objectsBacking Data Silo Atack: Alfresco sharding, SOLR for non-flat objects
Backing Data Silo Atack: Alfresco sharding, SOLR for non-flat objectsITD Systems
 
Stardog 1.1: Easier, Smarter, Faster RDF Database
Stardog 1.1: Easier, Smarter, Faster RDF DatabaseStardog 1.1: Easier, Smarter, Faster RDF Database
Stardog 1.1: Easier, Smarter, Faster RDF DatabaseClark & Parsia LLC
 
Stardog 1.1: An Easier, Smarter, Faster RDF Database
Stardog 1.1: An Easier, Smarter, Faster RDF DatabaseStardog 1.1: An Easier, Smarter, Faster RDF Database
Stardog 1.1: An Easier, Smarter, Faster RDF Databasekendallclark
 
Sebastian Cohnen – Building a Startup with NoSQL - NoSQL matters Barcelona 2014
Sebastian Cohnen – Building a Startup with NoSQL - NoSQL matters Barcelona 2014Sebastian Cohnen – Building a Startup with NoSQL - NoSQL matters Barcelona 2014
Sebastian Cohnen – Building a Startup with NoSQL - NoSQL matters Barcelona 2014NoSQLmatters
 
Real time monitoring of hadoop and spark workflows
Real time monitoring of hadoop and spark workflowsReal time monitoring of hadoop and spark workflows
Real time monitoring of hadoop and spark workflowsShankar Manian
 
Full Catalog RDA Enrichment in Alma (ELUNA 2015)
Full Catalog RDA Enrichment in Alma (ELUNA 2015)Full Catalog RDA Enrichment in Alma (ELUNA 2015)
Full Catalog RDA Enrichment in Alma (ELUNA 2015)trail001
 
2020 oct zowe quarterly webinar series
2020 oct zowe quarterly webinar series2020 oct zowe quarterly webinar series
2020 oct zowe quarterly webinar seriesOpen Mainframe Project
 
Experience Converting from Ruby to Scala
Experience Converting from Ruby to ScalaExperience Converting from Ruby to Scala
Experience Converting from Ruby to ScalaJohn Nestor
 
NASIG 2021 Don't wait automate! Industry perspectives on KBART automation
NASIG 2021   Don't wait automate! Industry perspectives on KBART automationNASIG 2021   Don't wait automate! Industry perspectives on KBART automation
NASIG 2021 Don't wait automate! Industry perspectives on KBART automationMatthew Ragucci
 
Making the Big Move: Moving to Cloud-Based OCLC’s WorldShare Management Servi...
Making the Big Move: Moving to Cloud-Based OCLC’s WorldShare Management Servi...Making the Big Move: Moving to Cloud-Based OCLC’s WorldShare Management Servi...
Making the Big Move: Moving to Cloud-Based OCLC’s WorldShare Management Servi...Charleston Conference
 
AOEcon17: Searchperience - The journey from PHP and Solr to Scala and Elastic...
AOEcon17: Searchperience - The journey from PHP and Solr to Scala and Elastic...AOEcon17: Searchperience - The journey from PHP and Solr to Scala and Elastic...
AOEcon17: Searchperience - The journey from PHP and Solr to Scala and Elastic...AOE
 
Whitepages Practical Experience Converting from Ruby to Reactive
Whitepages Practical Experience Converting from Ruby to ReactiveWhitepages Practical Experience Converting from Ruby to Reactive
Whitepages Practical Experience Converting from Ruby to ReactiveDragos Manolescu
 
Building a Large Scale SEO/SEM Application with Apache Solr: Presented by Rah...
Building a Large Scale SEO/SEM Application with Apache Solr: Presented by Rah...Building a Large Scale SEO/SEM Application with Apache Solr: Presented by Rah...
Building a Large Scale SEO/SEM Application with Apache Solr: Presented by Rah...Lucidworks
 
DataEngConf SF16 - Scalable and Reliable Logging at Pinterest
DataEngConf SF16 - Scalable and Reliable Logging at PinterestDataEngConf SF16 - Scalable and Reliable Logging at Pinterest
DataEngConf SF16 - Scalable and Reliable Logging at PinterestHakka Labs
 
Scalable and Reliable Logging at Pinterest
Scalable and Reliable Logging at PinterestScalable and Reliable Logging at Pinterest
Scalable and Reliable Logging at PinterestKrishna Gade
 
Profiling and Tuning a Web Application - The Dirty Details
Profiling and Tuning a Web Application - The Dirty DetailsProfiling and Tuning a Web Application - The Dirty Details
Profiling and Tuning a Web Application - The Dirty DetailsAchievers Tech
 

Ähnlich wie Peer council 2013_presentation (20)

Just the Job: Employing Solr for Recruitment Search -Charlie Hull
Just the Job: Employing Solr for Recruitment Search -Charlie Hull Just the Job: Employing Solr for Recruitment Search -Charlie Hull
Just the Job: Employing Solr for Recruitment Search -Charlie Hull
 
A Case Study of NoSQL Adoption: What Drove Wordnik Non-Relational?
A Case Study of NoSQL Adoption: What Drove Wordnik Non-Relational?A Case Study of NoSQL Adoption: What Drove Wordnik Non-Relational?
A Case Study of NoSQL Adoption: What Drove Wordnik Non-Relational?
 
Backing Data Silo Atack: Alfresco sharding, SOLR for non-flat objects
Backing Data Silo Atack: Alfresco sharding, SOLR for non-flat objectsBacking Data Silo Atack: Alfresco sharding, SOLR for non-flat objects
Backing Data Silo Atack: Alfresco sharding, SOLR for non-flat objects
 
Tool
ToolTool
Tool
 
Into The Box 2023 Keynote Day 1
Into The Box 2023 Keynote Day 1Into The Box 2023 Keynote Day 1
Into The Box 2023 Keynote Day 1
 
Stardog 1.1: Easier, Smarter, Faster RDF Database
Stardog 1.1: Easier, Smarter, Faster RDF DatabaseStardog 1.1: Easier, Smarter, Faster RDF Database
Stardog 1.1: Easier, Smarter, Faster RDF Database
 
Stardog 1.1: An Easier, Smarter, Faster RDF Database
Stardog 1.1: An Easier, Smarter, Faster RDF DatabaseStardog 1.1: An Easier, Smarter, Faster RDF Database
Stardog 1.1: An Easier, Smarter, Faster RDF Database
 
Sebastian Cohnen – Building a Startup with NoSQL - NoSQL matters Barcelona 2014
Sebastian Cohnen – Building a Startup with NoSQL - NoSQL matters Barcelona 2014Sebastian Cohnen – Building a Startup with NoSQL - NoSQL matters Barcelona 2014
Sebastian Cohnen – Building a Startup with NoSQL - NoSQL matters Barcelona 2014
 
Real time monitoring of hadoop and spark workflows
Real time monitoring of hadoop and spark workflowsReal time monitoring of hadoop and spark workflows
Real time monitoring of hadoop and spark workflows
 
Full Catalog RDA Enrichment in Alma (ELUNA 2015)
Full Catalog RDA Enrichment in Alma (ELUNA 2015)Full Catalog RDA Enrichment in Alma (ELUNA 2015)
Full Catalog RDA Enrichment in Alma (ELUNA 2015)
 
2020 oct zowe quarterly webinar series
2020 oct zowe quarterly webinar series2020 oct zowe quarterly webinar series
2020 oct zowe quarterly webinar series
 
Experience Converting from Ruby to Scala
Experience Converting from Ruby to ScalaExperience Converting from Ruby to Scala
Experience Converting from Ruby to Scala
 
NASIG 2021 Don't wait automate! Industry perspectives on KBART automation
NASIG 2021   Don't wait automate! Industry perspectives on KBART automationNASIG 2021   Don't wait automate! Industry perspectives on KBART automation
NASIG 2021 Don't wait automate! Industry perspectives on KBART automation
 
Making the Big Move: Moving to Cloud-Based OCLC’s WorldShare Management Servi...
Making the Big Move: Moving to Cloud-Based OCLC’s WorldShare Management Servi...Making the Big Move: Moving to Cloud-Based OCLC’s WorldShare Management Servi...
Making the Big Move: Moving to Cloud-Based OCLC’s WorldShare Management Servi...
 
AOEcon17: Searchperience - The journey from PHP and Solr to Scala and Elastic...
AOEcon17: Searchperience - The journey from PHP and Solr to Scala and Elastic...AOEcon17: Searchperience - The journey from PHP and Solr to Scala and Elastic...
AOEcon17: Searchperience - The journey from PHP and Solr to Scala and Elastic...
 
Whitepages Practical Experience Converting from Ruby to Reactive
Whitepages Practical Experience Converting from Ruby to ReactiveWhitepages Practical Experience Converting from Ruby to Reactive
Whitepages Practical Experience Converting from Ruby to Reactive
 
Building a Large Scale SEO/SEM Application with Apache Solr: Presented by Rah...
Building a Large Scale SEO/SEM Application with Apache Solr: Presented by Rah...Building a Large Scale SEO/SEM Application with Apache Solr: Presented by Rah...
Building a Large Scale SEO/SEM Application with Apache Solr: Presented by Rah...
 
DataEngConf SF16 - Scalable and Reliable Logging at Pinterest
DataEngConf SF16 - Scalable and Reliable Logging at PinterestDataEngConf SF16 - Scalable and Reliable Logging at Pinterest
DataEngConf SF16 - Scalable and Reliable Logging at Pinterest
 
Scalable and Reliable Logging at Pinterest
Scalable and Reliable Logging at PinterestScalable and Reliable Logging at Pinterest
Scalable and Reliable Logging at Pinterest
 
Profiling and Tuning a Web Application - The Dirty Details
Profiling and Tuning a Web Application - The Dirty DetailsProfiling and Tuning a Web Application - The Dirty Details
Profiling and Tuning a Web Application - The Dirty Details
 

Mehr von WiLS

1:1 Community Interview Examples & Tips for Libraries
1:1 Community Interview Examples & Tips for Libraries1:1 Community Interview Examples & Tips for Libraries
1:1 Community Interview Examples & Tips for LibrariesWiLS
 
Using Data to Help Tell Your Library's Story
Using Data to Help Tell Your Library's StoryUsing Data to Help Tell Your Library's Story
Using Data to Help Tell Your Library's StoryWiLS
 
he Past Through Tomorrow: Empowering Digital History at the Library
he Past Through Tomorrow:  Empowering Digital History at the Libraryhe Past Through Tomorrow:  Empowering Digital History at the Library
he Past Through Tomorrow: Empowering Digital History at the LibraryWiLS
 
Can Do! The WiLS Toolbox for Building a Culture of Shared Work
Can Do! The WiLS Toolbox for Building a Culture of Shared WorkCan Do! The WiLS Toolbox for Building a Culture of Shared Work
Can Do! The WiLS Toolbox for Building a Culture of Shared WorkWiLS
 
WiLS 2020 Annual Report
WiLS 2020 Annual ReportWiLS 2020 Annual Report
WiLS 2020 Annual ReportWiLS
 
Setting Your Library's Course with Community Demographics
Setting Your Library's Course with Community DemographicsSetting Your Library's Course with Community Demographics
Setting Your Library's Course with Community DemographicsWiLS
 
Lead the Way 2020: Facilitation Tools, Techniques, and Tips
Lead the Way 2020: Facilitation Tools, Techniques, and Tips Lead the Way 2020: Facilitation Tools, Techniques, and Tips
Lead the Way 2020: Facilitation Tools, Techniques, and Tips WiLS
 
WiLS 2020 Membership Meeting
WiLS 2020 Membership MeetingWiLS 2020 Membership Meeting
WiLS 2020 Membership MeetingWiLS
 
WiLS 2019 Annual Report
WiLS 2019 Annual ReportWiLS 2019 Annual Report
WiLS 2019 Annual ReportWiLS
 
Mukurtu Hubs & Spokes: A Sustainable Platform for Community Digital Archiving
Mukurtu Hubs & Spokes: A Sustainable Platform for Community Digital ArchivingMukurtu Hubs & Spokes: A Sustainable Platform for Community Digital Archiving
Mukurtu Hubs & Spokes: A Sustainable Platform for Community Digital ArchivingWiLS
 
Thank You to Recollection Wisconsin Partners
Thank You to Recollection Wisconsin PartnersThank You to Recollection Wisconsin Partners
Thank You to Recollection Wisconsin PartnersWiLS
 
User Experience: Crafting Recommendations
User Experience: Crafting RecommendationsUser Experience: Crafting Recommendations
User Experience: Crafting RecommendationsWiLS
 
Curating Community Digital Collections
Curating Community Digital CollectionsCurating Community Digital Collections
Curating Community Digital CollectionsWiLS
 
Building Belonging: Libraries and Social Justice
Building Belonging: Libraries and Social JusticeBuilding Belonging: Libraries and Social Justice
Building Belonging: Libraries and Social JusticeWiLS
 
Don’t Ask Permission
Don’t Ask PermissionDon’t Ask Permission
Don’t Ask PermissionWiLS
 
Choosing Privacy: Raising Awareness and Engaging Patrons in Privacy Issues
Choosing Privacy: Raising Awareness and Engaging Patrons in Privacy IssuesChoosing Privacy: Raising Awareness and Engaging Patrons in Privacy Issues
Choosing Privacy: Raising Awareness and Engaging Patrons in Privacy IssuesWiLS
 
The Library as Publisher: How Pressbooks Supports Knowledge Sharing
The Library as Publisher: How Pressbooks Supports Knowledge SharingThe Library as Publisher: How Pressbooks Supports Knowledge Sharing
The Library as Publisher: How Pressbooks Supports Knowledge SharingWiLS
 
WiLSWorld 2019 Lightning Talks: Community Engagement Showcase
WiLSWorld 2019 Lightning Talks: Community Engagement ShowcaseWiLSWorld 2019 Lightning Talks: Community Engagement Showcase
WiLSWorld 2019 Lightning Talks: Community Engagement ShowcaseWiLS
 
Engaged and Thriving: Building Peer Support Systems for Staff
Engaged and Thriving: Building Peer Support Systems for StaffEngaged and Thriving: Building Peer Support Systems for Staff
Engaged and Thriving: Building Peer Support Systems for StaffWiLS
 
Productivity Tools You Won't Believe You Lived Without!
Productivity Tools You Won't Believe You Lived Without!Productivity Tools You Won't Believe You Lived Without!
Productivity Tools You Won't Believe You Lived Without!WiLS
 

Mehr von WiLS (20)

1:1 Community Interview Examples & Tips for Libraries
1:1 Community Interview Examples & Tips for Libraries1:1 Community Interview Examples & Tips for Libraries
1:1 Community Interview Examples & Tips for Libraries
 
Using Data to Help Tell Your Library's Story
Using Data to Help Tell Your Library's StoryUsing Data to Help Tell Your Library's Story
Using Data to Help Tell Your Library's Story
 
he Past Through Tomorrow: Empowering Digital History at the Library
he Past Through Tomorrow:  Empowering Digital History at the Libraryhe Past Through Tomorrow:  Empowering Digital History at the Library
he Past Through Tomorrow: Empowering Digital History at the Library
 
Can Do! The WiLS Toolbox for Building a Culture of Shared Work
Can Do! The WiLS Toolbox for Building a Culture of Shared WorkCan Do! The WiLS Toolbox for Building a Culture of Shared Work
Can Do! The WiLS Toolbox for Building a Culture of Shared Work
 
WiLS 2020 Annual Report
WiLS 2020 Annual ReportWiLS 2020 Annual Report
WiLS 2020 Annual Report
 
Setting Your Library's Course with Community Demographics
Setting Your Library's Course with Community DemographicsSetting Your Library's Course with Community Demographics
Setting Your Library's Course with Community Demographics
 
Lead the Way 2020: Facilitation Tools, Techniques, and Tips
Lead the Way 2020: Facilitation Tools, Techniques, and Tips Lead the Way 2020: Facilitation Tools, Techniques, and Tips
Lead the Way 2020: Facilitation Tools, Techniques, and Tips
 
WiLS 2020 Membership Meeting
WiLS 2020 Membership MeetingWiLS 2020 Membership Meeting
WiLS 2020 Membership Meeting
 
WiLS 2019 Annual Report
WiLS 2019 Annual ReportWiLS 2019 Annual Report
WiLS 2019 Annual Report
 
Mukurtu Hubs & Spokes: A Sustainable Platform for Community Digital Archiving
Mukurtu Hubs & Spokes: A Sustainable Platform for Community Digital ArchivingMukurtu Hubs & Spokes: A Sustainable Platform for Community Digital Archiving
Mukurtu Hubs & Spokes: A Sustainable Platform for Community Digital Archiving
 
Thank You to Recollection Wisconsin Partners
Thank You to Recollection Wisconsin PartnersThank You to Recollection Wisconsin Partners
Thank You to Recollection Wisconsin Partners
 
User Experience: Crafting Recommendations
User Experience: Crafting RecommendationsUser Experience: Crafting Recommendations
User Experience: Crafting Recommendations
 
Curating Community Digital Collections
Curating Community Digital CollectionsCurating Community Digital Collections
Curating Community Digital Collections
 
Building Belonging: Libraries and Social Justice
Building Belonging: Libraries and Social JusticeBuilding Belonging: Libraries and Social Justice
Building Belonging: Libraries and Social Justice
 
Don’t Ask Permission
Don’t Ask PermissionDon’t Ask Permission
Don’t Ask Permission
 
Choosing Privacy: Raising Awareness and Engaging Patrons in Privacy Issues
Choosing Privacy: Raising Awareness and Engaging Patrons in Privacy IssuesChoosing Privacy: Raising Awareness and Engaging Patrons in Privacy Issues
Choosing Privacy: Raising Awareness and Engaging Patrons in Privacy Issues
 
The Library as Publisher: How Pressbooks Supports Knowledge Sharing
The Library as Publisher: How Pressbooks Supports Knowledge SharingThe Library as Publisher: How Pressbooks Supports Knowledge Sharing
The Library as Publisher: How Pressbooks Supports Knowledge Sharing
 
WiLSWorld 2019 Lightning Talks: Community Engagement Showcase
WiLSWorld 2019 Lightning Talks: Community Engagement ShowcaseWiLSWorld 2019 Lightning Talks: Community Engagement Showcase
WiLSWorld 2019 Lightning Talks: Community Engagement Showcase
 
Engaged and Thriving: Building Peer Support Systems for Staff
Engaged and Thriving: Building Peer Support Systems for StaffEngaged and Thriving: Building Peer Support Systems for Staff
Engaged and Thriving: Building Peer Support Systems for Staff
 
Productivity Tools You Won't Believe You Lived Without!
Productivity Tools You Won't Believe You Lived Without!Productivity Tools You Won't Believe You Lived Without!
Productivity Tools You Won't Believe You Lived Without!
 

Kürzlich hochgeladen

Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Disha Kariya
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactdawncurless
 
Student login on Anyboli platform.helpin
Student login on Anyboli platform.helpinStudent login on Anyboli platform.helpin
Student login on Anyboli platform.helpinRaunakKeshri1
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhikauryashika82
 
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdfSoniaTolstoy
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Krashi Coaching
 
9548086042 for call girls in Indira Nagar with room service
9548086042  for call girls in Indira Nagar  with room service9548086042  for call girls in Indira Nagar  with room service
9548086042 for call girls in Indira Nagar with room servicediscovermytutordmt
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsTechSoup
 
Disha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdfDisha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdfchloefrazer622
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introductionMaksud Ahmed
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxVishalSingh1417
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Celine George
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdfQucHHunhnh
 
Sanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfSanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfsanyamsingh5019
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAssociation for Project Management
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingTeacherCyreneCayanan
 
Class 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfClass 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfAyushMahapatra5
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)eniolaolutunde
 

Kürzlich hochgeladen (20)

Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impact
 
Student login on Anyboli platform.helpin
Student login on Anyboli platform.helpinStudent login on Anyboli platform.helpin
Student login on Anyboli platform.helpin
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
 
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
 
9548086042 for call girls in Indira Nagar with room service
9548086042  for call girls in Indira Nagar  with room service9548086042  for call girls in Indira Nagar  with room service
9548086042 for call girls in Indira Nagar with room service
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
 
Disha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdfDisha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdf
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptx
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
Advance Mobile Application Development class 07
Advance Mobile Application Development class 07Advance Mobile Application Development class 07
Advance Mobile Application Development class 07
 
Sanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfSanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdf
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across Sectors
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writing
 
Class 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfClass 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdf
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)
 

Peer council 2013_presentation

  • 1. An Automated Cataloging Workflow with SkyRiver Jim Novy and Steve Ohs Lakeshores Library System 1
  • 2. The presenters… Jim Novy • System Services Technician • Primary IT expertise at LLS • Automation Coordinator of SHARE Consortium Steve Ohs • Library Development Coordinator at LLS • Supports Jim in IT & ILS administration • Partial cataloging background 2
  • 3. Outline for this session… 1. Challenges we face in our consortium 2. Background of our choice to move to SkyRiver 3. Our old work flow 4. Our new work flow (and the benefits as we see them) 5. Some code examples **Please feel free to ask questions as we move through the presentation!** 3
  • 4. Our Challenges… • Lots of libraries (50 Public & K-12s). Huge variance in onsite cataloging expertise • Historically a free-for-all. No formal agreement to govern cataloging practices or quality • Ongoing duplicate problem & lots of coding inconsistencies • Staffers lost through attrition not being replaced • 2 original catalogers in the entire consortium 4
  • 5. Our choice to move to SkyRiver… • SHARE was an OCLC customer since its inception until 2010 • Utilized a working group of catalogers to “test drive” the SkyRiver database • Record quality acceptable • Database coverage acceptable • Main motivation was cost savings • An additional bonus (for us): responsiveness to our needs 5
  • 6. SkyRiver isn’t perfect… • We tend to find more records of a less-than-full nature. We find more oddball Elvl records than we’re used to • A few publishers weren’t initially well- represented • Fewer “individual disc” or “split” records for certain video and sound recordings (though in our case we’re trying to move away from that) • Longer wait times for a record to appear 6
  • 7. Our *OLD* work flow… 7
  • 8. That work flow didn’t cut it… The imperfections of SkyRiver… • Certain materials harder to find • Certain publishers not initially well-represented • More records of less-than-full quality being incorrectly imported into the ILS • Generally longer wait times until a full level record became available …translated into longer periods of time for items to get into the hands of patrons.  This was a problem(for us) 8
  • 9. So there we were… • Pressure was mounting to come up with some sort of a solution • Implementing an effective program of staff training & uniform application of learned standards was not an option. • It was at this point we remembered we had direct z39.50 access to SkyRiver’s server 9
  • 10. Snapping the pieces together… We cobbled together a new, automated, work flow using a few different parts: 1. SirsiDynix Symphony ILS API tools 2. The Perl programming language & some extra Perl code libraries 3. An algorithm that Jim previously designed to rank, select and overlay records based on quality 4. A “brief record” model we gleaned from SAILS consortium (CT) 5. Our existing model of using the two original catalogers to mediate the original cataloging situation 10
  • 11. Our *NEW* work flow… 11
  • 12. MARC-BRIEFNightly Processing(Detail)… For each MARC-BRIEF record: 1. Duplicate check against our catalog. If duplicate found, the MARC-BRIEF holdings & items are merged into existing record. 2. Initiate z39.50 connection. Search for & extract a matching record set. Process records through ranking algorithm. Winning record overlays onto MARC-BRIEF. If no matching records retrieved, automatically constructs & emails SkySearchPlus record request for the title. 3. If MARC-BRIEF record is not overlaid within 4 weeks, a hold is created on that item for the nearest Original Cataloger. Patron holds prioritized. Item then follows normal intra-system transit flow, is originally cataloged, and returned to owning library. 12
  • 13. RankingAlgorithm (Detail)… What determines the best record score of a given set? Some elements are: • Elvl leader byte • Contents of 040 • Number of 5XX notes • Number of 6XX headings with 1st indicator 0 or 1 • Presence of 6XX headings with juvenile form subdivisions 13
  • 14. Local Record Improvements For each record added in a day, we process it through the following improvements: • Convert 440 to 490 • Add 007 if not present or invalid • Add local GMD • Fix subfield v values in 490 14
  • 15. Additionalprojects(Detail)… • Weekly “Brief Record Update” scripts to upgrade non MARC-BRIEF records brought in. • Daily scripts to collect possible duplicates & present to catalogers. • Developing agnostic vendor record loader. So any library that wants to can load vendor records directly as MARC-BRIEF, including pre-processing information (holdings codes, call numbers, barcodes, prices) 15
  • 16. Analysis… Benefits • It’s a much simpler copy cataloging work flow • Extra duplicate checks are built-in • We leverage the ‘perks’ of z39.50 and SkySearchPlus • Items can circulate immediately • Items in need of OC’ing integrate seamlessly into the normal ‘hold picking’ process Drawbacks • Reliant on ISBN matching, so older items or split dvd’sare still sometimes a pain • Significant up-front development & debugging time • Initially made some staff fearful 16
  • 17. Code & Questions… Thanks!! Jim  jnovy@lakeshores.lib.wi.us Steve  sohs@lakeshores.lib.wi.us 17