SlideShare ist ein Scribd-Unternehmen logo
1 von 36
Electronic Resource Assessment:
Adventures in Engagement
John Tofanelli | Colleen Major | Jeff Carroll
Columbia University Libraries
MOVING TOWARDS ENGAGEMENT
• The larger assessment environment
• Methods for involving selectors in the assessment process
• An invention that facilitates involvement: Google fund
calendars
THE FISCAL ENVIRONMENT
THE COMMERCIAL PUBLISHING ENVIRONMENT
Proliferations
• Publications that go forth and multiply
• Packages and/or databases that overlap in content
• Databases and e-journals available from more than one
vendor, each providing access through its own interface
THE COMMERCIAL PUBLISHING ENVIRONMENT
Challenges
• All-or-nothing aggregator packages
• Licensing agreements that limit the scope of cancellation
activity within e-journal packages
• Columbia Libraries have over 98,000 ongoing e-resource
purchases (includes serials & continuing service fees)
• Payments are due throughout the fiscal year
• Vendors must typically be notified of serials cancellations 30
days before renewal date
THE DATA ENVIRONMENT
• E-Resource Management Systems
• Standardized Usage Data (COUNTER)
USAGE STATISTICS:
STANDARDIZED & EXPLAINED
COUNTER (Counting Online Usage of NeTworked Electronic
Resources)
"an international initiative serving librarians, publishers and
intermediaries by setting standards that facilitate the recording
and reporting of online usage statistics in a consistent, credible
and compatible way."
http://www.projectcounter.org/about.html
COUNTER Code of Practice: Release 1 published 2003
Draft release 4 currently available for public comment
THE INTERNAL WORKPLACE ENVIRONMENT
As found at Columbia University
• More than forty subject selectors
• Seven library divisions:
History & Humanities; Science & Engineering; Art &
Architecture; Area Studies; Social Sciences; Theology;
Rare Books & Manuscripts
• Many selectors not yet trained in use of new tools available
in the data environment
• Assessment practices uneven across disciplinary areas
WHEN, WHY, AND HOW DO WE ASSESS
E-RESOURCES?
Chapter 1
Where our Journey Began
The Conservative, Minimalist, and Reactive Approach
• assessment is largely confined to pre-purchase trial period
• subsequent assessment is done primarily in response to
known problems
• characteristic of a growth economy
• emphasis is on expansion of online collections
WHEN, WHY, AND HOW DO WE ASSESS E-
RESOURCES?
Chapter 12
Where we need to be now
The Expansive, Holistic, and Proactive Approach
• assessment is an ongoing periodic duty
• assessment can discover or anticipate problems
• characteristic of a constrained economy
• emphasis is on managing what we have; growing collections
judiciously; ensuring value for dollar
Engaging Selectors in Assessment
Engaging Selectors in Assessment
• Make assignments (working groups, projects, etc.)
Engaging Selectors in Assessment
• Make assignments (working groups, projects, etc.)
• Announce new projects, workflows, etc. to selectors
Engaging Selectors in Assessment
• Make assignments (working groups, projects, etc.)
• Announce new projects, workflows, etc. to selectors
• Follow up in weeks after announcement to see who
has made progress
Engaging Selectors in Assessment
• Make assignments (working groups, projects, etc.)
• Announce new projects, workflows, etc. to selectors
• Follow up in weeks after announcement to see who
has made progress
• Enlist 1 or 2 of these selectors to present at a follow
up session as example/testimonial
Engaging Selectors in Assessment
• Make assignments (working groups, projects, etc.)
• Announce new projects, workflows, etc. to selectors
• Follow up in weeks after announcement to see who
has made progress
• Enlist 1 or 2 of these selectors to present at a follow
up session as example/testimonial
• Solicit feedback from individuals and divisions
• E-Resource Assessment Task Force (2008)
• E-Resource Assessment Working Group
• 2009 - and beyond
Both groups consisted of:
Make Assignments
• E-Resource Assessment Task Force (2008)
• E-Resource Assessment Working Group
• 2009 - and beyond
Both groups consisted of:
• Selectors from various divisions
Make Assignments
• E-Resource Assessment Task Force (2008)
• E-Resource Assessment Working Group
• 2009 - and beyond
Both groups consisted of:
• Selectors from various divisions
• E-Resources librarian
Make Assignments
• E-Resource Assessment Task Force (2008)
• E-Resource Assessment Working Group
• 2009 - and beyond
Both groups consisted of:
• Selectors from various divisions
• E-Resources librarian
• Asst. Director for Collection
Development
Make Assignments
Announce new projects
• Eresources Assessment Working Group
announces new projects
Follow up
• Eresources Assessment Working Group
announces new projects
• Group follows up after a period of time
Follow up
• Eresources Assessment Working Group
announces new projects
• Group follows up after a period of time
o educational offerings in the use of
electronic resource management tools
Enlist those engaged
• Eresources Assessment Working Group
announces new projects
• Group follows up after a period of time
• Ask selectors who have become engaged
to present on their findings and
demonstrate their methodology
Enlist those engaged
• Eresources Assessment Working Group
announces new projects
• Group follows up after a period of time
• Ask selectors who have become engaged
to present on their findings and
demonstrate their methodology
o inspirational presentations from
librarians who have improved
collections using such tools
Track engagement
• E-resources Assessment Working Group
announces new projects
• Group follows up after a period of time
• Ask selectors who have become engaged
to present on their findings and
demonstrate their methodology
• Evaluate the level of engagement by
selectors
Google Calendar
• Created e-resource renewal reminder system in
Google Calendar
• Announced and demonstrated capabilities of
calendar at a meeting of the Selectors
Discussion Group
• Followed up with selectors to see who had
actually made use of the calendar
• Enlisted engaged selectors to present their
findings and methodologies
• Tracked level of overall engagement by looking
at calendar usage
• What we had been using
• What we wanted:
o easy to use
o easy to implement
o pushed to users
o played off existing efforts and strategies
• How we did it
Python code is available at:
https://github.com/nadaoneal/gapps_python_whatever
Creation of an e-resource reminder
system in Google Calendar
one month view
expenditure event view
3 month event reminder
5 month event reminder
Staff work view
Searching across calendars
Image: http://www.openclipart.org/detail/159643/thank-you-pinned-by-juliobaha

Weitere ähnliche Inhalte

Ähnlich wie Electronic Resource Assessment: Adventures in Engagement

Expertise, Consumer-Oriented, and Program-Oriented Evaluation Approaches
Expertise, Consumer-Oriented, and Program-Oriented Evaluation ApproachesExpertise, Consumer-Oriented, and Program-Oriented Evaluation Approaches
Expertise, Consumer-Oriented, and Program-Oriented Evaluation Approachesdctrcurry
 
Evaluating Systems Change
Evaluating Systems ChangeEvaluating Systems Change
Evaluating Systems ChangeNoel Hatch
 
What is program evaluation lecture 100207 [compatibility mode]
What is program evaluation lecture   100207 [compatibility mode]What is program evaluation lecture   100207 [compatibility mode]
What is program evaluation lecture 100207 [compatibility mode]Jennifer Morrow
 
Rubriq: Independent Peer Review & Journal Matching ISMTE 2012
Rubriq: Independent Peer Review & Journal Matching   ISMTE 2012Rubriq: Independent Peer Review & Journal Matching   ISMTE 2012
Rubriq: Independent Peer Review & Journal Matching ISMTE 2012Keith Collier
 
Accreditation introduction workshop slides 2017
Accreditation introduction workshop slides 2017Accreditation introduction workshop slides 2017
Accreditation introduction workshop slides 2017Melinda Haunton
 
Hci evaluationa frame work lec 14
Hci evaluationa frame work lec 14Hci evaluationa frame work lec 14
Hci evaluationa frame work lec 14Anwal Mirza
 
Accreditation introduction workshop slides - updated 2017 with timescales
Accreditation introduction workshop slides - updated 2017 with timescalesAccreditation introduction workshop slides - updated 2017 with timescales
Accreditation introduction workshop slides - updated 2017 with timescalesMelinda Haunton
 
Planning with numbers
Planning with numbersPlanning with numbers
Planning with numbersCapULibrary
 
Evaluating Problem Gambling KTE
Evaluating Problem Gambling KTEEvaluating Problem Gambling KTE
Evaluating Problem Gambling KTEAnne Bergen
 
Retention Modeling for the Eastern Academic Scholars' Trust (EAST)
Retention Modeling for the Eastern Academic Scholars' Trust (EAST)Retention Modeling for the Eastern Academic Scholars' Trust (EAST)
Retention Modeling for the Eastern Academic Scholars' Trust (EAST)Anna Perricci
 
Build Your Community Professional Services
Build Your Community Professional ServicesBuild Your Community Professional Services
Build Your Community Professional ServicesShack Co.
 
Journal Review Benefits Beyond the Budget: Dollars and Sense at Wayne State U...
Journal Review Benefits Beyond the Budget: Dollars and Sense at Wayne State U...Journal Review Benefits Beyond the Budget: Dollars and Sense at Wayne State U...
Journal Review Benefits Beyond the Budget: Dollars and Sense at Wayne State U...Charleston Conference
 
NCompass Live: ACRL Outcome Measurement Made Easy: Project Outcome for Academ...
NCompass Live: ACRL Outcome Measurement Made Easy: Project Outcome for Academ...NCompass Live: ACRL Outcome Measurement Made Easy: Project Outcome for Academ...
NCompass Live: ACRL Outcome Measurement Made Easy: Project Outcome for Academ...Nebraska Library Commission
 
Flexible Evaluation
Flexible EvaluationFlexible Evaluation
Flexible EvaluationpasicUganda
 
Evaluation Workshop
Evaluation WorkshopEvaluation Workshop
Evaluation WorkshopNoel Hatch
 

Ähnlich wie Electronic Resource Assessment: Adventures in Engagement (20)

Expertise, Consumer-Oriented, and Program-Oriented Evaluation Approaches
Expertise, Consumer-Oriented, and Program-Oriented Evaluation ApproachesExpertise, Consumer-Oriented, and Program-Oriented Evaluation Approaches
Expertise, Consumer-Oriented, and Program-Oriented Evaluation Approaches
 
Evaluating Systems Change
Evaluating Systems ChangeEvaluating Systems Change
Evaluating Systems Change
 
What is program evaluation lecture 100207 [compatibility mode]
What is program evaluation lecture   100207 [compatibility mode]What is program evaluation lecture   100207 [compatibility mode]
What is program evaluation lecture 100207 [compatibility mode]
 
Rubriq: Independent Peer Review & Journal Matching ISMTE 2012
Rubriq: Independent Peer Review & Journal Matching   ISMTE 2012Rubriq: Independent Peer Review & Journal Matching   ISMTE 2012
Rubriq: Independent Peer Review & Journal Matching ISMTE 2012
 
Assessment 101 Part 3
Assessment 101 Part 3Assessment 101 Part 3
Assessment 101 Part 3
 
Accreditation introduction workshop slides 2017
Accreditation introduction workshop slides 2017Accreditation introduction workshop slides 2017
Accreditation introduction workshop slides 2017
 
How to Increase Extension Program Outcomes and Impacts (Slides for Educators)
How to Increase Extension Program Outcomes and Impacts (Slides for Educators)How to Increase Extension Program Outcomes and Impacts (Slides for Educators)
How to Increase Extension Program Outcomes and Impacts (Slides for Educators)
 
Update jiscpathfinder(2) sharp_taylor-roe_uksg2015
Update jiscpathfinder(2) sharp_taylor-roe_uksg2015Update jiscpathfinder(2) sharp_taylor-roe_uksg2015
Update jiscpathfinder(2) sharp_taylor-roe_uksg2015
 
Hci evaluationa frame work lec 14
Hci evaluationa frame work lec 14Hci evaluationa frame work lec 14
Hci evaluationa frame work lec 14
 
Accreditation introduction workshop slides - updated 2017 with timescales
Accreditation introduction workshop slides - updated 2017 with timescalesAccreditation introduction workshop slides - updated 2017 with timescales
Accreditation introduction workshop slides - updated 2017 with timescales
 
Planning with numbers
Planning with numbersPlanning with numbers
Planning with numbers
 
Evaluating Problem Gambling KTE
Evaluating Problem Gambling KTEEvaluating Problem Gambling KTE
Evaluating Problem Gambling KTE
 
Retention Modeling for the Eastern Academic Scholars' Trust (EAST)
Retention Modeling for the Eastern Academic Scholars' Trust (EAST)Retention Modeling for the Eastern Academic Scholars' Trust (EAST)
Retention Modeling for the Eastern Academic Scholars' Trust (EAST)
 
Build Your Community Professional Services
Build Your Community Professional ServicesBuild Your Community Professional Services
Build Your Community Professional Services
 
Virginia tech's transition to sakai
Virginia tech's transition to sakaiVirginia tech's transition to sakai
Virginia tech's transition to sakai
 
Clement, A measured approach to supporting research productivity
Clement, A measured approach to supporting research productivityClement, A measured approach to supporting research productivity
Clement, A measured approach to supporting research productivity
 
Journal Review Benefits Beyond the Budget: Dollars and Sense at Wayne State U...
Journal Review Benefits Beyond the Budget: Dollars and Sense at Wayne State U...Journal Review Benefits Beyond the Budget: Dollars and Sense at Wayne State U...
Journal Review Benefits Beyond the Budget: Dollars and Sense at Wayne State U...
 
NCompass Live: ACRL Outcome Measurement Made Easy: Project Outcome for Academ...
NCompass Live: ACRL Outcome Measurement Made Easy: Project Outcome for Academ...NCompass Live: ACRL Outcome Measurement Made Easy: Project Outcome for Academ...
NCompass Live: ACRL Outcome Measurement Made Easy: Project Outcome for Academ...
 
Flexible Evaluation
Flexible EvaluationFlexible Evaluation
Flexible Evaluation
 
Evaluation Workshop
Evaluation WorkshopEvaluation Workshop
Evaluation Workshop
 

Kürzlich hochgeladen

Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUK Journal
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessPixlogix Infotech
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...Neo4j
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?Antenna Manufacturer Coco
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEarley Information Science
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 

Kürzlich hochgeladen (20)

Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 

Electronic Resource Assessment: Adventures in Engagement

  • 1. Electronic Resource Assessment: Adventures in Engagement John Tofanelli | Colleen Major | Jeff Carroll Columbia University Libraries
  • 2. MOVING TOWARDS ENGAGEMENT • The larger assessment environment • Methods for involving selectors in the assessment process • An invention that facilitates involvement: Google fund calendars
  • 4. THE COMMERCIAL PUBLISHING ENVIRONMENT Proliferations • Publications that go forth and multiply • Packages and/or databases that overlap in content • Databases and e-journals available from more than one vendor, each providing access through its own interface
  • 5. THE COMMERCIAL PUBLISHING ENVIRONMENT Challenges • All-or-nothing aggregator packages • Licensing agreements that limit the scope of cancellation activity within e-journal packages • Columbia Libraries have over 98,000 ongoing e-resource purchases (includes serials & continuing service fees) • Payments are due throughout the fiscal year • Vendors must typically be notified of serials cancellations 30 days before renewal date
  • 6. THE DATA ENVIRONMENT • E-Resource Management Systems • Standardized Usage Data (COUNTER)
  • 7. USAGE STATISTICS: STANDARDIZED & EXPLAINED COUNTER (Counting Online Usage of NeTworked Electronic Resources) "an international initiative serving librarians, publishers and intermediaries by setting standards that facilitate the recording and reporting of online usage statistics in a consistent, credible and compatible way." http://www.projectcounter.org/about.html COUNTER Code of Practice: Release 1 published 2003 Draft release 4 currently available for public comment
  • 8. THE INTERNAL WORKPLACE ENVIRONMENT As found at Columbia University • More than forty subject selectors • Seven library divisions: History & Humanities; Science & Engineering; Art & Architecture; Area Studies; Social Sciences; Theology; Rare Books & Manuscripts • Many selectors not yet trained in use of new tools available in the data environment • Assessment practices uneven across disciplinary areas
  • 9. WHEN, WHY, AND HOW DO WE ASSESS E-RESOURCES? Chapter 1 Where our Journey Began The Conservative, Minimalist, and Reactive Approach • assessment is largely confined to pre-purchase trial period • subsequent assessment is done primarily in response to known problems • characteristic of a growth economy • emphasis is on expansion of online collections
  • 10. WHEN, WHY, AND HOW DO WE ASSESS E- RESOURCES? Chapter 12 Where we need to be now The Expansive, Holistic, and Proactive Approach • assessment is an ongoing periodic duty • assessment can discover or anticipate problems • characteristic of a constrained economy • emphasis is on managing what we have; growing collections judiciously; ensuring value for dollar
  • 11. Engaging Selectors in Assessment
  • 12. Engaging Selectors in Assessment • Make assignments (working groups, projects, etc.)
  • 13. Engaging Selectors in Assessment • Make assignments (working groups, projects, etc.) • Announce new projects, workflows, etc. to selectors
  • 14. Engaging Selectors in Assessment • Make assignments (working groups, projects, etc.) • Announce new projects, workflows, etc. to selectors • Follow up in weeks after announcement to see who has made progress
  • 15. Engaging Selectors in Assessment • Make assignments (working groups, projects, etc.) • Announce new projects, workflows, etc. to selectors • Follow up in weeks after announcement to see who has made progress • Enlist 1 or 2 of these selectors to present at a follow up session as example/testimonial
  • 16. Engaging Selectors in Assessment • Make assignments (working groups, projects, etc.) • Announce new projects, workflows, etc. to selectors • Follow up in weeks after announcement to see who has made progress • Enlist 1 or 2 of these selectors to present at a follow up session as example/testimonial • Solicit feedback from individuals and divisions
  • 17. • E-Resource Assessment Task Force (2008) • E-Resource Assessment Working Group • 2009 - and beyond Both groups consisted of: Make Assignments
  • 18. • E-Resource Assessment Task Force (2008) • E-Resource Assessment Working Group • 2009 - and beyond Both groups consisted of: • Selectors from various divisions Make Assignments
  • 19. • E-Resource Assessment Task Force (2008) • E-Resource Assessment Working Group • 2009 - and beyond Both groups consisted of: • Selectors from various divisions • E-Resources librarian Make Assignments
  • 20. • E-Resource Assessment Task Force (2008) • E-Resource Assessment Working Group • 2009 - and beyond Both groups consisted of: • Selectors from various divisions • E-Resources librarian • Asst. Director for Collection Development Make Assignments
  • 21. Announce new projects • Eresources Assessment Working Group announces new projects
  • 22. Follow up • Eresources Assessment Working Group announces new projects • Group follows up after a period of time
  • 23. Follow up • Eresources Assessment Working Group announces new projects • Group follows up after a period of time o educational offerings in the use of electronic resource management tools
  • 24. Enlist those engaged • Eresources Assessment Working Group announces new projects • Group follows up after a period of time • Ask selectors who have become engaged to present on their findings and demonstrate their methodology
  • 25. Enlist those engaged • Eresources Assessment Working Group announces new projects • Group follows up after a period of time • Ask selectors who have become engaged to present on their findings and demonstrate their methodology o inspirational presentations from librarians who have improved collections using such tools
  • 26. Track engagement • E-resources Assessment Working Group announces new projects • Group follows up after a period of time • Ask selectors who have become engaged to present on their findings and demonstrate their methodology • Evaluate the level of engagement by selectors
  • 27.
  • 28. Google Calendar • Created e-resource renewal reminder system in Google Calendar • Announced and demonstrated capabilities of calendar at a meeting of the Selectors Discussion Group • Followed up with selectors to see who had actually made use of the calendar • Enlisted engaged selectors to present their findings and methodologies • Tracked level of overall engagement by looking at calendar usage
  • 29. • What we had been using • What we wanted: o easy to use o easy to implement o pushed to users o played off existing efforts and strategies • How we did it Python code is available at: https://github.com/nadaoneal/gapps_python_whatever Creation of an e-resource reminder system in Google Calendar
  • 32. 3 month event reminder
  • 33. 5 month event reminder