SlideShare ist ein Scribd-Unternehmen logo
1 von 15
TEXT ANALYZER:
A NEW WAY TO SEARCH,
FROM JSTOR LABS
DPLAfest 2017
20 April 2017
Alex Humphreys
@abhumphreys
JSTOR Labs works with partner publishers, libraries and
labs to create tools for researchers, teachers and students
that are immediately useful – and a little bit magical.
INTRODUCING…
www.jstor.org/analyze
UNDER THE HOOD
1. Extract Text
a. From many textual
formats (pdf, word, et
al)
b. OCR, if needed (e.g. a
picture of a page in a
magazine)
2. Identify Terms
a. Topics: JSTOR
Thesaurus & an LDA
Topic Model
b. Entities: Alchemy
(Watson), OpenCalais,
Stanford, Apache
3. Generate Results
a. TF-IDF to select 5 terms
b. “OR” search
c. Relevance ranked based
on “equalizer”
HOW WE BUILT IT
The Design Squiggle, by Damien Newman:
http://cargocollective.com/central/The-Design-Squiggle/
THE SEED…
The Design Squiggle, by Damien Newman:
http://cargocollective.com/central/The-Design-Squiggle/
CONCEPT TESTING...
The Design Squiggle, by Damien Newman:
http://cargocollective.com/central/The-Design-Squiggle/
ITERATING ON
INTERACTION DESIGN
The Design Squiggle, by Damien Newman:
http://cargocollective.com/central/The-Design-Squiggle/
RELEASE AS A JSTOR BETA…
The Design Squiggle, by Damien Newman:
http://cargocollective.com/central/The-Design-Squiggle/
WE’RE STILL REFINING...
The Design Squiggle, by Damien Newman:
http://cargocollective.com/central/The-Design-Squiggle/
THANK YOU!
For more information:
web: labs.jstor.org
email: alex.humphreys@ithaka.org
twitter: @abhumphreys
APPENDIX
(OPEN IN CASE OF NO
INTERNET CONNECTION)
Text Analyzer: a New Way to Search from JSTOR Labs
Text Analyzer: a New Way to Search from JSTOR Labs
Text Analyzer: a New Way to Search from JSTOR Labs

Weitere ähnliche Inhalte

Mehr von Alex Humphreys

Reimagining the Monograph - guest lecture at the Kluge Center of the Library ...
Reimagining the Monograph - guest lecture at the Kluge Center of the Library ...Reimagining the Monograph - guest lecture at the Kluge Center of the Library ...
Reimagining the Monograph - guest lecture at the Kluge Center of the Library ...
Alex Humphreys
 
JSTOR Sustainability: Creating a Multidisciplinary Map for Researchers - ASEH...
JSTOR Sustainability: Creating a Multidisciplinary Map for Researchers - ASEH...JSTOR Sustainability: Creating a Multidisciplinary Map for Researchers - ASEH...
JSTOR Sustainability: Creating a Multidisciplinary Map for Researchers - ASEH...
Alex Humphreys
 

Mehr von Alex Humphreys (20)

The Case for Applied Digital Humanities in Scholarly Communications
The Case for Applied Digital Humanities in Scholarly CommunicationsThe Case for Applied Digital Humanities in Scholarly Communications
The Case for Applied Digital Humanities in Scholarly Communications
 
Your Chocolate, My Peanut Butter: JSTOR Labs' Content Mashups - NFAIS Webinar...
Your Chocolate, My Peanut Butter: JSTOR Labs' Content Mashups - NFAIS Webinar...Your Chocolate, My Peanut Butter: JSTOR Labs' Content Mashups - NFAIS Webinar...
Your Chocolate, My Peanut Butter: JSTOR Labs' Content Mashups - NFAIS Webinar...
 
Creating a New Way to Search - CNI Fall 2017
Creating a New Way to Search - CNI Fall 2017Creating a New Way to Search - CNI Fall 2017
Creating a New Way to Search - CNI Fall 2017
 
How JSTOR Labs Applies (Some) Methods & Tools from Digital Scholarship - SSP ...
How JSTOR Labs Applies (Some) Methods & Tools from Digital Scholarship - SSP ...How JSTOR Labs Applies (Some) Methods & Tools from Digital Scholarship - SSP ...
How JSTOR Labs Applies (Some) Methods & Tools from Digital Scholarship - SSP ...
 
How JSTOR Labs Thinks about Change - German Studies Association 2017 Annual C...
How JSTOR Labs Thinks about Change - German Studies Association 2017 Annual C...How JSTOR Labs Thinks about Change - German Studies Association 2017 Annual C...
How JSTOR Labs Thinks about Change - German Studies Association 2017 Annual C...
 
Reimagining the Monograph - guest lecture at the Kluge Center of the Library ...
Reimagining the Monograph - guest lecture at the Kluge Center of the Library ...Reimagining the Monograph - guest lecture at the Kluge Center of the Library ...
Reimagining the Monograph - guest lecture at the Kluge Center of the Library ...
 
On Beyond Keyword Search: The Thinking Behind JSTOR Labs' Text Analyzer - NFA...
On Beyond Keyword Search: The Thinking Behind JSTOR Labs' Text Analyzer - NFA...On Beyond Keyword Search: The Thinking Behind JSTOR Labs' Text Analyzer - NFA...
On Beyond Keyword Search: The Thinking Behind JSTOR Labs' Text Analyzer - NFA...
 
Reimagining the Monograph - AAUP 2017 Annual Meeting
Reimagining the Monograph - AAUP 2017 Annual MeetingReimagining the Monograph - AAUP 2017 Annual Meeting
Reimagining the Monograph - AAUP 2017 Annual Meeting
 
Introduction to JSTOR Labs: What We Do & How We Do It
Introduction to JSTOR Labs: What We Do & How We Do ItIntroduction to JSTOR Labs: What We Do & How We Do It
Introduction to JSTOR Labs: What We Do & How We Do It
 
Reimagining the Digital Monograph: Improving the Discovery and Use of Scholar...
Reimagining the Digital Monograph: Improving the Discovery and Use of Scholar...Reimagining the Digital Monograph: Improving the Discovery and Use of Scholar...
Reimagining the Digital Monograph: Improving the Discovery and Use of Scholar...
 
ACRL 2017: Unlocking the Value of the Monograph
ACRL 2017: Unlocking the Value of the MonographACRL 2017: Unlocking the Value of the Monograph
ACRL 2017: Unlocking the Value of the Monograph
 
Building Your Next Great Product by Talking to Users Each Step of the Way
Building Your Next Great Product by Talking to Users Each Step of the WayBuilding Your Next Great Product by Talking to Users Each Step of the Way
Building Your Next Great Product by Talking to Users Each Step of the Way
 
Design Jam: Brainstorm Innovative Ideas by Focusing on the User - AAUP 2016
Design Jam: Brainstorm Innovative Ideas by Focusing on the User - AAUP 2016Design Jam: Brainstorm Innovative Ideas by Focusing on the User - AAUP 2016
Design Jam: Brainstorm Innovative Ideas by Focusing on the User - AAUP 2016
 
JSTOR Sustainabilty: Supporting Multidisciplinary Researchers
JSTOR Sustainabilty: Supporting Multidisciplinary ResearchersJSTOR Sustainabilty: Supporting Multidisciplinary Researchers
JSTOR Sustainabilty: Supporting Multidisciplinary Researchers
 
Of Libraries and Labs: Effecting User-Driven Innovation
Of Libraries and Labs: Effecting User-Driven InnovationOf Libraries and Labs: Effecting User-Driven Innovation
Of Libraries and Labs: Effecting User-Driven Innovation
 
Understanding Shakespeare: What We've Learned (So Far) - RSA 2016
Understanding Shakespeare: What We've Learned (So Far) - RSA 2016Understanding Shakespeare: What We've Learned (So Far) - RSA 2016
Understanding Shakespeare: What We've Learned (So Far) - RSA 2016
 
JSTOR Sustainability: Creating a Multidisciplinary Map for Researchers - ASEH...
JSTOR Sustainability: Creating a Multidisciplinary Map for Researchers - ASEH...JSTOR Sustainability: Creating a Multidisciplinary Map for Researchers - ASEH...
JSTOR Sustainability: Creating a Multidisciplinary Map for Researchers - ASEH...
 
Learning Lean: Using Flash Builds to Learn from Your Users
Learning Lean: Using Flash Builds to Learn from Your UsersLearning Lean: Using Flash Builds to Learn from Your Users
Learning Lean: Using Flash Builds to Learn from Your Users
 
Of Libraries and Labs: Effecting User-Driven Innovation - RLUK Members Mtg 2015
Of Libraries and Labs: Effecting User-Driven Innovation - RLUK Members Mtg 2015Of Libraries and Labs: Effecting User-Driven Innovation - RLUK Members Mtg 2015
Of Libraries and Labs: Effecting User-Driven Innovation - RLUK Members Mtg 2015
 
Really, Really Rapid Prototyping: Flash Builds and User-Driven Innovation - N...
Really, Really Rapid Prototyping: Flash Builds and User-Driven Innovation - N...Really, Really Rapid Prototyping: Flash Builds and User-Driven Innovation - N...
Really, Really Rapid Prototyping: Flash Builds and User-Driven Innovation - N...
 

Kürzlich hochgeladen

The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
heathfieldcps1
 

Kürzlich hochgeladen (20)

How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17
 
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptxHMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
 
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdfUnit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
SOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning PresentationSOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning Presentation
 
Interdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptxInterdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptx
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POS
 
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.
 
REMIFENTANIL: An Ultra short acting opioid.pptx
REMIFENTANIL: An Ultra short acting opioid.pptxREMIFENTANIL: An Ultra short acting opioid.pptx
REMIFENTANIL: An Ultra short acting opioid.pptx
 
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptxHMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
Towards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxTowards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptx
 
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
 
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
 
Understanding Accommodations and Modifications
Understanding  Accommodations and ModificationsUnderstanding  Accommodations and Modifications
Understanding Accommodations and Modifications
 
Sociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning ExhibitSociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning Exhibit
 

Text Analyzer: a New Way to Search from JSTOR Labs

  • 1. TEXT ANALYZER: A NEW WAY TO SEARCH, FROM JSTOR LABS DPLAfest 2017 20 April 2017 Alex Humphreys @abhumphreys
  • 2. JSTOR Labs works with partner publishers, libraries and labs to create tools for researchers, teachers and students that are immediately useful – and a little bit magical.
  • 4. UNDER THE HOOD 1. Extract Text a. From many textual formats (pdf, word, et al) b. OCR, if needed (e.g. a picture of a page in a magazine) 2. Identify Terms a. Topics: JSTOR Thesaurus & an LDA Topic Model b. Entities: Alchemy (Watson), OpenCalais, Stanford, Apache 3. Generate Results a. TF-IDF to select 5 terms b. “OR” search c. Relevance ranked based on “equalizer”
  • 5. HOW WE BUILT IT The Design Squiggle, by Damien Newman: http://cargocollective.com/central/The-Design-Squiggle/
  • 6. THE SEED… The Design Squiggle, by Damien Newman: http://cargocollective.com/central/The-Design-Squiggle/
  • 7. CONCEPT TESTING... The Design Squiggle, by Damien Newman: http://cargocollective.com/central/The-Design-Squiggle/
  • 8. ITERATING ON INTERACTION DESIGN The Design Squiggle, by Damien Newman: http://cargocollective.com/central/The-Design-Squiggle/
  • 9. RELEASE AS A JSTOR BETA… The Design Squiggle, by Damien Newman: http://cargocollective.com/central/The-Design-Squiggle/
  • 10. WE’RE STILL REFINING... The Design Squiggle, by Damien Newman: http://cargocollective.com/central/The-Design-Squiggle/
  • 11. THANK YOU! For more information: web: labs.jstor.org email: alex.humphreys@ithaka.org twitter: @abhumphreys
  • 12. APPENDIX (OPEN IN CASE OF NO INTERNET CONNECTION)