2. Learning outcomes for today
At the end of this session, participants will be able to:
1. Describe the learning outcomes assessment process
in libraries.
2. Write learning outcomes for an information literacy instruction
session.
3. Choose appropriate assessment methods.
4. Define ways to work with assessment results.
2
3. Why assess student learning in libraries?
3
ï Affirm commitment to student learning
ï Improve effectiveness of instructional programs
ï Align with campus, disciplinary, and higher ed efforts
ï Be recognized on campus for contributions to
student learning
4. Whatâs happening on campus?
4
SACS re-accreditation: required departments and
programs to create and assess learning outcomes
(SLOs/objectives/goals)
Undergraduate programs have done this; graduate
programs are in the process
Every department and program website must post
learning outcomes
5. Example: Classical Studies
5
Majors develop:
ï Comprehensive knowledge of disciplinary fundamentals through study of Greek and Latin (CLLA),
courses in both Greek and Roman history, and a variety of courses in literature, art and archaeology,
history, philosophy (CLCIV), with ample scope in both domains for developing advanced-level
proficiencies through more concentrated study.
ï Proficiency in writing in the discipline of Classical Studies, enjoying opportunities to write research and
analytical papers in in both CLLA and CLCIV courses. In addition, all majors take the Capstone
Seminar.
ï Research experience, through the Capstone seminar; majors are also encouraged to write a Senior
Thesis.
ï Expertise outside the classroom, including study abroad, excavation experience, summer abroad
programs, and other varieties of hands-on experience, including other experiential learning
opportunities.
7. What will we do in the library?
7
ï Summer 2011: workshops on LOA and shared
learning outcomes for WR20 library instruction.
ï Fall 2011: begin assessing student learning in
WR20 and subject specific instruction.
ï Spring 2012: continue assessing, gather feedback
from librarians
8. What is LOA: learning outcomes assessment?
8
ï Systematic look at what students are learning
ï Moving from âWhat am I going to teach today?â to
âWhat do I want students to learn today?â
9. What LOA is NOT
9
ï NOT evaluation of teaching
ï NOT evaluation of program
10. Assessment loop
Develop student
learning
outcomes
Work with
results Set criteria
Do assessment Devise
assessment
measures
10
11. Levels of assessment
ï Institutional (University wide)
ï Program (e.g. Department)
ï Course
ï Session (e.g. IL instruction)
11
12. LOA in libraries: constraints
12
ï Lack of consistent, reliable access to students
ï IL instruction: is it a âprogramâ?
ï Program assessment vs. session assessment
ï Difficult to isolate effects of library instruction
13. Where will you assess student learning?
13
ï On the instruction session level?
ï In a for-credit library skills course?
ï Across a series of library instruction sessions?
ï Broadly across the student population?
14. Some simple approaches
14
Develop learning outcomes for your instruction program, and look at
where they are taught â âsnapshotsâ
Focus on large programmatic efforts e.g. first year writing
Highlight specific academic departments
Assess individual library instruction sessions â develop shared
learning outcomes, compare/contrast
15. What is a learning outcome?
A learning outcome is one sentence that
indicates what students should represent,
demonstrate or produce as a result of what
they learn.
- source: Peggy Maki
15
16. Good learning outcomes:
ï Focus on what students will learn/know/be
able to do
ï Describe actions or behaviors
ï Are results oriented
ï Are observable and measurable
ï Include a time frame
16
17. ACRL Standards
ï 3 levels: standards, performance
indicators, outcomes
ï Can be used for LOA
ï Examples: (1)Identifies keywords, synonyms and related
terms for the information needed. (2) Selects an appropriate
documentation style and uses it consistently to cite sources
17
18. Writing outcomes
18
Today, weâll write learning outcomes for a
library instruction session.
19. Exercise: What do you cover?
Think of an information literacy instruction
session that you teach on a regular basis.
List what you would cover in that session.
19
20. Bloomâs Taxonomy
ï Classification of educational objectives
ï Published in 1956, revised in 2001 (changes: noun to
verb, synthesis/creating becomes highest level)
ï Taxonomy = classification
ï Cognitive levels (lower ï higher)
ï Provides way to express outcomes
20
23. Verbs to avoid
23
Understand Become familiar with
Appreciate Learn about
Know about Become aware of
24. Learning outcomes formula
ï 1. Time frame
ï 2. Student focus
ï 3. Action verb
ï 4. Product/process/outcome
24
25. Using the formula
ï Time frame: âAt the end of the library
sessionâŠâ
ï Student focus: ââŠstudents will be able toâŠâ
ï Action verb: ââŠidentifyâŠâ
ï Product/process: ââŠa relevant database for
their term paper research.â
25
26. Another example:
ï Time frame: âAfter completing the online
tutorialâŠâ
ï Student focus: ââŠstudents will be able toâŠâ
ï Action verb: ââŠdifferentiate betweenâŠâ
ï Product/process: ââŠscholarly journals and
popular magazines.â
26
27. One more example:
ï Time frame: âBy the time they complete their
undergraduate programâŠâ
ï Student focus: ââŠstudents will be able toâŠâ
ï Action verb: ââŠconstructâŠâ
ï Product/process: ââŠa research question that
can be investigated using primary archival
resources.â
27
28. Examples: bad and better
Bad: Students will understand how to use social science
databases.
Better: Students will perform a search in Sociological Abstracts
that retrieves relevant items.
Bad: Students will be able to search the catalog.
Better: Students will use the catalog to identify a book on their
topic.
Bad: Students will appreciate the importance of correct citation.
Better: Students will produce citations in correct APA format.
28
29. Now, write your own!
Choose two items from the list of what you cover in
an information literacy session.
Transform them into learning outcomes, using the
formula.
Find a partner and critique your outcomes using the
following checklist.
29
30. Checklist for learning outcomes
ï Includes a time frame?
ï Focuses on students?
ï Uses action verbs?
ï Names a product or process?
ï Is measurable/observable?
ï Prompts a measure/method?
ï Will be useful for you to assess?
30
33. Assessment methods
ï Knowledge test
ï One Minute paper & variations
ï Bibliography analysis
ï Concept Inventory
ï Standardized test
33
34. Knowledge tests
34
ï Tests knowledge and/or skills before and/or after
library instruction session.
ï Can be given at end of library session or later in
semester.
ï Can use clickers to gather data during library
session.
Sample questions:
1. What is the difference between a library catalog
and a database?
2. The Boolean operator âorâ narrows a search
statement (true/false).
35. One minute paper & variations
35
Sample questions:
1. What is the most important thing about library research
you learned today?
2. 3-2-1 (three things you learned, two things youâre still
confused about, one thing youâd change about session)
3. What is one question you still have?
4. In your research, what will you do differently after
todayâs session?
36. Bibliography analysis
36
ï Look for citations from scholarly/peer reviewed
journals
ï Look for citations for books and journals owned by
your library
ï Look for articles retrieved from your databases.
37. Concept inventory
37
Make a checklist of 3-12 important concepts students need
to master.
Ask students to explain each concept in a sentence or two.
If a concept is unfamiliar, they should leave blank.
Count good responses for each concept, then plan future
instruction.
38. Standardized tests
38
ï I-Skills
ï ILAT (James Madison University)
ï SAILS
39. Using assessment information
ï Rewrite learning outcomes
ï Change what you do/how you teach
ï Work collaboratively with colleagues
(librarians and faculty)
ï Revise assessment measures
ï Share the news in the library and on campus
39
40. Learning outcomes are:
ï Fundamental components of a learning
assessment program
ï Focused on student learning
ï Indicate what students will know/be able to do
ï Measurable, observable, overt
40
42. LOA resources
ï Angelo, Thomas (1993). Classroom assessment techniques.
ï Maki, Peggy (2004). Assessing for learning : building a
sustainable commitment across the institution.
ï Middle States Commission on Higher Education(2003).
Developing research & communication skills: guidelines for
information literacy in the curriculum
http://msche.org/publications/devskill050208135642.pdf
ï Neely, Teresa Y(2006). Information literacy assessment :
standards-based tools and assignments.
ï Radcliff, Carolyn et.al (2007). A practical guide to information
literacy assessment for academic librarians.
ï Student Learning Outcomes Assessment (University of
Virginia)http://www.web.virginia.edu/iaas/assessment/outcom
es.htm
42