Novice and expert use of e-resources: A longitudinal study

Andy Choi
MSc LIM part-time student

*E-learning
*Use of
e-resources …

*

* E-resources – a broad definition
* Electronic files / CD-ROMs
* E-resources – definition in library science book:
* websites with content management system on
the Internet (Yu & Breivold, 2008)
* E-resources – definition in this study:
* library catalogue, e-journals, search engine
* (e.g. ISI Web Of Knowledge, Proquest, Emerald, GoogleScholar)

* Searchable online user interface

*

*How e-learners
search for
information …

*

*E-learners may sometimes failed to
locate required information
accurately
*Novice Expert study:
*novice information searchers could
be trained to become more
experienced information searchers

*

*Novice Expert comparison
*10 years ago and Today
*Focus
*Source selected
*Search terms and search operators
used
*Tactics to generate search terms

*

*Transcription files translated from
recording of information searching sections
*Reuse raw data from previous researches
*Participants:
*Postgraduate research students (Novice)
*Professor in Information science (Expert)
*Novice & Expert search on the same topic
*Similar settings for 10 years ago and today

*

*70 transcription files containing over
350 information searching sections
*728 search statements from 148
searching sections
* 249 from “novice 10-years-ago
* 67 from “expert 10-years-ago”
* 247 from “novice today”
* 165 from “expert today

*

Think-aloud protocol (TAP) recordings of
Information Search -> Transcript files

Extract search statements

Coding: identify search terms, search
operators and tactics

Calculate: Probability, Mean, Variance

Presented in graphs and tables

*

1. Variety of e-resources by novice
and expert groups
2. Novice groups use more varieties
of e-resources on the whole
3. Novice groups are more diverse in
the choice of e-resources

*

Expert Novice

today 10 years ago today 10 years ago
0.00% 0.00%

0%
0.61%
0.00%
4.02%
8.10%

HKUTO
ERICDC
13.33%

AltaVista

UKThesis
LibPOLYU
17.91% 0.00%
0.80%
0.00%

10%
4.82%
0.00%
0.61%

Lsoft
0.80%

ASCIA
0.00%
17.81%

Informit
ERICWEB

University
20%
15.15%
2.41%
0.00%

ASFE
1.21%
0.00% 4.02%

InfoSeek
FirstSrch

WebSpirs
0.00%

MDConsult
0.61%
0.00% 6.48% 3.21%

30%
9.70% 1.62% 5.62%
2.43%

Google
ISIWOS
MEDLINE
WorldCat
1.61%

CatchWord
0.00% 19.40%

40%
5.22%
6.67%

DDC
15.38%

MichU
0.00% 6.02%

LibCUHK
0.00%

GoogleBook

WWWVirtEE
50%
9.09% 0.00%
0.81%
0.00%
1.21%
0.00%

Deja

NDLTD
3.64%

YAHOO
3.03%

LibHKALL
GoogleHK
0.00%
0.61% 0.00%
0.81%
60%

0.00%
1.49%
0.00% 26.51%

PQ
LibHKU
15.79%
DialogCarl

19.39%
GoogleSchr
70%

13.43%
PQDT
EBSCO

0.00% 4.05% 0.00%
0.80%
LibHKU2

0.00% 0.80%
0.40%
0.00%
GoogleTW

0.40%
0.40%
0.00% 0.40%
0.80%
80%

0.00%
2.81%
Novice Expert use of e-resources by information source

0.00%
0.40%
10.45%
Emerald
HKULdlc
LibHUSU
PQDTDAO

21.21% 19.84% 11.65%
90%

4.48%
1.49% 0.80%
0.80%
0.00%
1.49%
0.00%
1.49% 3.21%
0.00% 0.00%
100%

Novice Expert

10-years-ago Overall = 26 Overall = 13

Today Overall = 17 Overall = 12

*

Novice Expert

Mean, µ=7.5 Mean, µ=8.1
SD, σ=1.26 SD, σ=2.2
10-years-ago
µ + 2σ (75%)=10.02 µ + 2σ (75%)=12.5
Overall = 26 Overall = 13
Mean, µ=6.25 Mean, µ=5.0
SD, σ=1.79 SD, σ=1.66
Today
µ + 3σ (88%)=11.62 µ + 3σ (88%)=9.98
Overall = 17 Overall = 12

*

1. e-resources grouped by source
type
2. Popular: Journal Article Databases
3. Decrease in use for library
catalogue
4. Advent of Google Scholar

*

Directories

GoogleBooks

OtherSources
GoogleScholar
InternetSearch
GlobalCatalogue

LibraryCatalogue
DissertationDatabase
0%
10%
20%
30%
40%
50%
60%

JournalArticleDatabase
Directories
GlobalCatalogue
GoogleBooks
GoogleScholar

8.84%
0.00%

1.20%
0.00%
0.80%
6.02%
5.22%
InternetSearch

Novice

32.53%
45.38%
LibraryCatalogue
OtherSources
Directories
10 years ago
GlobalCatalogue
GoogleBooks
GoogleScholar

0.00%

4.48%
0.00%
1.49%
5.97%
0.00%
Expert

InternetSearch

19.40%

13.43%
55.22%
LibraryCatalogue
OtherSources
Directories
GlobalCatalogue
GoogleBooks
GoogleScholar
9.72%

0.00%
1.62%
0.00%
9.31%
0.00%

InternetSearch
Novice

15.38%

21.46%
42.51%

LibraryCatalogue
Novice Expert Use of e-resources by source type

OtherSources
today

Directories
GlobalCatalogue
GoogleBooks
GoogleScholar
9.70%

0.00%
0.61%
1.21%
0.00%
Expert

InternetSearch
15.15%

12.12%
39.39%
21.82%

LibraryCatalogue
OtherSources

1. E-resources grouped by source
type
2. Popular: Journal Article Databases
3. Decrease in use for library
catalogue
4. Advent of Google Scholar

*

1. Search Words extracted by
removing all search operators from
search statements.
2. Today: more search words are
used.
3. Expert: more diverse in number of
search words used

*

Number of search words used in search statments
50%

45%

40%

35%

30%

25%

20%

15%

10%

5%

0%
1 2 3 4 5 6 7 8 9 10 11 12 13 15 16 17 20
10 years ago - Novice 4.66% 41.53%30.08%10.17% 7.20% 2.97% 1.69% 0.85% 0.85% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00%
10 years ago - Expert 4.48% 46.27%16.42% 5.97% 5.97% 2.99% 2.99% 2.99% 1.49% 2.99% 5.97% 0.00% 1.49% 0.00% 0.00% 0.00% 0.00%
today - Novice 3.51% 16.67%27.63%28.51%10.09% 3.07% 3.07% 0.00% 3.07% 1.32% 2.19% 0.88% 0.00% 0.00% 0.00% 0.00% 0.00%
today - Expert 5.92% 11.84%17.76%13.82%15.13%10.53% 1.32% 5.26% 2.63% 7.24% 1.97% 1.32% 0.66% 0.66% 1.32% 0.66% 1.97%

Average number of search
words used
6 Expert -
today, 5.52
Novice Expert
5

Novice - Expert - 10
10-
today, 4.00 years ago, 3.91
4
Mean, μ=2.99 Mean, μ=3.91
Novice - 10 years-
years ago, 2.99 SD, σ=1.43 SD, σ=2.99
3 ago

2

Mean, μ=4 Mean, μ=5.52
1
Today
SD, σ=2.15 SD, σ=3.86
0

*

1. System Specific search operators
(“w/”, “n/”, “site:”)
e.g. ProQuest: Hong w/2 University
e.g. Google: “course site:hku.hk”

2. Today: use less
3. Expert: more diverse in number of
system specific search words used

*

Number of system specific search operators used in search statments
100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%
0 1 2 3 4 5 6 7 8 10
10 years ago - Expert 65.67% 11.94% 4.48% 8.96% 1.49% 1.49% 1.49% 2.99% 0.00% 1.49%
10 years ago - Novice 87.15% 5.22% 4.02% 3.21% 0.40% 0.00% 0.00% 0.00% 0.00% 0.00%
today - Expert 55.76% 13.33% 7.88% 7.27% 2.42% 3.64% 3.64% 3.03% 2.42% 0.61%
today - Novice 80.24% 9.27% 8.06% 1.21% 0.40% 0.00% 0.40% 0.40% 0.00% 0.00%

Average number of search
operators used Novice Expert
Expert -
today, 1
1.60 Expert - .47
10 years 10-
1.40 Mean, μ=0.24 Mean, μ=1.06
ago, 1.0 years-
SD, σ=0.71 SD, σ=2.02
1.20
6 ago
1.00

0.80 Novice -Novice -
0.60 10 yearstoday, 0 Mean, µ=0.36 Mean, µ=1.47
ago, 0.2 .36 Today
0.40 SD, σ=0.90 SD, σ=2.28
4
0.20

0.00

*
Total

The Framework (Hembrooke et al. 2005)

1. Elaboration
Details and sophistication intrinsic to user search
attempts

2. Backtracking
searcher reuses prior search terms over successive
trials

3. Topic Terms
searcher incorporate the topic words as their search
terms

*

4. Plural Making or Taking
a user repeatedly incorporates similar nouns into their
search attempt with the slight modification of making
the word plural or singular

5. Broadening
user expands the scope of the search phrase over
successive trials

6. Refining
a subject begins broadly and narrows the search with
increasing specificity

*

7. Kitchen Sink
a searcher incorporates search terms related to the
subject, but not specific to the query task

8. Poke-n-hope
user expands the scope of the search phrase over
successive trials

*

1. Highly used:
Elaboration, Backtracking, Topic
Terms
2. Expert:
Elaboration, Broadening, Refining,
and Kitchen Sink
3. Novice: Backtracking, Plural
making or taking, Poke-n-hope
*

Expert today
Novice today
100%
120%

20%
40%
60%
80%

0%

Expert 10 years ago
Novice 10 years ago
Novice 10 years ago
Expert 10 years ago

EL -
Novice today

78.95%
57.50%
57.14%
30.19%
Expert today

Elaboration
Novice 10 years ago
Expert 10 years ago

g
BT -
Novice today

89.47%
85.00%
61.90%
69.81%
Expert today

Backtrackin
Novice 10 years ago
Expert 10 years ago
Novice today

Terms

94.74%
92.50%
90.48%
96.23%
Expert today

TT - Topic
Novice 10 years ago
Expert 10 years ago
Novice today

2.63%
7.50%
4.76%
1.89%
Taking
Making or
PM - Plural Expert today

Novice 10 years ago
Expert 10 years ago
BR -

Novice today

7.89%
5.00%
9.52%
3.77%
Expert today
Broadening

Novice 10 years ago
Expert 10 years ago
RF -

Novice today
26.32%
15.00%
19.05%
13.21%
Refining

Expert today

Novice 10 years ago
Comparsion of search tactics usage of Novice and Expert researchers

Expert 10 years ago
KS -

Sink

Novice today
9.43%

21.05%
17.50%
23.81%
Kitchen

Expert today

Novice 10 years ago
Expert 10 years ago
Novice today
2.63%
9.52%
27.50%
49.06%
n-hope

Expert today
PH - Poke-

*Novice groups are more diverse in the
choice of e-resources
*Novice may not know how to choose e-
resources
*Novice: less diverse in number of
search words used
*Novice may not be flexible enough to
generate search words

*

*Novice: less system specific search
operators used
*Novice may not be familiar with
particular e-resources
*Novice: Backtracking, Plural making or
taking, Poke-n-hope
*Make them aware of expert skills:
Elaboration, Broadening, Refining, and
Kitchen Sink

*

* Bates, M. E. (2003). Are We Overloaded Yet? [Feature Article]. EContent, 26(2), 17-17.
* Brand-Gruwel, S., Wopereis, I., & Vermetten, Y. (2005). Information problem solving by experts and novices: analysis of a complex cognitive skill. Computers in Human Behavior, 21(3), 487-508. doi:
10.1016/j.chb.2004.10.005
* Chu, S. K. W., & Law, N. (2005). Development of Information Search Expertise: Research Students' Knowledge on Databases. Online information review, 29(6), 621-642.
* Chu, S. K. W., & Law, N. (2007). Development of information search expertise: postgraduate students' knowledge of search skills. portal: Libraries and the Academy, 7(3), 295-316.
* Chu, S. K. W., & Law, N. (2008). Development of information search expertise of research students. Journal of Librarianship and Information Science, 40(3), 165-177. doi: 10.1177/0961000608092552
* Connaway, L. S., & Powell, R. R. (2010). Basic research methods for librarians (5th ed.). Santa Barbara, Calif.: Libraries Unlimited.
* Cothran, T. (2011). Google Scholar acceptance and use among graduate students: A quantitative study. Library & Information Science Research, 33(4), 293-301. doi: 10.1016/j.lisr.2011.02.001
* Cotton, D., & Gresty, K. (2006). Reflecting on the think-aloud method for evaluating e-learning. British Journal of Educational Technology, 37(1), 45-54. doi: 10.1111/j.1467-8535.2005.00521.x
* Halvey, M., & Jose, J. M. (2009). The role of expertise in aiding video search. Paper presented at the Proceedings of the ACM International Conference on Image and Video Retrieval, Santorini, Fira, Greece.
* Hearst, M. (2009). Search user interfaces. New York: Cambridge University Press.
* Hembrooke, H. A., Granka, L. A., Gay, G. K., & Liddy, E. D. (2005). The effects of expertise and feedback on search term selection and subsequent learning. Journal Of The American Society For Information
Science And Technology, 56(8), 861-871. doi: 10.1002/asi.20180
* Hölscher, C., & Strube, G. (2000). Web search behavior of Internet experts and newbies. Computer Networks, 33(1–6), 337-346. doi: 10.1016/s1389-1286(00)00031-1
* Kang, R., & Fu, W.-T. (2010). Exploratory information search by domain experts and novices. Paper presented at the Proceedings of the 15th international conference on Intelligent user interfaces, Hong
Kong, China.
* Kim, Y.-M. (2011). Users' perceptions of university library websites: A unifying view. Library & Information Science Research, 33(1), 63-72. doi: 10.1016/j.lisr.2010.04.007
* Lazonder, A. W., Biemans, H. J. A., & Wopereis, I. G. J. H. (2000). Differences between novice and experienced users in searching information on the World Wide Web. Journal of the American Society for
Information Science, 51(6), 576-581. doi: 10.1002/(sici)1097-4571(2000)51:6<576::aid-asi9>3.0.co;2-7
* Legris, P., Ingham, J., & Collerette, P. (2003). Why do people use information technology? A critical review of the technology acceptance model. Information & Management, 40(3), 191-204. doi:
10.1016/s0378-7206(01)00143-4
* Li-Chen, T., Hwang, S.-L., & Kuo-Hao, T. (2011). Analysis of keyword-based tagging behaviors of experts and novices. Online information review, 35(2), 272-290. doi: 10.1108/14684521111128041
* Liu, Z. (2006). Print vs. electronic resources: A study of user perceptions, preferences, and use. Information Processing & Management, 42(2), 583-592. doi: 10.1016/j.ipm.2004.12.002
* Marchionini, G. (1995). Information seeking in electronic environments. Cambridge: Cambridge University Press.
* Saeed Rezaei, S. (2006). How digital libraries can support e-learning. [DOI: 10.1108/02640470610671231]. Electronic Library, The, 24(3), 389-401.
* Safford, B. R. (2006). How to Help Students Handle the Information Overload. [Feature Article]. School Library Monthly, 23(2), 33-34.
* Tabatabai, D., & Shore, B. M. (2005). How experts and novices search the Web. Library & Information Science Research, 27(2), 222-248. doi: 10.1016/j.lisr.2005.01.005
* Tran, D. T. (2011). Process-oriented semantic web search. Heidelberg, Germany Amsterdam: AKA IOS Press.
* White, R. W., Dumais, S. T., & Teevan, J. (2009). Characterizing the influence of domain expertise on web search behavior. Paper presented at the Proceedings of the Second ACM International Conference on
Web Search and Data Mining, Barcelona, Spain.
* Yu, H., & Breivold, S. (2008). Electronic resource management in libraries : research and practice. Hershey, PA: Information Science Reference.

*

Novice and expert use of e-resources: A longitudinal study

Novice and expert use of e-resources: A longitudinal study

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Andere mochten auch

Andere mochten auch (10)

Ähnlich wie Novice and expert use of e-resources: A longitudinal study

Ähnlich wie Novice and expert use of e-resources: A longitudinal study (20)

Mehr von CITE

Mehr von CITE (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

Novice and expert use of e-resources: A longitudinal study