4. 1. Usability
● Usability research:
social science meets
technology meets
design meets
people
4 30 november 2010
5. 2. National health and care portal
Assignment of NL Ministry of Health 2004 – 2012
Objectives
- to help people with questions and choices in health and health
care
- to disseminate information on quality
- to encourage choice behaviour
> Annual budget: circa 3M euro, 12 fte
5 30 november 2010
7. 2. National health and care portal
Unique visitors per month
600.000
500.000
2006
400.000
2007
300.000 2008
200.000 2009
2010
100.000
0
jan feb mrt apr mei jun jul aug sep okt nov dec
7 30 november 2010
8. 2. National health and care portal
● How about the usability for chronic patients and their carers?
● Should it be improved?
8 30 november 2010
9. 3. Research
Cooperation between RIVM and IBR-Center for eHealth Research
and Disease management (University of Twente)
Objectives:
1. Formulate recommendations for usability improvement portal
1. Contribute to usability research
9 30 november 2010
10. 3. Research
● Participants (n = 21)
mean age 54y mean age 36y
mean age 36y
mean age 54y
● Education (medium-high)
8 mean age 50y
mean age 50y
7
● eHealth literacy (high) 6
5
fe male
4
male
3
2
1
0
Arthritis Asthma Diabetes
mean age 47yrs
mean age 47yrs
SD = 15,5
SD = 15,5
10 30 november 2010
11. 3. Research
● Methods
1. Scenario study
› Think-aloud protocol
› Cognitive walk throughs
› Screen capture software
2. Website Evaluation Questionnaire
3. Focus group
11 30 november 2010
12. 3. Research
● Outcomes
Scenario
- Basic search strategy is ORIENTEERING (65%) vs TELEPORTING (16%)
- Partial and/or unsuccessful scenarios are common
Topic % of ss who % successful
- Age & Education correspond finished a scenario completion
with performance Medical 81% 60%
information
Care 100% 71%
providers
Health 71% 33%
insurances
13. 3. Research
● Outcomes
- Recorded verbal expressions -
Think-aloud usability category scenarios interviews
Lay out
Interviews Navigation 81%; 43%+ 33%; 51%+
Content 18%; 34%+ 47%; 74%+
Acceptance
Satisfaction
Empowerment
All 41%+ 61% +
13 30 november 2010
14. 3. Research
● Outcomes
Focusgroup
Disagreement and consenus with regard to
Lay out presentation of search results; font
size; colour
Navigation search options; autocomplete;
readspeaker;
Content comprehensiveness, language
Acceptance dead links, consistency
14 30 november 2010
15. 3. Research
Consensus:
Chronic patients need comprehensive information; expect support
in searching to quickly find information
Improve Findability, Simplicity, Navigation
Lay out, Acceptance, Satisfaction +/-
Content +
(no priority: small changes increase overall usability)
15 30 november 2010
16. 4. Implications
Many front end /
back end adaptations
16 30 november 2010
17. 4. Implications
● For usability research
– Intensive but productive: social science works: qualitative
methods combined with quantitative measurement
– Outcomes comply with other findings
– Applicable to 2.0 interventions (co-creation, co-design)
17 30 november 2010