Developing the web data collection in personal surveys

1. Developing the web data collection in
personal surveys
Kirsti Pohjanpää
Senior Officer for Development
Data Collection
Nordic Statistician Meeting
Bergen 15.–16.8.2013

2. Personal and business surveys are different
 The data of business surveys are collected by web since
2005–06 in Statistics Finland
 There are several differences between business and
personal data collection
 The answering is volunteering
 The time of answering 24/7
 We are planning the mixed mode data collection (CATI +
CAWI)
 We are moving from (telephone) interviewing to web
data collection (self answering)
15 August 2013 A 2Kristi Pohjanpää

3. Development of web data collection in personal surveys
 Set of about ten projects
 From 16 May 2012 to 30 April 2014
 (a) To develop an infrastructure for web data collection for
personal surveys
 (b) To support and co-ordinate the development of web and
mixed mode data collections for personal data collections, and
especially for the Labour Force Survey.
 Several departments of Statistics Finland take part in the work
15 August 2013 3Kristi Pohjanpää

4. As part of Statistics Finland's strategic goal
 An Internet questionnaire will be available as an alternative
data collection tool in all personal data collections by 2017
The project is part of Eurostat's ESSnet project DCSS
 Data Collection for Social Surveys using Multi Modes
 2012–14
 DE, NL, UK, NO, FI
15 August 2013 4Kristi Pohjanpää

5. 15 August 2013 5Kristi Pohjanpää
MAIN
PRO-
JECT
WEB00
Kirsti
Pohjanpää
start
15 May
2012
end
30 April
2014
Web questionnaire for LFS (WEB01)
Marjaana Järvensivu
LFS web pilot (WEB02)
Kirsti Pohjanpää
Vision of the mixed-mode process of LFS (WEB03), Not necessarily a project
Consumer Survey and Finnish Travle Survey,
2nd pilot (WEB04), Tiina Heikkinen
Integration of the web and telephone interview
system (WEB05), not set
Recommendation on
web q. layout (WEB06), not set
Statistics Finland’s data collection pages (WEB07),
Reija Helenius
IT infrastructure A (WEB08),
Pirjo Hyytiäinen
Questions about occupation and industry
on the web (WEB11), Laura Hulkko
2012 2013 2014
Other projects where necessary
S
T
E
E
R
I
N
G
G
R
O
U
P
Jari
Tar-
koma
A Seperate
Steering Group
Steering
Group
Steering Group
IT infrastructure B (WEB10)
IT Dep., not set
A Seperate Steering Group
A Seperate
Steering
Group
Steering Group
Steering Group
Steering Group
Occu+ind.y
(WEB09)
Kati Heikkinen
Steering Group
A Seperate
Steering Group

6. Where are we now?
 Four projects have finished
 Mixed mode pilot of Consumer Survey
 Web questionnaire of LFS
 IT infrastructure, pre project
 Questions about occupation and industry, pre project
 Two projects are still working
 Data collection pages
 Web pilot of LFS
 2 to 4 project will be set 2013
 Two main IT projects!
15 August 2013 A 6Kristi Pohjanpää

7. The Mixed Mode Pilot Study
of Consumer Survey 2012
Tiina Heikkinen, Project Manager
Tara Junes & Pertti Kangassalo
15 August 2013 A 7Kristi Pohjanpää

8. The Mixed Mode Pilot Study of Consumer Survey
 To study mode effect between telephone interview and
web data collection
 Data collection Nov 2012
 Sample size n=2,350
 A random sample of 15 to 84 year-olds
 First web, after that a telephone interview (for non
response)
15 August 2013 8Kristi Pohjanpää
The Mixed Mode Pilot Study
of Consumer Survey

9. Response rate of the pilot
 1,305 responses
 Total response rate 56% (Consumer Survey 61%)
 Web 23.5%
 Telephone 32.1%
 In the web respondents there were …
 little more women (26% vs. 21%)
 more high educated
 only a few 65+ year-olds (65-74: 17%, 75-84: 8%)
15 August 2013 9Kristi Pohjanpää
The Mixed Mode Pilot Study
of Consumer Survey

10. About 42% answered by web
15 August 2013 10Kristi Pohjanpää

11. Confidence Indicator November 2012
15 August 2013 A 11
The Mixed Mode Pilot Study
of Consumer Survey
Kristi Pohjanpää
-5,2
-1,4
-3,4
1,0
-10 -8 -6 -4 -2 0 2 4 6 8 10
Pilot Survey: CAWI
Pilot Survey: CATI
Pilot Survey
Main Data Collection: Cati
=> CAWI is not
recommended
to be used.

12. Statistics Finland’s
data collection pages
Reija Helenius, Project Manager
15 August 2013 A 12Kristi Pohjanpää

13. Statistics Finland’s data collection pages
1. Renew the data collections section of Statistics Finland’s
website to better support household and personal
surveys
2. Improve communications with respondents to achieve a
higher response rate
 In personal surveys the participating is based on
voluntariness, and in web surveys there are no one to
motivate people.
15 August 2013Kristi Pohjanpää A 13
Statistics Finland’s
Data Collection Pages

14. Benchmarking and brainstroming
1. Collected external benchmarking data from other
statistical organisations and survey producers
 Including all the Nordic organisations
2. Held two brainstorming sessions to collect ideas and
feedback from employees
 Three perspectives: Users, appeal, and content
 A total of 36 participants
 Gathered a total of over 500 unique suggestions
 All ideas have been categorised and reviewed
15 August 2013Kristi Pohjanpää A 14
Statistics Finland’s
Data Collection Pages

15. Some other plans for developing
 Calendars of current and future surveys
 Notices of service breaks and changes in surveys
 Content to motivate survey participants
 Login to web questionnaire by bank codes
 Launch in the beginning of 2014
15 August 2013Kristi Pohjanpää A 15
Statistics Finland’s
Data Collection Pages

16. The Web Pilot of LFS 2013
Some plans
15 August 2013 A 16Kristi Pohjanpää

17. The Web Pilot Study of LFS
 To study the mode effect between telephone interview and web
data collection (the pilot data)
 LFS normal data as a comparison data (CATI)
 Sample size n=8,000
 A random sample of 15 to 74 year-olds
 Data collection at October 2013
 There will three split-plot tests in the pilot
15 August 2013 17Kristi Pohjanpää
The Web Pilot Study
of LFS, plans

18. Three split-plot tests, two groups
15 August 2013 18Kristi Pohjanpää
Group A Group B
(1) Number of hours
Total hours, and minutes per
week
Hours, and minutes per day by day
(2) Methods used
to find work
Separate questions (yes / no),
seperate pages
All questions at the same page
(yes / no)
(3) Don't know option In view If needed
Sample n=4,000 n=4,000
The Web Pilot Study
of LFS, plans

19. Experiences of the project work
 Some challenges
 Joining the project work and other work
 IT resources => 2 main IT projects are not yet set
 Eagerness, and energetic work
 A lot of knowledge, and learning
 1.1.2013 Data Collection Unit
 It has been very good idea to lump together all the projects!
 To be sure that all have the same goal
 Timing of work
15 August 2013 A 19Kristi Pohjanpää