At ICTD2013 the Exploring the Emerging Impacts of Open Data in Developing Countries (ODDC) network discussed different methods for open data research. This presentation provides an overview of the Open Data Barometer methodology.

1. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The Open Data Barometer
• Building on the 2012 Web Index
• Based on primary expert survey data & secondary
indicator data
• A pilot methodology to provide a macro-level
picture of open data policy and practice
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

2. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The process...
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

3. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The process...
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

4. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The process...
Literature review
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

5. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The process...
Literature review
Idea storm
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

6. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The process...
Literature review
Idea storm
Review of
qualitative cases
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

7. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The process...
Literature review
Idea storm
Review of
qualitative cases
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

8. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The process...
Literature review
Context &
impact themes
Idea storm
Review of
qualitative cases
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

9. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The process...
Literature review
Context &
impact themes
Idea storm
Supply side
questions
Review of
qualitative cases
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

10. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The process...
Literature review
Context &
impact themes
Secondary data
shortlist
Idea storm
Supply side
questions
Review of
qualitative cases
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

11. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The process...
Literature review
Context &
impact themes
Secondary data
shortlist
Supply side
questions
Expert survey
Idea storm
Review of
qualitative cases
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

12. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The process...
Expert survey
Recruit
researchers
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

13. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The process...
Expert survey
Recruit
researchers
Research
handbook
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

14. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The process...
Expert survey
Recruit
researchers
Research
handbook
Online
training
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

15. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The process...
Expert survey
Recruit
researchers
Research
handbook
Online
training
Initial
research
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

16. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The process...
Expert survey
Recruit
researchers
Research
handbook
Online
training
Initial
research
Spot
check
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

17. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The process...
Expert survey
Recruit
researchers
Online
training
Initial
research
Clarifications
Research
handbook
Spot
check
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

18. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The process...
Expert survey
Recruit
researchers
Research
handbook
Double-blind
peer-review
Online
training
Initial
research
Clarifications
Spot
check
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

19. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The process...
Expert survey
Recruit
researchers
Research
handbook
Further
clarification
Double-blind
peer-review
Online
training
Initial
research
Clarifications
Spot
check
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

20. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The process...
Expert survey
Recruit
researchers
Research
handbook
Further
clarification
Double-blind
peer-review
Online
training
Initial
research
Clarifications
Spot
check
Technical
review
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

21. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The process...
Expert survey
Recruit
researchers
Research
handbook
Further
clarification
Double-blind
peer-review
Technical
review
Online
training
Initial
research
Clarifications
Spot
check
Cross-checking
& calibration
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

22. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The process...
Expert survey
Recruit
researchers
Research
handbook
Online
training
Initial
research
Further
clarification
Double-blind
peer-review
Clarifications
Spot
check
Technical
review
Cross-checking
& calibration
Export data
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

23. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
Question structure...
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

24. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
Question structure...
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

25. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
Dataset assessment...
Ten point checklist
a - Does the data exist?
b - Is it available online from government in any form?
c - Is the dataset provided in machine-readable formats?
d - Is the machine-readable data available in bulk?
e - Is the dataset available free of charge?
f - Is the data openly licensed?
g - Is the dataset up to date?
h - Is the publication of the dataset sustainable?
i - Was it easy to find information about this dataset?
j - Are (linked) data URIs provided for key elements of the data?
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

26. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
Dataset assessment...
Ten point checklist
a - Does the data exist?
b - Is it available online from government in any form?
c - Is the dataset provided in machine-readable formats?
d - Is the machine-readable data available in bulk?
e - Is the dataset available free of charge?
f - Is the data openly licensed?
g - Is the dataset up to date?
h - Is the publication of the dataset sustainable?
i - Was it easy to find information about this dataset?
j - Are (linked) data URIs provided for key elements of the data?
Detailed justification data
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

27. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
Dataset assessment...
Ten point checklist
Category definitions and guidance
a - Does the data exist?
b - Is it available online from government in any form?
c - Is the dataset provided in machine-readable formats?
d - Is the machine-readable data available in bulk?
e - Is the dataset available free of charge?
f - Is the data openly licensed?
g - Is the dataset up to date?
h - Is the publication of the dataset sustainable?
i - Was it easy to find information about this dataset?
j - Are (linked) data URIs provided for key elements of the data?
Detailed justification data
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

28. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
Datasets assessed...
D1: Map data (full map coverage of the country)
D2: Land ownership data
(D3: Government service directory)
D4: Detailed census data
D5: Detailed government budget
D6: Detailed data on government spend
D7: Company register
D8: Legislation
D9: Public transport timetables
D10: International trade data
D11: Health sector performance
D12: Primary or secondary education performance data
D13: Crime statistics
D14: National environment statistics
D15: National election results
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

29. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
Tools...
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

30. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
Tools...
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

31. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
Analysis...
Z-score normalization
Creation of sub-components
(unweighted mean)
Creation of sub-indices
(unweighted mean)
Creating of overall ranking
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

32. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The result...
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

33. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The result...
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

34. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The result...
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

35. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The result...
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

36. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The result...
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

37. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
Results...
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

38. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
Results...
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

39. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
Next steps...
• Improving questions, definitions and datasets
selected;
• Iterative development of the data collection
methodology;
• Checking relevance of created data for policy
influence, and supporting in-depth local research;
www.opendatabarometer.org | @timdavies
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

40. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
Questions?
www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

41. Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).