Standards for statistical data dissemination: a wish list

1. Standards for statistical data dissemination a wish list Xavier Badosa (@badosa) Statistical Institute of Catalonia OECD Statistical Information System Collaboration Community (SIS-CC) Workshop 2012. Paris, 12-14 March

2. For humans

3. For humans (naked)

4. For humans (naked)(accessed and read by humans)

5. For humans (naked)(accessed and read humans)

6. For humans with machines(accessed by humans,but read by machines) For humans (naked) (accessed and read humans)

7. For machines

8. For machines built by humans

9. For machines built by humans(accessed and read by machines)

10. API D A T A

11. General-purpose“Apps”Third-party“Apps”that solve specific needsStatistics as platform “O.S.”

12. How I stopped worrying about mywebsite and learned to love the wholeInternet Matt McAlister Director of Digital Strategy Guardian Media Group

13. We don’t operate in theeyeball market maximum data exposure & reachWe operate in the accuracy preservationreferencemarket brand recognition

14. E A BCHA Big orgsNG Stats-savvyE B2B

15. E A BCHA Big orgsNG Stats-savvyE B2B Shared environment

16. D I SS EM I N A T IO N

18. like the ? WWW

19. For machines built by humans

20. don’t make me think KISS principlerespect the conventions develop also for the weakest link

21. is a platform An example

22. is widely used An example

23. 2006 is widely used2009 50,000 applications

24. is widely used# mashups

25. is widely usedhad more than1 provider

26. is widely used= is a standard

27. “these APIs are simple enough for weekendhackers to build interesting projects on, and(…) easy to implement even on mobile devicesand in almost any programming language.” Anil Dash Expert Labshttp://dashes.com/anil/2009/12/the-twitter-api-is-finished.html

28. KISS principle“these APIs are simple enough for weekendhackers to build interesting projects on, and(…) easy to implement even on mobile devicesand in almost any programming language.” Anil Dash Expert Labshttp://dashes.com/anil/2009/12/the-twitter-api-is-finished.html

29. develop for the weakest link“these APIs are simple enough for weekendhackers to build interesting projects on, and(…) easy to implement even on mobile devicesand in almost any programming language.” Anil Dash Expert Labshttp://dashes.com/anil/2009/12/the-twitter-api-is-finished.html

30. provide a useful service“these APIs are simple enough for weekendhackers to build interesting projects on, and(…) easy to implement even on mobile devicesand in almost any programming language.” Anil Dash Expert Labshttp://dashes.com/anil/2009/12/the-twitter-api-is-finished.html

31. get close to the end users“these APIs are simple enough for weekendhackers to build interesting projects on, and(…) easy to implement even on mobile devicesand in almost any programming language.” Anil Dash Expert Labshttp://dashes.com/anil/2009/12/the-twitter-api-is-finished.html

32. langs / APIs ~ browsers / websites“these APIs are simple enough for weekendhackers to build interesting projects on, and(…) easy to implement even on mobile devicesand in almost any programming language.” Anil Dash Expert Labshttp://dashes.com/anil/2009/12/the-twitter-api-is-finished.html

33. “these APIs are simple enough for weekendhackers to build interesting projects on, and(…) easy to implement even on mobile devicesand in almost any programming language.”

34. 2 APIsREST API 100 x 1.5 = 150 pp.Streaming API 6 x 3 = 18 pp. < 200 pp.

35. 208 pp. < 200 pp.books.google.com

36. The Fifteen Minute Rule A person of reasonable ability should be able toget from zero to ‘Hello World’ in fifteen minutes. Michael E. Driscoll Dataspore, Metamarkets

37. http://lcsd05.cs.tamu.edu/slides/keynote.pdf

38. 18 pp.1 PDF18 pp.

39. 18 pp. 1 PDF143 pp.

40. 161 pp. 1 PDF143 pp.

41. 161 pp.ZIP 8 MSW

42. 1,109 pp.ZIP 8 MSW 46 pp. 341 pp. 269 pp. 68 pp. 176 pp. 34 pp. 4 pp. 10 pp.

43. 1,109 pp.Samples

44. 1,278 pp.ZIP 1 PDF 169 pp.

45. 1,327 pp. PDF 49 pp.

46. 1,377 pp. PDF 50 pp.

47. 1,408 pp. PDF 31 pp.

48. 1,408 pp. 1,344 pp.books.google.com

49. high barrier to entry APIdevelopers

50. ECHAN SDMXGE Shared environment

51. ECHAN SDMXG amazingly flexibleE Shared environment

52. ECHAN SDMXG amazingly complexE Shared environment

53. ECHAN SDMXG amazingly complexESDMX-ML is a meta-language

54. D I S TypePad WordPressS EM I N A T I existing Twitter clientsO N

55. The Metcalfe-Bray Law D The value of a I markup language is proportional S TypePad WordPress approximatelyS to the square E of theM number of I different N software implementations A that can process T it. I Tim Bray existing Twitter clientsO Google N

56. The Metcalfe-Bray Law D The value of a I markup language is proportional S Stats provider Stats provider approximatelyS to the square E of theM number of I different N software implementations A that can process T it. I Tim Bray existing clientsO Google N

57. D I Are we S Stats provider Stats provider so specialS that E weM can’t I benefit N from A existing T libraries I and clients? existing clientsO N

58. Are we so special that we Special things can’t benefit from existing libraries and clients?Common things

59. Population Search API

60. Population Search API Atom

61. Population Search API Atom OpenSearch

62. Population Search APIAtom OpenSearch SDMX

65. Rectifications API

66. Rectifications API Atom OpenSearch

72. AtomOpenSearchhttp://www.opensearch.orgOpen Data Protocolhttp://www.odata.orgGoogle Data Protocolhttp://code.google.com/apis/gdata/Open Publication Distribution Systemhttp://opds-spec.org

73. Are we so special that we Special things can’t benefit from existing libraries and clients?Common things

74. Are we so special SDMX? that we Special things can’t benefit from existing libraries and clients?Common things

75. Are we so special SDMX? that we Special things can’t benefit from Simplified SDMX? existing libraries and clients?Common things

76. A Complex System That Works Is InvariablyFound To Have Evolved From A Simple System That Worked. “Gall’s Law” Systemantics How Systems Work and Especially How They Fail John Gall

77. The parallel proposition also appears to be true: A Complex System Designed From Scratch Never Works And Cannot Be Made To Work. You Have To Start Over, Beginning With A Working Simple System. “Gall’s Law” Systemantics How Systems Work and Especially How They Fail John Gall

78. What’s common practice in the API space?

79. Open APIs and the Semantic Web (John Musser, ProgrammableWeb)http://www.slideshare.net/jmusser/j-musser-semtechjun2011

80. “REST” RESTish Pragmatic REST REST-inspiredOpen APIs and the Semantic Web (John Musser, ProgrammableWeb)http://www.slideshare.net/jmusser/j-musser-semtechjun2011

84. <KeyFamilyRef>ALFS_SUMTAB</KeyFamilyRef> <Series> <SeriesKey> <Value concept="LOCATION" value="AUS" /> <Value concept="SUBJECT" value="YGTT01L1_ST" /> <Value concept="FREQUENCY" value="A" /> </SeriesKey> <Attributes> <Value concept="TIME_FORMAT" value="P1Y" /> </Attributes> <Obs> <Time>2000</Time> <ObsValue value="19153" /> </Obs> <Obs> <Time>2001</Time> <ObsValue value="19413" /> </Obs> <Obs> <Time>2002</Time>SDMX-ML <ObsValue value="19651" /> </Obs> <Obs> <Time>2003</Time> <ObsValue value="19895" /> </Obs> <Obs> <Time>2004</Time> <ObsValue value="20127" />fragment </Obs> <Obs> <Time>2005</Time> <ObsValue value="20395" /> </Obs> <Obs> <Time>2006</Time> <ObsValue value="20698" /> </Obs> <Obs> <Time>2007</Time> <ObsValue value="21072" /> </Obs> <Obs> <Time>2008</Time> <ObsValue value="21499" /> </Obs> <Obs> <Time>2009</Time> <ObsValue value="21955" /> </Obs> <Obs> <Time>2010</Time> <ObsValue value="22342" /> </Obs> </Series>

85. <KeyFamilyRef>ALFS_SUMTAB</KeyFamilyRef><KeyFamilyRef>ALFS_SUMTAB</KeyFamilyRef> <Series> <SeriesKey><Series> <Value concept="LOCATION" value="AUS" /> <SeriesKey> <Value concept="SUBJECT" value="YGTT01L1_ST" /> <Value concept="FREQUENCY" value="A" /> <Value concept="LOCATION" value="AUS" /> </SeriesKey> <Attributes> <Value concept="SUBJECT" value="YGTT01L1_ST" /> <Value concept="TIME_FORMAT" value="P1Y" /> </Attributes> <Value concept="FREQUENCY" value="A" /> <Obs> </SeriesKey> <Time>2000</Time> <ObsValue value="19153" /> <Attributes> </Obs> <Obs> <Value concept="TIME_FORMAT" value="P1Y" /> <Time>2001</Time> <ObsValue value="19413" /> </Attributes> </Obs> <Obs> <Obs> <Time>2002</Time> <Time>2000</Time> <ObsValue value="19651" /> </Obs> <ObsValue value="19153" /> <Obs> <Time>2003</Time> </Obs> <ObsValue value="19895" /> <Obs> </Obs> <Obs> <Time>2001</Time> <Time>2004</Time> <ObsValue value="20127" /> <ObsValue value="19413" /> </Obs> <Obs> </Obs> <Time>2005</Time> <Obs> <ObsValue value="20395" /> </Obs> <Time>2002</Time> <Obs> <Time>2006</Time> <ObsValue value="19651" /> <ObsValue value="20698" /> </Obs> </Obs> <Obs> <Obs> <Time>2007</Time> <ObsValue value="21072" /> <Time>2003</Time> </Obs> <Obs> <ObsValue value="19895" /> <Time>2008</Time> <ObsValue value="21499" /> </Obs> </Obs> <Obs> <Obs> <Time>2009</Time> <Time>2004</Time> <ObsValue value="21955" /> </Obs> <ObsValue value="20127" /> <Obs> <Time>2010</Time> </Obs> <ObsValue value="22342" /> <Obs> </Obs> </Series> <Time>2005</Time>

86. <KeyFamilyRef>ALFS_SUMTAB</KeyFamilyRef> "KeyFamilyRef" : "ALFS_SUMTAB" ,<Series> "Series" : { <SeriesKey> "SeriesKey" : { <Value concept="LOCATION" value="AUS" /> "location" : "AUS" , <Value concept="SUBJECT" value="YGTT01L1_ST" /> "subject" : "YGTT01L1_ST" , <Value concept="FREQUENCY" value="A" /> "frequency" : "A" </SeriesKey> }, <Attributes> "Attributes" : { <Value concept="TIME_FORMAT" value="P1Y" /> "time_format" : "P1Y" </Attributes> }, <Obs> "Obs" : [ <Time>2000</Time> {"2000" : 19153}, <ObsValue value="19153" /> {"2001" : 19413}, </Obs> {"2002" : 19651}, <Obs> {"2003" : 19895}, <Time>2001</Time> {"2004" : 20127}, <ObsValue value="19413" /> {"2005" : 20395}, </Obs> {"2006" : 20698}, <Obs> {"2007" : 21072}, <Time>2002</Time> {"2008" : 21499}, <ObsValue value="19651" /> {"2009" : 21955}, </Obs> {"2010" : 22342} <Obs> ] <Time>2003</Time> <ObsValue value="19895" /> </Obs> <Obs> <Time>2004</Time> <ObsValue value="20127" /> </Obs> <Obs> <Time>2005</Time>

87. "KeyFamilyRef" : "ALFS_SUMTAB" ,"Series" : { "SeriesKey" : { "location" : "AUS" , "subject" : "YGTT01L1_ST" , "frequency" : "A" }, "Attributes" : { "time_format" : "P1Y" }, "Obs" : [ {"2000" : 19153}, {"2001" : 19413}, {"2002" : 19651}, {"2003" : 19895}, {"2004" : 20127}, {"2005" : 20395}, {"2006" : 20698}, {"2007" : 21072}, {"2008" : 21499}, {"2009" : 21955}, {"2010" : 22342} ]

88. "KeyFamilyRef" : "ALFS_SUMTAB" ,"Series" : { "SeriesKey" : { "location" : "AUS" , "subject" : "YGTT01L1_ST" , "frequency" : "A" }, "Attributes" : { "time_format" : "P1Y" }, "Obs" : { "2000" : 19153, "2001" : 19413, "2002" : 19651, "2003" : 19895, "2004" : 20127, "2005" : 20395, "2006" : 20698, "2007" : 21072, "2008" : 21499, "2009" : 21955, "2010" : 22342 }

89. "KeyFamilyRef" : "ALFS_SUMTAB" ,"Series" : { "SeriesKey" : { "location" : "AUS" , "subject" : "YGTT01L1_ST" , "frequency" : "A" }, "Attributes" : { "time_format" : "P1Y" }, "Obs" : { "time": [ "2000","2001","2002","2003", "2004","2005","2006","2007", "2008","2009","2010" ], "value": [ 19153,19413,19651,19895, 20127,20395,20698,21072, 21499,21955,22342 ] }

90. "KeyFamilyRef" : "ALFS_SUMTAB" ,"Series" : { "SeriesKey" : { "location" : "AUS" , "subject" : "YGTT01L1_ST" , "frequency" : "A" }, "Attributes" : { "time_format" : "P1Y" }, "Obs" : { "time": [ "2000","2001","2002","2003", "2004","2005","2006","2007", "2008","2009","2010" ], "value": [ 19153,19413,19651,19895, 20127,20395,20698,21072, 21499,21955,22342 ] }

91. "KeyFamilyRef" : "ALFS_SUMTAB" , "Series" : { "SeriesKey" : { "location" : "AUS" ,Natural to programmers "subject" : "YGTT01L1_ST" , "frequency" : "A" }, "Attributes" : { “time_format" : "P1Y" }, "Obs" : { "time": [ "2000","2001","2002","2003", "2004","2005","2006","2007", "2008","2009","2010" ], "value": [ 19153,19413,19651,19895, 20127,20395,20698,21072, 21499,21955,22342 ] }

92. "KeyFamilyRef" : "ALFS_SUMTAB" ,a “data” format "Series" : { "SeriesKey" : { "location" : "AUS" ,Natural to programmers "subject" : "YGTT01L1_ST" , "frequency" : "A" }, "Attributes" : {string, number, bool, null “time_format" : "P1Y" },array (vector, list, sequence) "Obs" : { "time": [ "2000","2001","2002","2003",object (struct, hash table, "2004","2005","2006","2007",associative array, map, "2008","2009","2010" ],record, keyed list, dictionary) "value": [ 19153,19413,19651,19895, 20127,20395,20698,21072, 21499,21955,22342 ] }

93. "KeyFamilyRef" : "ALFS_SUMTAB" ,a “data” format "Series" : { "SeriesKey" : { "location" : "AUS" ,Natural to programmers "subject" : "YGTT01L1_ST" , "frequency" : "A" }, "Attributes" : { “time_format" : "P1Y"“JSON shines as a }, "Obs" : {programming language- "time": [independent representation "2000","2001","2002","2003", "2004","2005","2006","2007",of typical programming "2008","2009","2010"language data structures.” ], "value": [ James Clark 19153,19413,19651,19895, Technical lead for the W3C XML 20127,20395,20698,21072, activity which developed 21499,21955,22342 XML 1.0 Recommendation ] }

94. "KeyFamilyRef" : "ALFS_SUMTAB" , "Series" : { "SeriesKey" : { "location" : "AUS" ,Natural to programmers "subject" : "YGTT01L1_ST" , "frequency" : "A" }, "Attributes" : {value[0] = 19153 “time_format" : "P1Y"value[1] = 19413 },value[2] = 19651 "Obs" : { "time": [value[3] = 19895 "2000","2001","2002","2003",value[4] = 20127 "2004","2005","2006","2007",value[5] = 20395 "2008","2009","2010" ],value[6] = 20698 "value": [value[7] = 21072 19153,19413,19651,19895,value[8] = 21499 20127,20395,20698,21072, 21499,21955,22342value[9] = 21955 ]value[10] = 22342 }

95. "KeyFamilyRef" : "ALFS_SUMTAB" , "Series" : { "SeriesKey" : { "location" : "AUS" ,Natural to programmers "subject" : "YGTT01L1_ST" , "frequency" : "A" }, "Attributes" : { "time_format" : "P1Y" }, "Obs" : { "time": [ "2000","2001","2002","2003", "2004","2005","2006","2007", "2008","2009","2010" ], "value": [ 19153,19413,19651,19895, 20127,20395,20698,21072, 21499,21955,22342 ] }

96. "KeyFamilyRef" : "ALFS_SUMTAB" , "Series" : { "SeriesKey" : { "location" : "AUS" ,Natural to programmers "subject" : "YGTT01L1_ST" , "frequency" : "A" }, "Attributes" : { "time_format" : "P1Y" }, "Obs" : { "time": [ "2000","2001","2002","2003", "2004","2005","2006","2007", "2008","2009","2010" ], "value": [ 19153,19413,19651,19895, 20127,20395,20698,21072, 21499,21955,22342 ] }

97. From document viewerNatural to programmers to application platform

98. Fragmented device market

99. Fragmented device market

100. Storage Offline GeolocationAudio and Video Canvas Drag and Drop … JS APIs

101. SGML / DTD XML / XSD

102. JSONP callbackJSON with padding

103. CORS

104. http://caniuse.com/#feat=cors

105. Date: Wed, 22 Feb 2012 17:12:52 GMTServer: ApacheExpires: Wed, 22 Feb 2012 18:12:52 GMTAccess-Control-Allow-Origin: *Content-Length: 697Connection: closeContent-Type: application/json;charset=utf-8200 OKhttp://api.idescat.cat/pob/v1/sug.json?q=bar

106. XML SDMX-MLJSON SDMX-JS?

107. XMLJSON

108. XML Xml2Json() JSONOn-the-fly conversion

109. XML Xml2Json() JSONOn-the-fly conversion<text>Hello, World!</text>

110. XML Xml2Json() JSONOn-the-fly conversion<text>Hello, World!</text>"text": "Hello, World!"

111. XML Xml2Json() JSONOn-the-fly conversion<text>Hello, World!</text><text>Goodbye, Life!</text>"text": "Hello, World!"

112. XML Xml2Json() JSONOn-the-fly conversion<text>Hello, World!</text><text>Goodbye, Life!</text>"text": ["Hello, World!", "Goodbye, Life!"]

113. XML Xml2Json() JSONOn-the-fly conversion<text>Hello, World!</text>"text": ["Hello, World!"]

114. XML JSONPredefined map

115. XML JSONPredefined map namespaces? elements/attributes? all strings?

116. “XMLish” JSONPredefined map

117. {"@concept" : "OBS_STATUS", "@value" : "P"}}},{"generic:Time" : "2011-04", "generic:ObsValue" : “XMLish”{"@value" : "106.56246"}, "generic:Attributes" :{"generic:Value" : {"@concept" : "OBS_STATUS","@value" : "P"}}}, {"generic:Time" : "2011-05", JSON"generic:ObsValue" : {"@value" : "113.26596"},"generic:Attributes" : {"generic:Value" :{"@concept" : "OBS_STATUS", "@value" : "P"}}},{"generic:Time" : "2011-06", "generic:ObsValue" :{"@value" : "114.22037"}, "generic:Attributes" :{"generic:Value" : {"@concept" : "OBS_STATUS","@value" : "P"}}}, {"generic:Time" : "2011-07","generic:ObsValue" : {"@value" : "108.77534"},"generic:Attributes" : {"generic:Value" :{"@concept" : "OBS_STATUS", "@value" : "P"}}},{"generic:Time" : "2011-08", "generic:ObsValue" :{"@value" : "116.37424"}, "generic:Attributes" :

118. natural-bornJSON

119. natural-born JSON“JSON-G” genuine

120. natural-born JSON“JSON-G”“JSON-C”compact/customized

121. Price of an apple?Save as many bytesas possible

122. Price of an apple?Nutrition valueAllergiesRecipesPriceForbidden fruit inthe Garden of Eden

123. FlexibilityNutrition valueAllergiesRecipesPriceForbidden fruit inthe Garden of Eden

124. detail=fulldetail=dataonlydetail=serieskeysonlydetail=nodata

125. ResponseGroup=Images,Reviews

126. fields=id,name,picture

127. fields=title,teaserbyline,none

128. :(id,first-name,last-name,positions:(title))

129. fields=id,scope/type

130. fields=entry(id,gd:when)

131. fields=entry(@gd:*,id,gd:when)

132. fields=entry(title,link[@rel=self or @rel=edit],media:group(media:thumbnail))

133. fields=entry[media:group/yt:duration/@seconds<= 120 and yt:statistics/@viewCount > 20]

134. simple flexible RESTish JSONlightweightdeveloper-centric mobile-friendly

135. simple flexible RESTish JSONlightweight Semantic Web-ish?developer-centric mobile-friendly

136. I have a dream for the Web [in which computers] becomecapable of analyzing all the data on the Web – the content,links, and transactions between people and computers. A‘Semantic Web’, which should make this possible, has yet toemerge, but when it does, the day-to-day mechanisms oftrade, bureaucracy and our daily lives will be handled bymachines talking to machines. The ‘intelligent agents’ peoplehave touted for ages will finally materialize. Tim Berners-Lee Director of the W3C, 1999

137. Statistical “Cube” Data. The group will produce avocabulary, compatible with SDMX, for expressingsome kinds of statistical data. This need not be asexpressive as all of SDMX, but may provide a subsetas in the RDF Data Cube vocabulary. It may also include ways toannotate data to indicate its assumptions and comparability.

138. The MainstreamRelevance “Law”The mainstreamrelevance of acommunicationenvironment isproportional tothe quantity ofrubbish in thatenvironment.

139. The MainstreamRelevance “Law”The mainstreamrelevance of acommunicationenvironment isproportional tothe quantity ofrubbish in thatenvironment.

140. The MainstreamRelevance “Law” TV e-mail Twitter ...

141. simple? flexible RESTish JSON?lightweight? Semantic Web-ish?developer-centric? mobile-friendly?

144. For some web developers the need to understandthe RDF data model and associated serializations andquery language (SPARQL) has proved a barrier toadoption of linked data. This project seeks to developAPIs, data formats and supporting tools to overcomethis barrier. Including, but not limited to, accessinglinked data via a developer-friendly JSON format.

145. Simplify + JSONify SDMX?Reuse/adapt a generic data format? semantic

146. Simplify + JSONify SDMX?Reuse/adapt a generic data format? semanticCreate a new simple standard for stats?

147. http://json-stat.org

148. http://json-stat.orglightweight

149. http://json-stat.orgsimple

150. http://json-stat.orgdeveloper-centric

151. http://json-stat.orgflexible

152. http://code.google.com/p/json-stat/

153. { "label": "Latest population figure of Catalonia", "value": [7539618] , "dimension" : { "id" : ["metric", "time", "geo"], "size" : [1,1,1], "metric": {// "label" : "What" , "desc" : "Longer text", "category" : { "index" : { "pop" : 0 } , "label" : { "U" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } } } , "time" : {// "value": [7539618] "label" : "When" , "desc" : "Longer text", "category" : { "index": {"2011-01-01":0} , "label": {"2011-01-01":"January 1st, 2011"} } } , "geo" : {// "label" : "Where" , "desc" : "Longer text", "category" : { "index" : { "B" : 0 } , "label" : { "B" : "Catalonia" } } } }}

154. { "label": "Latest population figure of Catalonia", "value": [7539618] , "dimension" : { "id" : ["metric", "time", "geo"], "size" : [1, 1, 1], "metric": {// "label" : "What" , "desc" : "Longer text", "category" : { "index" : { "pop" : 0 } , "label" : { "pop" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } }"id"} , : ["metric", "time", "geo"], "time" : {"size" : [1, 1, 1],// "label" : "When" , "desc" : "Longer text", "category" : { "index": {"2011-01-01":0} , "label": {"2011-01-01":"January 1st, 2011"} } } , "geo" : {// "label" : "Where" , "desc" : "Longer text", "category" : { "index" : { "B" : 0 } , "label" : { "B" : "Catalonia" } } } }}

155. { "label": "Latest population figure of Catalonia", "value": [7539618] , "dimension" : { "id" : ["metric", "time", "geo"], "size" : [1, 1, 1], "metric": {// "label" : "What" , "desc" : "Longer text", "category" : { "index" : { "pop" : 0 } , "label" : { "pop" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } } } , "time" : {// "label" : "When" , "desc" : "Longer text", "index" : { "pop" : 0 } , "category" : { "index": {"2011-01-01":0} , "label": {"2011-01-01":"January 1st, 2011"} "label" : { "pop" : "Population" } } } , "geo" : {// "label" : "Where" , "desc" : "Longer text", "category" : { "index" : { "B" : 0 } , "label" : { "B" : "Catalonia" } } } }}

156. { "label": "Latest population figure of Catalonia", "value": [7539618] , "dimension" : { "id" : ["metric", "time", "geo"], "size" : [1, 1, 1], "metric": {// "label" : "What" , "desc" : "Longer text", "category" : { "index" : { "pop" : 0 } , "label" : { "pop" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } } } , "time" : {// "label" : "When" , "desc" : "Longer text", "index" : { "pop" : 0 } , "category" : { "index": {"2011-01-01":0} , "label": {"2011-01-01":"January 1st, 2011"} "label" : { "pop" : "Population" } } } , "geo" : {// "label" : "Where" , "desc" : "Longer text", "category" : { "index" : { "B" : 0 } , "label" : { "B" : "Catalonia" } } } }}

157. { "label": "Latest population figure of Catalonia", "value": [7539618] , "dimension" : { "id" : ["metric", "time", "geo"], "size" : [1, 1, 1], "metric": {// "label" : "What" , "desc" : "Longer text", "category" : { "index" : { "pop" : 0 } , "label" : { "pop" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } } } , "time" : {// "label" : "When" , "desc" : "Longer text", "category" : { "index": {"20110101":0} , "label": {"20110101":"January 1st, 2011"} } } , "geo" : {// "label" : "Where" , "desc" : "Longer text", "category" : { "index" : { "B" : 0 } , "label" : { "B" : "Catalonia" } } } }}

158. { "label": "Latest population figure of Catalonia", "value": [7539618] , "dimension" : { "id" : ["metric", "time", "geo"], "size" : [1, 1, 1], "metric": {// "label" : "What" , "desc" : "Longer text", "category" : { "index" : { "pop" : 0 } , "label" : { "pop" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } } } , "time" : {// "label" : "When" , "desc" : "Longer text", "category" : { "index": {"20110101":0} , "label": {"20110101":"January 1st, 2011"} } } , "geo" : {// "label" : "Where" , "desc" : "Longer text","index" : {"2011-01-01" : 0} , "category" : { "index" : { "B" : 0 } , "label" : { "B" : "Catalonia" }"label" : {"2011-01-01" : "January 1st, 2011"} } } }}

161. { "label": "Latest population figure of Catalonia", "value": [7539618] , "dimension" : { "id" : ["metric", "time", "geo"], "size" : [1, 1, 1], "metric": {// "label" : "What" , "desc" : "Longer text", "category" : { "index" : { "pop" : 0 } , "label" : { "pop" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } } } , "time" : {// "label" : "When" , "desc" : "Longer text", "category" : { "index": {"20110101":0} , "label": {"20110101":"January 1st, 2011"} } } , "geo" : {// "label" : "Where" , "desc" : "Longer text", "category" : { "index":{"ISO-3166-2:ES-CT":0} , "label":{"ISO-3166-2:ES-CT":"Catalonia"} } } }}

162. { "label": "Latest population figure of Catalonia", "value": [7539618] , "dimension" : { "id" : ["metric", "time", "geo"], "size" : [1, 1, 1], "metric": {// "label" : "What" , "desc" : "Longer text", "category" : { "index" : { "pop" : 0 } , "label" : { "pop" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } } } ,"index" : { "ISO-3166-2:ES-CT" : 0 } ,// "time" : { "label" : "When" , "desc" : "Longer text","label" : { "ISO-3166-2:ES-CT" : "Catalonia" } "category" : { "index": {"2011-01-01":0} , "label": {"2011-01-01":"January 1st, 2011"} } } , "geo" : {// "label" : "Where" , "desc" : "Longer text", "category" : { "index":{"ISO-3166-2:ES-CT":0} , "label":{"ISO-3166-2:ES-CT":"Catalonia"} } } }}

163. { "label": "Latest population figure of Catalonia", "value": [7539618] , "dimension" : { "id" : ["metric", "time", "geo"], "size" : [1, 1, 1], "metric": {// "label" : "What" , "desc" : "Longer text", "category" : { "index" : { "pop" : 0 } , "label" : { "pop" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } } } ,"index" : { "ISO-3166-2:ES-CT" : 0 } ,// "time" : { "label" : "When" , "desc" : "Longer text","label" : { "ISO-3166-2:ES-CT" : "Catalonia" } "category" : { "index": {"2011-01-01":0} , "label": {"2011-01-01":"January 1st, 2011"} } } , "geo" : {// "label" : "Where" , "desc" : "Longer text", "category" : { "index":{"ISO-3166-2:ES-CT":0} , "label":{"ISO-3166-2:ES-CT":"Catalonia"} } } }}

164. { "label": "Population of Catalonia, January 1st, 2011", "value": [7539618] , "dimension" : { "id" : ["metric", "time", "geo"], "size" : [1, 1, 1], "metric": {// "label" : "What" , "desc" : "Longer text", "category" : { "index" : { "pop" : 0 } , "label" : { "pop" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } } } , "time" : {// "label" : "When" , "desc" : "Longer text", "category" : { "index": {"20110101":0} , "label": {"20110101":"January 1st, 2011"} } } , "geo" : {// "label" : "Where" , "desc" : "Longer text", "category" : { "index":{"ISO-3166-2:ES-CT":0} , "label":{"ISO-3166-2:ES-CT":"Catalonia"} } } }}

165. { "label": “Population of Catalonia, January 1st, 2011", "value": [7539618] , "dimension" : { "id" : ["metric", "time", "geo"], "size" : [1, 1, 1], "metric": {// "label" : "What" , "desc" : "Longer text", "category" : { "index" : { "pop" : 0 } , "label" : { "pop" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } } } , "time" : {// "label" : "When" , "desc" : "Longer text", "category" : { "index": {"2011-01-01":0} , "label": {"2011-01-01":"January 1st, 2011"} } } , "geo" : {// "label" : "Where" , "desc" : "Longer text", "category" : { "index":{"ISO-3166-2:ES-CT":0} , "label":{"ISO-3166-2:ES-CT":"Catalonia"} } } }}

166. { "label": “Population of Catalonia, January 1st, 2011", "value": [7539618] , "dimension" : { "id" : ["metric", "time", "geo"], "size" : [1, 1, 1], "metric": {// "label" : "What" , "desc" : "Longer text", "category" : { "index" : { "pop" : 0 } , "label" : { "pop" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } } } , "time" : {// "label" : "When" , "desc" : "Longer text", "category" : { "type" : { "pop" : "count" } , "index": {"2011-01-01":0} , "label": {"2011-01-01":"January 1st, 2011"} } } , "base" : { "pop" : "Person" } , "geo" : {// "symbol" : { "label" : "Where" , "desc" : "Longer text", "pop" : null } , "mult" "category" : { : { "pop" : 0 } "index":{"ISO-3166-2:ES-CT":0} , "label":{"ISO-3166-2:ES-CT":"Catalonia"} } } }}

167. { "label": “Population of Catalonia, January 1st, 2011", "value": [7539618] , "dimension" : { "id" : ["metric", "time", "geo"], "size" : [1, 1, 1], "metric": {// "label" : "What" , "desc" : "Longer text", "category" : { "index" : { "pop" : 0 } , "label" : { "pop" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } } } , "time" : {// "label" : "When" , "desc" : "Longer text", "category" : { "index": {"2011-01-01":0} , "label": {"2011-01-01":"January 1st, 2011"} } } , "geo" : {// "label" : "Where" , "desc" : "Longer text", "category" : { "index":{"ISO-3166-2:ES-CT":0} , "label":{"ISO-3166-2:ES-CT":"Catalonia"} } } }}

168. { "label": “Population of Catalonia, January 1st, 2011", "value": [7539618] , "long" : 2.178389, "dimension" : { "id" : ["metric", "time", "geo"], "size" : [1, 1, 1], "lat" : 41.383531 "metric": {// "label" : "What" , "desc" : "Longer text", "category" : { "index" : { "pop" : 0 } , "label" : { "pop" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } } } , "time" : {// "label" : "When" , "desc" : "Longer text", "category" : { "index": {"2011-01-01":0} , "label": {"2011-01-01":"January 1st, 2011"} } } , "geo" : {// "label" : "Where" , "desc" : "Longer text", "category" : { "index":{"ISO-3166-2:ES-CT":0} , "label":{"ISO-3166-2:ES-CT":"Catalonia"} } } }}

169. { "label": “Population of Catalonia, January 1st, 2011", "value": [7539618] , "dimension" : { "id" : ["metric", "time", "geo"], "size" : [1, 1, 1], "metric": {// "label" : "What" , "desc" : "Longer text", "category" : { "index" : { "pop" : 0 } , "label" : { "pop" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } } } , "time" : {// "label" : "When" , "desc" : "Longer text", "category" : { "index": {"20110101":0} , "label": {"20110101":"January 1st, 2011"} } } , "geo" : {"index" : {"20110101" : 0} ,// "label" : "Where" , "desc" : "Longer text", "category" : {"label" : {"20110101" : "January 1st, 2011"} "index":{"ISO-3166-2:ES-CT":0} , "label":{"ISO-3166-2:ES-CT":"Catalonia"} } } }}

170. { "label": “Population of Catalonia, January 1st, 2011", "value": [7539618] , "index" "dimension" : {: { "id" : ["metric", "time", "geo"], "size" : [1, 1, 1], "from" : "20000101" "metric": { ,// "to" : "20110101" "label" : "What" , "desc" : "Longer text", "category" : { } "index" : { "pop" : 0 } , "label" : { "pop" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } } } , "time" : {// "label" : "When" , "desc" : "Longer text", "category" : { "index": {"20110101":0} , "label": {"20110101":"January 1st, 2011"} } } , "geo" : {"index" : {"20110101" : 0} ,// "label" : "Where" , "desc" : "Longer text", "category" : {"label" : {"20110101" : "January 1st, 2011"} "index":{"ISO-3166-2:ES-CT":0} , "label":{"ISO-3166-2:ES-CT":"Catalonia"} } } }}

171. { "label": “Population of Catalonia, January 1st, 2011", "value": [7539618] , "dimension" : { "id" : ["metric", "time", "geo"], "size" : [1, 1, 1], "metric": {// "label" : "What" , "desc" : "Longer text", "category" : { "index" : { "pop" : 0 } , "label" : { "pop" : "Population" } , "unit" : {"type" : {"pop" : "count"} , "base" : {"pop" : "Person"} ,"symbol" : { "pop" : null} ,"mult" : {"pop" : 0} } } } , "time" : {// "label" : "When" , "desc" : "Longer text", "category" : { "index": {"20110101":0} , "label": {"20110101":"January 1st, 2011"} } } , "geo" : {// "label" : "Where" , "desc" : "Longer text", "category" : { "index":{"ISO-3166-2:ES-CT":0} , "label":{"ISO-3166-2:ES-CT":"Catalonia"} } } }}

172. "value": [3732196, 3807422 , 7539618]

173. "value": [3732196, 3807422 , 7539618]"id" : ["metric", "time", "geo", "sex"] ,"size" : [1, 1, 1, 3]

174. "value": [3732196, 3807422 , 7539618]"id" : ["metric", "time", "geo", "sex"] ,"size" : [1, 1, 1, 3]"sex" : { "category" : { "index" : {"M" : 0 , "F" : 1 , "T" : 2} , "label" : { "M" : "Men" , "F" : "Women" , "T" : "Total" } }}

175. "value": [3732196, 3807422 , 7539618]"id" : ["metric", "time", "geo", "sex"] ,"size" : [1, 1, 1, 3]"sex" : { "category" : { "index" : {"M" : 0 , "F" : 1 , "T" : 2} , "label" : { "M" : "Men" , "F" : "Women" , "T" : "Total" } } Names not predetermined!}

176. "value": [3732196, 3807422 , 7539618]"id" : ["metric", "time", "geo", "sex"] ,"size" : [1, 1, 1, 3]"sex" : { "category" : { "index" : {"M" : 0 , "F" : 1 , "T" : 2} , "label" : { "M" : "Men" , "F" : "Women" , "T" : "Total" } } value[dimension["sex"].category.index["F"]]}

177. "value": [3732196, 3807422 , 7539618]"id" : ["metric", "time", "geo", "sex"] ,"size" : [1, 1, 1, 3]"sex" : { "category" : { "id" : ["M", "F", "T"] , "label" : ["Men", "Women", "Total"] }} value[dimension["sex"].category.index["F"]]

178. "value": [3732196, 3807422 , 7539618]"id" : ["metric", "time", "geo", "sex"] ,"size" : [1, 1, 1, 3]"sex" : { "category" : { "id" : ["M", "F", "T"] , "label" : ["Men", "Women", "Total"] }} for( ; ; ){ ... } value[dimension["sex"].category.index["F"]]

179. "value": [3732196, 3807422 , 7539618]"id" : ["metric", "time", "geo", "sex"] ,"size" : [1, 1, 1, 3]"sex" : { "category" : { "index" : {"M" : 0 , "F" : 1 , "T" : 2} , "label" : { "M" : "Men" , "F" : "Women" , "T" : "Total" } }}

180. "value": [3732196, 3807422 , 7539618]"id" : ["metric", "time", "geo", "sex"] ,"size" : [1, 1, 1, 3]"sex3" : { "attribute" : "sex" , "category" : { "index" : {"M" : 0 , "F" : 1 , "T" : 2} , "label" : { "M" : "Men" , "F" : "Women" , "T" : "Total" } }}

181. "value": [ 3058628, 3115336, 3201029, 3309850, 3366329, 3468235, 3543706, 3578176, 3661028, 3713765, 3724515, 3732196, 3203371, 3246029, 3305411, 3394296, 3446990, 3526971, 3590991, 3632332, 3703050, 3761655, 3787866, 3807422, 6261999, 6361365, 6506440, 6704146, 6813319, 6995206, 7134697, 7210508, 7364078, 7475420, 7512381, 7539618]

182. "value": [ 3058628, 3115336, 3201029, 3309850, 3366329, 3468235, 3543706, 3578176, 3661028, 3713765, 3724515, 3732196, 3203371, 3246029, 3305411, 3394296, 3446990, 3526971, 3590991, 3632332, 3703050, 3761655, 3787866, 3807422, 6261999, 6361365, 6506440, 6704146, 6813319, 6995206, 7134697, 7210508, 7364078, 7475420, 7512381, 7539618] ↓ cryptic ↑ single model

183. "value": [ 3058628, 3115336, 3201029, 3309850, 3366329, 3468235, 3543706, 3578176, 3661028, 3713765, 3724515, 3732196, 3203371, 3246029, 3305411, 3394296, 3446990, 3526971, 3590991, 3632332, 3703050, 3761655, 3787866, 3807422, 6261999, 6361365, 6506440, 6704146, 6813319, 6995206, 7134697, 7210508, 7364078, 7475420, 7512381, 7539618] ↓ cryptic ↑ single model"id" : ["metric", "time", "geo", "sex"] ,"size" : [1, 12, 1, 3]

184. "value": [ 3058628, 3115336, 3201029, 3309850, 3366329, 3468235, 3543706, 3578176, 3661028, 3713765, 3724515, 3732196, 3203371, 3246029, 3305411, 3394296, 3446990, 3526971, 3590991, 3632332, 3703050, 3761655, 3787866, 3807422, 6261999, 6361365, 6506440, 6704146, 6813319, 6995206, 7134697, 7210508, 7364078, 7475420, 7512381, 7539618] 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011"id" : ["metric", "time", "geo", "sex"] ,"size" : [1, 12, 1, 3]

185. "value": [ 3058628, 3115336, 3201029, 3309850, 3366329, 3468235, 3543706, 3578176, 3661028, 3713765, 3724515, 3732196, 3203371, 3246029, 3305411, 3394296, 3446990, 3526971, 3590991, 3632332, 3703050, 3761655, 3787866, 3807422, 6261999, 6361365, 6506440, 6704146, 6813319, 6995206, 7134697, 7210508, 7364078, 7475420, 7512381, 7539618] 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 Male Female Total"id" : ["metric", "time", "geo", "sex"] ,"size" : [1, 12, 1, 3]

186. "value": [ 3058628, 3115336, 3201029, 3309850, 3366329, 3468235, 3543706, 3578176, 3661028, 3713765, 3724515, 3732196, 3203371, 3246029, 3305411, 3394296, 3446990, 3526971, 3590991, 3632332, 3703050, 3761655, 3787866, 3807422, 6261999, 6361365, 6506440, 6704146, 6813319, 6995206, 7134697, 7210508, 7364078, 7475420, 7512381, 7539618] 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 Male Female “CSV revisited” Total"id" : ["metric", "time", "geo", "sex"] ,"size" : [1, 12, 1, 3]

187. "value": [ 3058628, 3115336, 3201029, 3309850, 3366329, 3468235, 3543706, 3578176, 3661028, 3713765, 3724515, 3732196, 3203371, 3246029, 3305411, 3394296, 3446990, 3526971, 3590991, 3632332, 3703050, 3761655, 3787866, 3807422, 6261999, 6361365, 6506440, 6704146, 6813319, 6995206, 7134697, 7210508, 7364078, 7475420, 7512381, 7539618]getDataById(ds, {"sex" : "M" , "time" : "20090101"})"id" : ["metric", "time", "geo", "sex"] ,"size" : [1, 12, 1, 3]

188. "value": [ 3058628, 3115336, 3201029, 3309850, 3366329, 3468235, 3543706, 3578176, 3661028, 3713765, 3724515, 3732196, 3203371, 3246029, 3305411, 3394296, 3446990, 3526971, 3590991, 3632332, 3703050, 3761655, 3787866, 3807422, 6261999, 6361365, 6506440, 6704146, 6813319, 6995206, 7134697, 7210508, 7364078, 7475420, 7512381, 7539618]"status": [ "a", "a", "a", "a", "a", "a", "a", "a", "a", "a", "p", "e", "a", "a", "a", "a", "a", "a", "a", "a", "a", "a", "p", "e", "a", "a", "a", "a", "a", "a", "a", "a", "a", "a", "p", "e"]

189. "value": [3732196, 3807422 , 7539618]"sex" : { "category" : { "index" : {"M" : 0 , "F" : 1 , "T" : 2} , "label" : { "M" : "Men" , "F" : "Women" , "T" : "Total" } , }}

190. "value": [3732196, 3807422 , 7539618]"sex" : { "category" : { "index" : {"M" : 0 , "F" : 1 , "T" : 2} , "label" : { "M" : "Men" , "F" : "Women" , "T" : "Total" } , "uri" : "http://jsonstat.dataprovider.org/dimension/sex.json", }}

191. "value": [3732196, 3807422 , 7539618]"sex" : { "category" : { "uri" : "http://jsonstat.dataprovider.org/dimension/sex.json", }}

192. The JSON-stat CommunityWelcomes You!

193. The JSON-stat CommunityWelcomes You! Needs You!

194. Standards for statistical data dissemination a wish list Xavier Badosa (@badosa) Statistical Institute of Catalonia Thank you OECD Statistical Information System Collaboration Community (SIS-CC) Workshop 2012. Paris, 12-14 March

195. Dan Taylor borman818 / Daniel Borman Christian Cable Ian Muttoo Donald Macleod Lushbunny shaggy359Wikimedia Commons http://en.wikipedia.org/wiki/File:IBM_PC_5150.jpg http://en.wikipedia.org/wiki/File:Asimo_look_new_design.jpg Richard Cyganiak

196. Photos of products and webpages have been taken from the respectivecompanies’ websites. 1993 Mosaic webpage, © Board of Trustees of theUniversity of Illinois, taken from the Computer History Museum website.Superman logo (free licence) from vectortemplates.com. Authors’pictures taken from respective websites or Twitter accounts, except TimBerners-Lee taken from a video session. HTML5 logo from W3C. Image fromStanley Kubrick’s Dr. Strangelove or: How I Learned to Stop Worrying andLove the Bomb, © Columbia Pictures. Homo erectus’ drawing taken fromrecursos.cnice.mec.es (Spanish Ministry of Education & Science). Homosapiens neanderthalis’ drawing taken from vanedf11.blogspot.com.