The Power of Open Data
•Als ZIP, PDF herunterladen•
3 gefällt mir•553 views
Talk given to the Family History Developers Conferenceon Mar 11, 2009
Empfohlen
Weitere ähnliche Inhalte
Was ist angesagt?
Was ist angesagt? (20)
Andere mochten auch
Andere mochten auch (9)
Ähnlich wie The Power of Open Data
Ähnlich wie The Power of Open Data (20)
Mehr von Phil Windley
Mehr von Phil Windley (20)
Kürzlich hochgeladen
Kürzlich hochgeladen (20)
The Power of Open Data
- 1. The Power of Open Data Phillip J. Windley, Ph.D. CTO, Kynetx www.windley.com
- 2. Is your gas pump accurate? How do you know?
- 3. Where is the inspection data? Johanna Kirk, Deseret News Unfortunately, not online...
- 4. The Deseret News built an app... 2003 Deseret News Publishing Company
- 5. The Deseret News built an app... FA IL! ! 2003 Deseret News Publishing Company
- 6. We don’t need the Department of Agriculture to build the Web application...
- 7. We just need them to make the data available so we can!
- 9. Tired of buying books on Amazon? so was Jon Udell...
- 10. Is the book in the local library?
- 11. Library lookup... http://www.amazon.com/exec/obidos/ASIN/ 0738206679
- 12. Library lookup... http://www.amazon.com/exec/obidos/ASIN/ 0738206679
- 13. Library lookup... http://www.amazon.com/exec/obidos/ASIN/ 0738206679 http://ksclib.keene.edu/search/a?searcharg=
- 14. Library lookup... http://www.amazon.com/exec/obidos/ASIN/ http://ksclib.keene.edu/search/a?searcharg= 0738206679
- 15. Library lookup... http://www.amazon.com/exec/obidos/ASIN/ http://ksclib.keene.edu/search/a?searcharg= 0738206679
- 16. With a simple Javascript bookmarklet, Jon was able to mashup two independent Web sites
- 18. What made this possible?
- 19. Both systems referenced resources using meaningful URLS
- 20. Small, scripted aggregations lead to serendipitous applications
- 21. This is the power of open data
- 22. Two forces are making open data important...
- 23. Disaggregation is the new norm
- 24. Yahoo! is a “portal”
- 25. “Portal for the Global Pet Food Industry”
- 26. Web sites are cleaving along functional lines
- 28. Integrated on my blog
- 29. Integrated on my blog
- 30. Just events...
- 31. Integrated on the IIW site
- 32. Integrated on the IIW site
- 33. Here’s another cool word: “deperimeterization”
- 34. Mommy, I’m scared of the outside world!
- 36. Fairs
- 38. Markets
- 39. Which provided more opportunity for merchants?
- 40. Which provides more opportunity for you?
- 42. The architecture of the Web supports and encourages network effects
- 47. Network effects happen when participating makes the entire network more valuable
- 48. The Web’s architecture is called REST
- 49. REpresentational State Transform
- 50. Roy Fielding via duncandavidson on Flickr
- 51. At the heart of REST are resources
- 52. Web pages, XML documents, images, JSON, SVG, and so on represent these resources
- 53. nouns verbs
- 54. URLs are the nouns
- 55. HTTP methods are the verbs
- 56. HTTP methods are the verbs
- 57. HTTP methods are the verbs POST
- 58. HTTP methods are the verbs POST GET
- 59. HTTP methods are the verbs POST GET PUT
- 60. HTTP methods are the verbs POST GET PUT DELETE
- 61. HTTP methods are the verbs POST Create GET PUT DELETE
- 62. HTTP methods are the verbs POST Create GET Retrieve PUT DELETE
- 63. HTTP methods are the verbs POST Create GET Retrieve PUT Update DELETE
- 64. HTTP methods are the verbs POST Create GET Retrieve PUT Update DELETE Delete
- 65. HTTP methods are the verbs POST Create GET Retrieve PUT Update DELETE Delete CRUD
- 66. Constraining the application interface increases client flexibility
- 68. Ideally, transformations are in the representation
- 69. Benefits of REST
- 70. Benefits of REST
- 71. Benefits of REST Simple
- 72. Benefits of REST Simple Flexible
- 73. Benefits of REST Simple Flexible Fast
- 76. You’re already building a Web application... just give it an API
- 77. Start by viewing every data element as a resource
- 78. Collections and queries too...
- 79. Every resource should have a URL
- 80. Cool URLs don’t change!
- 81. Preserve the structure of data until the last possible minute
- 82. Preserve the structure of data until the last possible minute
- 83. Preserve the structure of data until the last possible minute Use XML
- 84. Preserve the structure of data until the last possible minute Use XML Use JSON
- 85. Preserve the structure of data until the last possible minute Use XML Use JSON Use RDFa
- 86. Preserve the structure of data until the last possible minute Use XML Use JSON Use RDFa Use microformats
- 87. Preserve the structure of data until the last possible minute Use XML Use JSON Use RDFa Use microformats Use them all...
- 88. XML Example
- 89. JSON Example
- 90. RDFa
- 91. RDFa
- 92. RDFa
- 93. RDFa
- 94. RDFa
- 95. RDFa
- 96. RDFa
- 97. RDFa
- 98. RDFa
- 99. Microformats
- 100. Microformats
- 103. Export HCard data to Google Maps
- 104. Export the HCard data
- 105. to an address book
- 106. Play nice with HTTP’s verbs
- 107. Play nice with HTTP’s verbs
- 108. Play nice with HTTP’s verbs Queries should use a GET
- 109. Play nice with HTTP’s verbs Queries should use a GET Use POST to create new resources
- 110. Play nice with HTTP’s verbs Queries should use a GET Use POST to create new resources Don’t forget PUT and DELETE
- 111. Use existing standards where you can
- 112. Use existing standards where you can
- 113. Use existing standards where you can RSS
- 114. Use existing standards where you can RSS ATOM
- 115. Use existing standards where you can RSS ATOM OPML
- 116. Use existing standards where you can RSS ATOM OPML GEDCOM
- 117. Handle authentication and authorization in standard ways
- 118. Handle authentication and authorization in standard ways
- 119. Handle authentication and authorization in standard ways HTTP AUTH
- 120. Handle authentication and authorization in standard ways HTTP AUTH OAuth
- 121. Document your API and data structure online
- 122. Document your API and data structure online
- 123. Document your API and data structure online Use HTML documents
- 124. Document your API and data structure online Use HTML documents Use XML Schemas
- 125. Document your API and data structure online Use HTML documents Use XML Schemas Follow conventions
- 129. Twitter is Microblogging Social network
- 130. Twitter is Microblogging Social network 140 character limit
- 131. Twitter is Microblogging Social network 140 character limit Asymmetric follow
- 133. Building a Retweeter: The Algorithm
- 134. Building a Retweeter: The Algorithm
- 135. Building a Retweeter: The Algorithm Authenticate
- 136. Building a Retweeter: The Algorithm Authenticate Find relevant tweets in friends timeline
- 137. Building a Retweeter: The Algorithm Authenticate Find relevant tweets in friends timeline Post them to utahpolitics tweetstream
- 144. Twitter API: update
- 145. Twitter API: update
- 148. Here’s the timeline in XML
- 149. Here’s the same data in RSS
- 150. We can use a browser to discover API functionality
- 151. The Perl Version
- 152. The Perl Version
- 153. The Perl Version
- 154. The Perl Version
- 155. REST makes writing the library easy
- 156. Twitter’s creators didn’t foresee
- 157. Twitter’s creators didn’t foresee
- 158. Twitter’s creators didn’t foresee Retweeters
- 159. Twitter’s creators didn’t foresee Retweeters Analytics
- 160. Twitter’s creators didn’t foresee Retweeters Analytics Hash tags
- 161. Twitter’s creators didn’t foresee Retweeters Analytics Hash tags or a hundred other things
- 162. The value of data is unforeseen
- 166. Open data enables serendipity
- 167. Open data is a radical innovation that is generating
- 168. wealth
- 169. knowledge
- 170. & opportunity
- 171. at a small relative cost $
- 172. at a small relative cost
- 173. That’s the power of open data Contact info: phil@windley.org www.windley.com @windley
Hinweis der Redaktion
- Because the data was garnered by GRAMMA instead of being online, the application quickly became hopelessly out of date.
- Both systems used meaningful URLs and a common format to refer to records about books
- Jon’s application was unexpected by either Amazon or the creators of the library software. But he was able to take advantage of their openness to create a useful tool.
- The second trend I want to talk about is deperimeterization...
- Does this sounds scary? It’s not the first time that it’s happened and it is a good thing...
- Cities used to be surrounded by walls to keep the bad guys out.
- Commerce happened at fairs that were held weekly, monthly, or seasonally
- The trebuchet and other technological advances changed that by knocking down the walls. The cities were deperimeterized.
- The consequence was that commerce now happened in markets that were open everyday. Now 24/7.
- The World Wide Web is the most successful information system ever invented. Why did the Web win?
- 2 devices, 1 connection 5 devices, 10 connections 10 devices, 45 connections
- 2 devices, 1 connection 5 devices, 10 connections 10 devices, 45 connections
- 2 devices, 1 connection 5 devices, 10 connections 10 devices, 45 connections
- 2 devices, 1 connection 5 devices, 10 connections 10 devices, 45 connections
- A large, unlimited really, set of nouns and a small, fixed set of universal verbs
- Affectionately known as “CRUD” Who says computer scientists can make up cute acronyms?
- Affectionately known as “CRUD” Who says computer scientists can make up cute acronyms?
- Affectionately known as “CRUD” Who says computer scientists can make up cute acronyms?
- Affectionately known as “CRUD” Who says computer scientists can make up cute acronyms?
- Affectionately known as “CRUD” Who says computer scientists can make up cute acronyms?
- Affectionately known as “CRUD” Who says computer scientists can make up cute acronyms?
- Affectionately known as “CRUD” Who says computer scientists can make up cute acronyms?
- Affectionately known as “CRUD” Who says computer scientists can make up cute acronyms?
- Affectionately known as “CRUD” Who says computer scientists can make up cute acronyms?
- Affectionately known as “CRUD” Who says computer scientists can make up cute acronyms?
- Some verbs are more universal than others...
- That is, the body of the POST or PUT. And thus, the state of the system is affected...
- URLs are the nouns of this system. A lingua franca
- Is more than one answer appropriate? Then support more than one.
- Is more than one answer appropriate? Then support more than one.
- Is more than one answer appropriate? Then support more than one.
- Is more than one answer appropriate? Then support more than one.
- Is more than one answer appropriate? Then support more than one.
- Is more than one answer appropriate? Then support more than one.
- Lots of tools, automatic formating (with XSL stylesheet) heavyweight, hard to parse
- Supported by lots of languages Easy to parse No schema checking
- using HTTP verbs correctly is good for performance and ensures that caches will work properly. Universal verbs should be created whenever possible.
- using HTTP verbs correctly is good for performance and ensures that caches will work properly. Universal verbs should be created whenever possible.
- using HTTP verbs correctly is good for performance and ensures that caches will work properly. Universal verbs should be created whenever possible.
- using HTTP verbs correctly is good for performance and ensures that caches will work properly. Universal verbs should be created whenever possible.
- Existing standards means that tools exist to use them.
- Existing standards means that tools exist to use them.
- Existing standards means that tools exist to use them.
- Existing standards means that tools exist to use them.
- Existing standards means that tools exist to use them.
- Not just arguments, but input, output, and error codes. See Flickr and Twitter APIs for a good examples.
- Not just arguments, but input, output, and error codes. See Flickr and Twitter APIs for a good examples.
- Not just arguments, but input, output, and error codes. See Flickr and Twitter APIs for a good examples.
- Not just arguments, but input, output, and error codes. See Flickr and Twitter APIs for a good examples.
- but they didn’t have to because they created an open API to access the data.
- but they didn’t have to because they created an open API to access the data.
- but they didn’t have to because they created an open API to access the data.
- but they didn’t have to because they created an open API to access the data.
- but they didn’t have to because they created an open API to access the data.
- This isn’t unusual. The creators of data often fail to recognize the true value it contains.
- if they lock it up, their data will never be used for anything more than what their limited imaginations can envision.
- The answer is to design systems so that they can participate in serendipitous mashups.
- But to do that, the data has to be out in the open...