It's the people's data
•Download as PPT, PDF•
1 like•533 views
Presentation at the Santa Fe Complex, 5 Oct 2001
![[object Object],[object Object],It's the people's data by J. T. Johnson is licensed under a Creative Commons Attribution-NonCommercial-NoDerivs](data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7)
Recommended
Recommended
More Related Content
What's hot
What's hot (19)
Viewers also liked
Viewers also liked (7)
Similar to It's the people's data
Similar to It's the people's data (20)
More from J T "Tom" Johnson
More from J T "Tom" Johnson (20)
Recently uploaded
Recently uploaded (20)
It's the people's data
- 1. Hey, it's THE PEOPLE'S data! The global emergence of the Open Data Movement Tom Johnson Managing Director Institute for Analytic Journalism Santa Fe, NM tom@jtjohnson.com
- 12. Development Seed
- 18. Culture “hacks”
- 20. Hacks and Hackers around the world
- 22. Hacks and Hackers chapters
- 25. Open Data Showroom - http://opendata-showroom.org/
- 26. AskTheEU.org
- 28. OpenlyLocal.com
- 29. Hyperlocal Sites in UK & Ireland
- 30. San Francisco: Data Sharing Among City Departments and Agencies
- 31. International Excellent meta-data
- 32. San Antonio Payment Register
- 33. Santa Fe .gov
- 38. Gov’t agencies in NM
- 39. New, major function for government in the Digital Age
- 42. Hey, it's THE PEOPLE'S data! The global emergence of the Open Data Movement Tom Johnson Managing Director Institute for Analytic Journalism Santa Fe, NM t o m @ j t j o h n s o n . c o m Slides may be found at http://opendatanm.pbworks.com
Editor's Notes
- This is a test
- Part of the SFX series "What's happening now?“ Brief interested citizens and journos on potential for citizen control of our data Test the water to see if others in SFe might be interested in building a "Get our data" project
- Basic Process: Data In Analysis Info Out Facilitate transparency, participation, collaboration, economic development Create greater efficiency and utility for public administrators Create a culture in government and public administration that assumes The People's Data will be quickly online in its original file format. Educate citizens on how to identify, retrieve, analyze and present data
- An informed electorate is better than uninformed Have factual basis to challenge pols ==== ========================== It IS the people's data Changing Functions of gov't. Fight against the "data huggers" An informed electorate is better than uninformed Full political spectrum can agree on impt. of data (if not interpretation) The technology is relatively easy; changing the culture is hard Supply analytic tools if possible, i.e. sort and array, GIS, visual stats
- Default: Post all gov't data in original file format as soon as possible Make as easy to download in original format as possible Yes, there are/will be privacy issues But start with “put the data up” proposition; then ask, “OK, is there going to be anything here that encroaches on an individual’s privacy?” I’m less concerned about “CORPORATE privacy than that of individuals. And the whole concept of PRIVACY is a topic for another discussion.
- The Pew Center referred to research by The Brennan Center for Justice at the New York University School of Law that said, "If the right to vote [in New York City] were conditioned on a proper match, up to 20 percent of new voter registrations would have been rejected solely because of data entry errors. Similar 'matching' error rates of 20-30 percent were discovered in Washington State. And the Social Security Administration has reported a 28.5 percent failed match rate nationwide." 1 ===============================================
- • technology alone, • building a portal, • transparency for the sake of transparency.
- Increased internal government efficiency and effectiveness Increased citizen participation and inclusion with more services closer to people’s needs More services to people because of increased base of more potential service providers New businesses/jobs for application and service developers Synergies between government, public administration and civil society organizations New uses of open data spur innovation and development in the CIT sector ====================== Bottom Line? Better Government Better services from government Economic development Source: http://www.webfoundation.org/2011/09/open-data-seeing-well-beyond-the-portals/ Sep 21, 2011 at 7:27 am • José M. Alonso Jose M. Alonso Program Manager, Open Data World Wide Web Foundation email: [email_address] twitter: @josemalonso skype: josema.alonso http://www.webfoundation.org
- Go to Web page for DevSeed
- Ivan Begtin <ibegtin@gmail.com> ccOpen Government WG List <open-government@lists.okfn.org> dateThu, Sep 15, 2011 at 12:14 PMsubjectRe: [open-government] About Moscow city administration opendata plansmailing listopen-government.lists.okfn.org Filter messages from this mailing listunsubscribeUnsubscribe from this mailing-listImportant mainly because you often read messages with this label. hide details 12:14 PM (14 minutes ago) 2011/9/15 Ivan Begtin < [email_address] >: [...] > I would like to lauch public discussion here in Russia about city data > openness and to civil oversight over city administration activities. > So could you help me please with information about similar city projects > around the world ? I know that there are Toronto, Chicago, Berlin and dozen > other city opendata projects. > If you know about any city level opendata portal, could you tell me about: > - how long time it takes to create it and to make it public? Depends what you need to do. To deploy a CKAN instance and do a bit theming could be a matter of a week (or even less). If you need to integrate with other material or do more customization it would be longer. Data Greater Manchester < http://datagm.org.uk/ > is an example of a reasonably simple city level open data portal. > - how expensive it is to create city level opendata portal? Again depends what you need to do. > - which open source solutions available? I know about CKAN and NDC from > Sunlight Labs. NDC site has been &quot;sunsetted&quot; though I believe the code is still around on github. Rufus =============================== Chis, yes I am thinking about something simple, open source and that has any example of installation for open data catalog use. Probably Drupal or Wordpress, probably CKAN. Just right now russian government agencies start to think about open data catalogs and I have a feeling that they could try to avoid this topic hiding behind ideas that &quot;it's too expensive to do it right now&quot;. That's why I am looking for examples that will be relevant to Moscow city and on Russian national level. About OpenlyLocal.com, I watch it for a long time. Yes, it's really interesting. I really would like to create something similar for Russia, but we have too centralized government and most municipalities here a very dependent on country level officials decisions. Another problem is that we have 2000 first level municipalities and 22 000 of second level. But we keep thinking about collecting data about them and OpenlyLocal.com is great example. Thanks a lot.
- Ukraine open data?
- South Sudan, Philippines and South Caucasus ????
- Warsaw – but all-Europe – hackathon Daniel Dietrich The Open Knowledge Foundation Promoting Open Knowledge in a Digital Age www.okfn.org - www.opendefinition.org Mail: [email_address] Mobil: +49 171 780 870 3 Twitter: @ddie
- The camp has 4 key objectives: * Build consensus – around core open data principles and values * Build community – expand and strengthen international open data community * Share ideas – on the future of open data and how we can do things better * Make things – from starting projects, to making plans, to writing code
- Culture hackathons
- Not only Europe, but growing interest in Africa
- Hackathons on various locales and topics
- Philadelphia hackathon
- US city hackathons Resources: Chaos Communication Camp 2011 - http://events.ccc.de/camp/2011/ Sort of a Burning Man for hackers Chaos Communication Camp this year for five days. Where? In an ancient Soviet military base, complete with airplanes and an open air museum. 3,500 hackers were expected for what is known to be the largest assembly of the kind in Europe. Here’s a collection of the best of OWNI’s interviews from these five days in the heart of hackerdom. - Birgitta Jónsdóttir: “Keep the freedom of information what it should be: free.” -- http://www.datajournalismblog.com/2011/08/18/best-of-ccc-2011-interviews/ The Icelandic deputy Birgitta Jónsdóttir is the backbone behind the Icelandic Media Modernization Initiative ( IMMI ), a resolution that aims to make Iceland into a paradise for freedom of expression.
- All of this activity is based on the FUNDAMENTAL PROCESS of Data In Analysis InfoOut Each of these steps has multiple sub-topics and digital tools – e.g. different file types or data cleaning before analysis.
- It all starts with locating – and retrieving data – government, corporate, demographic, etc. Description: The TWC International Open Government Dataset Catalog (IOGDC) is a linked data application based on metadata scraped from an increasing number of international dataset catalog websites publishing a rich variety of government data. Metadata extracted from these catalog websites is automatically converted to RDF linked data and re-published via the TWC LOGD SPAQRL endpoint and made available for download. The TWC IOGDC demo site features an efficient, reconfigurable faceted browser with search capabilities offering a compelling demonstration of the value of a common metadata model for open government dataset catalogs. We believe that the vocabulary choices demonstrated by IOGDC highlights the potential for useful linked data applications to be created from open government catalogs and will encourage the adoption of such a standard worldwide. Warning: This demo will crash IE7 and IE8. Contributor: Eric Rozell Contributor: Jinguang Zheng Contributor: Yongmei Shi Live Demo: http://logd.tw.rpi.edu/demo/international_dataset_catalog_search Notes: This is an experimental demo and some queries may take longer time to response (30 ~60 seconds). Please referesh this page if the demo is not loaded. Our metadata model can be accessed here . Procedure to getting and publishing metadata is described here . The RDF dump of the datasets can be downloaded here . Welcome to S2S! International OGD Catalog Search (searching 736,578 datasets) http://logd.tw.rpi.edu/demo/international_dataset_catalog_search
- Source: http://opendata-showroom.org/ Original in German Go to home site and walk-through tabs (in German) to show what is being done with the data and apps.
- Ask the EU to find data
- OpenCorporates webpage Demo video: How to use OpenCorporates to match companies in Google Refine - http://vimeo.com/17924204 by OpenCorporates
- British example of LOCAL Open Data sites
- Mapping of local sites in UK
- Find and Retrieve – San Francisco presumes data will be shared by government agencies AND citizens.
- Examples of good drill-down and META data
- City of San Antonio’s “checkbook” What missing, so far, is the link to the contract
- Santa Fe’s sites – a good start, but note last URL to financial report. It’s a PDF format, which is not helpful for analysis.
- So where do we start? With the current statutes, state and local.
- Source: http://www.statearchivists.org/arc/states/res_sch_genlloc.htm
- Source: http://www.nmcpr.state.nm.us/records/schedules.htm Title 1, Chapter 15 General Records Retention and Disposition Schedules (GRRDS) Title 1, Chapter 16 Legislative Records Retention and Disposition Schedules (LRRDS) Title 1, Chapter 17 Judicial Records Retention and Disposition Schedules (JRRDS) Title 1, Chapter 18 Executive Records Retention and Disposition Schedules (ERRDS) Title 1, Chapter 19 Local Government Records Retention and Disposition Schedules (LGRRDS) Title 1, Chapter 20 Education Records Retention and Disposition Schedules (EDRRDS)
- Key – and often overlooked – topic: DATA VERIFICATION DB schema: https://secure.wikimedia.org/wikipedia/en/wiki/Database_schema A database schema (pronounced skee -ma , /ˈski.mə/ ) of a database system is its structure described in a formal language supported by the database management system (DBMS) and refers to the organization of data to create a blueprint of how a database will be (or is) constructed (divided into database tables). https://secure.wikimedia.org/wikipedia/en/wiki/Database_schema In a relational database , the schema defines the tables , fields , relationships , views , indexes , packages , procedures , functions , queues , triggers , types , sequences , materialized views , synonyms , database links , directories , Java , XML schemas , and other elements.
- 225+ state agencies and departments in NM All have data that belongs to citizens All have, by law, an assigned records custodian Who are they and where is OUR data?
- Jump-station: High-level computer skills, but also need intern-level students to do basic data search-and-retrieval. Create support group(s) for libraries at all levels to be wheelhouse for ALL government data initiatives, NOT IT departments
- Anyone interested in OpenData-NM? Fill out info card Recruit others Visit “rough sketch” wiki – o p e n d a t a n m . p b w o r k s . c o m Make suggestions Step up to develop/manage a pertinent project
- This is a test