Presentation of Roger Longhorn, Secretary-General of the GSDI Association and Gabor Remetey-Fülöpp, Secretary-general of HUNAGI at Roundtable 5 of the GSDI 2015 Conference, 20 January, London - on "Harnessing Innovation Opportunities from Open Data and Big Data"
NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...
DGI 2015 Roundtable 5 Co-chair's presentation
1. Roundtable 5
Harnessing Innovation Opportunities from
Open Data and Big Data
Co-Chairs:
Roger Longhorn
Secretary-General, Global Spatial Data Infrastructure (GSDI) Association
www.gsdi.org
Contact: rlonghorn@gsdi.org / ral@alum.mit.edu
Gabor Remetey-Fülöpp
Secretary General, Hungarian Association for Geo-information (HUNAGI)
www.hunagi.hu
Contact: gabor.remetey@gmail.com
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference
QEEII Conference Center
London, 20 January 2015
1
2. Relevances from the keynotes
QEEII Conference Center
London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference
2
• Neil Thompson: Data availability is an issue: 60% vs 38% in previous year
• Jane Dickerson: Content, Context, Conveience, Consequences Principles of
Robert Cardello (NGI). Flexible sharing, full interoperability, timely service and
multi-national partnership
– Stuart Blundel’ intervention (Exelis, based on ad hoc discussion with the next sittings): agencies
should not compete with private sector but leveraging their services
• Éric Laliberté: clear vision and strategy is prepequisite for successful
implementation (the case of CSA)
• Dan Jablonsky (DigitalGlobe): set up some dedicated homeland security areas
where also Open and Big Data play important role
• Robert B, Murett (INSCT): expanded range of sensors and data management are
needed to handle the global commons: air, space, high seas and cyber.
Challanges include how to get more with less, commin/data transfer, data
sharing
• Craig Clarke: OSINT Impact of the social media: smart phones 2005 – 2014
• Anne Cathrine Frostrup (Kartverk) importance of availability, accessibility and
usability of reliable geospatial data
3. Agenda
• Introduction
• Open Data Issues and Challenges
• Open Data Discussion – Key Issues
• Big Data Issues and Challenges
• Big Data Discussion – Key Issues
• Research needs and programmes
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference
QEEII Conference Center
London, 20 January 2015
3
4. Introduction
QEEII Conference Center
London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference
4
• What is Open Data?
Open Definition from the Open Knowledge Foundation:
– defines “openness” in relation to data and content,
– precisely defines “open” in the terms “open data” and “open
content”,
– ensures interoperability (shared access) between different
collections of open material.
“A piece of data or content is open if anyone is free to use, reuse,
and redistribute it — subject only, at most, to the requirement to
attribute and/or share-alike.”
http://opendefinition.org/okd/ http://okfn.org/
5. Introduction
QEEII Conference Center
London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference
5
• What Open Data definition covers?
• Access
• Redistribution
• Reuse
• Absence of Technological Restriction
• Attribution
• Integrity
• No Discrimination Against Persons or Groups
• Distribution of License
• License Must Not Be Specific to a Package
• License Must
http://opendefinition.org/okd/ http://okfn.org/
6. Open Data Policies
QEEII Conference Center
London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference
6
The G8 Open Data Charter
• Principle 1 – Open Data by default
• Principle 2: Quality and Quantity
• Principle 3: Usable by All
• Principle 4: Releasing Data for Improved Governance
• Principle 5: Releasing Data for Innovation
7. GEO/GEOSS Data Sharing Principles
QEEII Conference Center
London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference
7
• GEO – mandate for the 2nd decade to implement GEOSS, a global,
coordinated, comprehensive and sustained System of Observation
Systems providing information for the benefit of the society (9 dedicated Society
Benefit Areas)
• Implementation requirement: setting up Data Sharing Principles
– Recognizing Relevant International and National Policies and Legislation
• Data and Products (space based and in situ) at minimum time delay
and minimum cost
• Free of Charge or Cost of reproduction for research and edu
Objective: improve coordination, avoid duplication, provide easier and
more open data access, foster use, building capacity and identify gaps
Source: Douglas Cripe (PhD), Group on Earth Observations (GEO) Secretariat at IGIT2015, 16
January, 2015 Székesfehérvár, Hungary www.earthobservations.org
8. GSDI involvement in GEO activities
Integrated Geo-spatial Information and Interoperable Services
supported by Global Spatial Data Infrastructure Association (GSDI) www.gsdi.org, www.igs.org
GSDI delegates since 2007 (FGDC, CIESIN, Esri, HUNAGI)
active in
Data Sharig Principles
Architecture and Data Com
User Interface Com
GEO Common Infrastructure
Plenaries
Ministerial Summits
(*)
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference
GSDI World Conference
lRotterdam CEOS WGISS
CODATA, GEO_OGC
(*) GSDI Statement to
Cape Town Declaration
GSDI Statement to
At GEO V Bucarest
GSDI contribution
at GEO VIII Istanbul
GSDI Statement
at GEO X Foz Do Iguazu
(*) GSDI Statement
at GEO X Geneva
GSDI delegate
at GEO IV 2007
GSDI delegate
at GEO IX 2012
GSDI delegate
at GEO VIII 2011
GSDI delegate
at GEO VII 2010
GSDI delegate
at GEO X 2014
GSDI delegate
at GEO V 2008
(*) GSDI Statement
at GEO VII Beijing
Regiona/cross borderl
EURISY, DanubeRegStrategy
QEEII Conference Center
London, 20 January 2015
GSDI World Conference
Singapore
GSDI World Conference
Quebec City
GSDI World Conference
Addis Ababa
9. The European Open Data Policy
QEEII Conference Center
London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference
9
Roberto Viola of DG Connect said in an interview to EUROGI in
Ocober 2014
– It is anticipated, that the opportunity to innovate with GI
will largerly increased thanks to the revision of PSI
directive the legal cornerstone of the Open Data Initiative
– The new rules to be implemented by July 2015
– All the public data should become re-usable as default at
no or much less costs
– Expected impact on the governmental agencies such as
cadastre
10. The European Open Data Policy
QEEII Conference Center
London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference
10
Open data and its economic impacts
Authentic overview made by the representative of the DG CNECT Dr.Márta Nagy-
Rothengass at
Open Data Open Source for GI Session, EUROGI Imagine Conference in October 2014
• EU is towards a data-driven economy. Open data is significant part of it. The big data market
rises from 10 bn € to 50 bn € between 2011-2015 and revolutionises the decision making
• Open data offers opportunities for growth, jobs, better quality, better efficiency and
innovative services and develops ecosystems across the economy and society
• Open govt’l data: an untapped business est. 140 bn € in the former EU28, Better governance,
empower citizens, address societal challenges and accelerate scientific progress
• Industry involvement is a key (PPP is open – join it!)
• The EU Open Data Strategy – milestones incude: EC Communicationon Open Data (2011),
Revision of PSI Directive (2013) Guidelines on PSI re-use (July 2014).
• Now we are speaking on EU open data infrastructure
• Research and Innovation funding available to foster cross-sectral re-use with merging
different types of data
11. Open Data Issues and Challenges
What data should be made public?
1. Economic drivers
– Recent studies reveal the value to economies of opening up public datasets for
unrestricted use, including commercially.
2. Principles for governance of society
– Reactive versus proactive release of government data?
– Privacy concerns
– Existing regulations
How to make data publicly ‘open’? Lessons learned by the EU PSI Directive
How to efficiently implement and monitor Open Data policy?
– Voluntary v mandatory? Regulations? Infringements to be applied?
How to judge the effectiveness of an Open Data policy?
– Defining effectiveness benefits for Gov, Society and business? Cost-Benefit Analysis
– What indicators? Some will be financial but many difficult to measure
QEEII Conference Center
London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference
11
12. Open Data Issues and Challenges
QEEII Conference Center
London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference
12
Some academic viewpoints
Open Source, Open Data and Content are foundations for Open Educational Resources
(Prof. J. Strobl, Salzburg Uni):
Open educational resources are considered as a transformational and potentially
disruptive game changer
Stages are: spatial literacy, spatial awareness and spatial thinking
Open educational resources not equal open education
Need to share a higher level: not only data but knowledge as well
Open data and content(Prof. P.Baumann Jacobs Uni):
Outreach to science, communities and citizens.
New, advanced technical solutions helps database visualization, parallel/distributed
query processing, secured archive integration
ISO standard for multi-dimensional spatio-temporal arrays has been approved
Note: Open Source Open Data at the FOSS4G (Seoul) &
FOSS4G-Europe (PoliMi Como, July, 2015)
with the 3rd NASA WWEC
13. Big Data Issues and Challenges
QEEII Conference Center
London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference
13
14. Big Data Issues and Challenges
Intergeo 2015 Berlin 17,000 professionals
• In focus: UAVs,/UASs
• Still lack of legislation
keeping privacy
ESA Big Data Conference
Frascati, November 2014
ISDE and ICSU CODATA
Conference in Beijing
July, 2014 (Science related)
GEO-OGC Think Tank in Frascati, Sept 2013, wGISS-37,38, 2014
EUROGI policy paper on Big and Linked Data (GI-related)
QEEII Conference Center
London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference
14
15. Big Data Issues and Challenges
Data acqusition,
Data from positioning, Earth observation, imaging, social networks
citizen science
Processing and Analysis
Facebook 300 petabytes of data (daily increase: 600 TB)
Google web index: 100 PB , 600 queries/s) Data Torrent can process 1.5 bn events per second
Use of extremely large and realistcally complex datasets, real-time
cross-stream analysis
Management and Service
Legal framework,Interoperability, Data sharing, Capacity building,
Collaboration, Usability: timely, reliable, ready to support in
temporaly critical decision (eg. Disaster response or other
homeland security measures)
QEEII Conference Center
London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference
15
16. Big Data Discussion – Key Issues
• Homeland security (disaster management, rescue and mitigation critical
infrastructures, land, water, etc) supporting solutions):
• Dynamic real-time location- and object to object communication–based services
Sensor webs, RFIDs, IoTs (enabling traceabilitiy) in transportation, logistics,, animal
and plant health, food security, human health monitoring – unique digital
identifiers
• Integrated and interoperable indoor-outdoor positioning and navigation
(for orientation support, rescue operation)
• Mobile GI, crowdsourcing, VGI, social networks, autonomous
data collection, UAVs,/UUVs, real-time data flows from ubiquitous sensors
• Need for Strategy, (Coordination, Implementation, Collaborationfor major Societal
Benefit Areas)
• Need for appropriate legislation (e.g. UAVs keeping privacy as much as possible)
• Need for awareness raising (role of NGOs, e.g. EUROGI policy paper) and PPPs.
• Need for Capacity Building in Big Data Analitycs
• Need for Research and Innovation
QEEII Conference Center
London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference
16
17. Research needs and programmes
Background on the EU Horizon 2020 RTD Programme
Topic ICT-16 2015 "Big Data: Research”
• Scope
• Expected impact
• Challenges and issues to be addressed
• The Horizon 2020 Big Data ‘Action’ (Budget: 561 M EUR)
• Research and Innovation actions
• Big Data Processing Examples and Benchmarking Environment
QEEII Conference Center
London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference
17
18. References
QEEII Conference Center
London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference
18
Background on the EU Horizon 2020 RTD Programme. Topic ICT-16 2015 "Big
Data: Research" Handout. Please ask copy by email from the moderators.
Additional references from the moderators incl.:
Shared and Open Data – European efforts
23rd ICSU CODATA Conference, Taipei Oct 27-31, 2012
(with K.Janssen KU.Leuven and C. Bamps EUROGI
Roger Longhorn
Open Data Meets Big Data
Open Data Forum 2014, Taipei July 9, 2014
19. Thank you for your participation!
QEEII Conference Center
London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference
19
Dr Gábor Remetey-Fülöpp,Secretary General, Hungarian Association
for Geo-information (HUNAGI) – www.hunagi.hu
Contact: gabor.remetey@gmail.com
Roger Longhorn
Secretary-General, Global Spatial Data Infrastructure (GSDI)
Association – www.gsdi.org
Contact: rlonghorn@gsdi.org / ral@alum.mit.edu
Hinweis der Redaktion
Courtesy by Prof.Dr.David Rhind, UK Government's Advisory Panel on Public Sector Information:
APPSI, Government’s Advisor Panel on Public Sector Information, has published three important new documents in the subject.
The interactive wiki version of APPSI’s glossary of Public Sector Information (PSI) and Open Data (OD) terms.
http://data.gov.uk/glossary
This derives from APPSI’s early identification of widespread and confusing use of the same terminology for different matters and different words for the same things. Government accepted the need for this in the Open Data White Paper 2012 (Cm 8353) and APPSI created and tested a glossary. With the active engagement of the Cabinet Office this has now been converted into a wiki whereby anyone can comment on the terms used, propose alternatives and suggest new definitions.
What is the value of Open Data? https://www.nationalarchives.gov.uk/documents/meetings/20140128-appsi-what-is-the-value-of-open-data.pdf.
Much government effort has been put into developing the Open Data agenda. Yet there is relatively little quantitative evidence of the resulting benefits. APPSI organised a major seminar with national and international experts to address this issue. The substantial report of the findings from the meeting show that it is unrealistic to seek simple and meaningful overall statements of monetary benefit. On the other hand there is growing evidence of significant consumer surplus benefits (e.g. saving time) and possibly some environmental benefits through use of PSI and OD. The report also addresses wider issues, such as the sustainability of OD, the importance of the new information ecosystem as opposed to a focus simply on data, the role of the private sector and the tensions between the Open Data agenda and the Trading Fund model under which some government bodies operate.
Open Data and its economic impacts
Dr. Márta Nagy-Rothengass, Head of Unit, DG Connect, European Commission
Made in Europe, Making a Difference - Contributions to Open Standards and Open Source Software
Prof. Dr. Peter Baumann, Jacobs University, Bremen
Open Source, Data and Content as Foundations for Open Educational Resources
Prof. Dr. Josef Strobl, Salzburg University SME, Administration, Education & Research
Panel Discussion FOSS4G and the European Open Data Policy - Drivers for the Wider Use of GI
Moderator Andrzej Sambura, CEO, ISPIK SA and keynote speakers plus Dr. Marco Minghini, Politecnico Milano at Como, Dr. Jon Blower, Melodies project, University of Readling and dr. Zoltán Siki, Dept. of Geodesy and Surveying, Budapest University of Technology and Economics
Contribution by Dr. Sven Schade, DG JRC IES Digital Earth and Reference Data:
Coupling Public Sector Information and Public-funded Research Data in Europe - A Vision of an Open Data Ecosystem S. Schade, C. Granell & A. Perego European Commission – DG Joint Research Centre, Ispra, Varese, Italy {sven.schade, carlos.granell, andrea.perego}@jrc.ec.europa.eu
For the time being the paper is still in the publication phase.
Agreeing data (& service) standards
… and introducing them.
Setting appropriate policies
… and enacting them.
Promulgating regulations
… and enforcing them.
Lessons learned from the EU’s PSI Re-use Directive(s) (2003 and 2013)