The document discusses CSI-Piemonte's efforts to develop a big data science platform for regional public sector information (PSI) in Italy. It describes CSI-Piemonte's role in managing and analyzing large volumes of public data. It outlines CSI-Piemonte's experience and expertise in areas like business intelligence, data warehousing, analytics, and visualization. It also provides examples of how CSI-Piemonte is using big data and analytics for applications like smart cities, social media analysis, and open data initiatives.
Intervento su Data governance in Piemonte (genn 2009) - parte 1
A Big Data Science platform for regional Public Sector Information
1. A big data science platform for regional
Public Sector Information
Giuliana Bonello
Business Intelligence & Data Quality Practice Manager
2012, October, 17th
2. A big data science platform for regional PSI
Where we are
Located on the north-west of Italy, bordering with
France and Switzerland
Capital city: Turin
4.5 Ml inhabitants
8 Provinces
1,206 Municipalities/Towns
8.7% contribution to the national GDP
5.3% unemployment rate
2012, October, 17th 2
3. A big data science platform for regional PSI
Who we are
Founded in 1977 by:
CSI-Piemonte: IT for public services
one of the main Information & Communication Technology
Piedmont Region agencies in Italy
University of Turin design and develop innovative public services,to simplify life for
citizens and enterprises and to facilitate and speed up their relations
Polytechnic of Turin with the Public Administration
Associated consortium members
Region 1
96 Associated Consortium
Universities 3
Members
Provinces 8
156,7 Millions € annual
Municipalities 43
revenues (2010)
Municipalities associations 11
1,200 employees Agencies & other institutions 10
5 sites in Piedmont Health & Hospital Units 20
Total number 96
2012, October, 17th 3
4. A big data science platform for regional PSI
CSI-Piemonte: IT for public services
we are one of the main Information & Communication
Technology agencies in Italy
we design and develop innovative public services,to simplify
life for citizens and enterprises and to facilitate and speed up
their relations with the Public Administration your life
Our Mission without queues
transforming innovation demand from citizens and enterprises all services
into services accessible for all and easy to use
at your place
helping public institutions to optimize internal processes to save
time, reduce expenses and satisfy the needs of the citizens 24/7
promoting collaboration among Administrations in Italy and just in one click
abroad and the reuse of Piedmont good practices
2012, October, 17th 4
5. A big data science platform for regional PSI
International activities
Since 2005 CSI is actively involved in promoting its international presence:
Relations and cooperation with our local Public
Authorities and in cooperation with ICT partners of
our territory, promoting our best practices
International relations with donors (EC,WB,UN…).
Relation with Italian Ministries (Foreign
Affairs, Public
Administration, Environment, Health…) and for
cooperation programme
Awarded projects: > 45
2012, October, 17th 5
6. A big data science platform for regional PSI
Public Sector Information: a resource
2012, October, 17th 6
7. A big data science platform for regional PSI
The issue to tackle
A big volume of data converges on every enterprise; they come from:
INTERNAL CHANNELS: through the digitalized operational
processes;
EXTERNAL CHANNELS: through the interactions of the enterprise
with the external world.
The technological evolution, through adequate infrastructures
(HW/SW), makes available an enormous volume of data with
respect to the past, both memorized in enterprise systems and
accessible in external web.
It is important to define a methodological and operational
process for the extraction of information and knowledge of the set
of data collected that represent the STRATEGIC INFORMATION
ASSET of the enterprise.
2012, October, 17th 7
8. A big data science platform for regional PSI
Big Data Era: IDC Definition
“Big data technologies describe a new
generation of technologies and
architectures, designed to
economically extract value from very
large volumes of a wide variety of
data, by enabling high-velocity
capture, discovery, and/or analysis.”
2012, October, 17th 8
9. A big data science platform for regional PSI
2012, October, 17th 9
10. A big data science platform for regional PSI
2012, October, 17th 10
11. A big data science platform for regional PSI
Gain from the use of big data
HEALTH CARE
GOVERNMENT
2012, October, 17th 11
12. A big data science platform for regional PSI
2012, October, 17th 12
13. A big data science platform for regional PSI
We need to filter this deluge of information
2012, October, 17th 13
14. A big data science platform for regional PSI
From BI to Data Science
2012, October, 17th 14
15. A big data science platform for regional PSI
The challenge in the government world
The challenge is to use such information as a strategic asset for:
The efficiency and effectiveness of the internal processes;
A transparent relationship towards external beneficiaries (citizens and enterprises);
The growth of the opportunities in their territories (territorial marketing, innovation,
competitiveness)
An enhanced capacity to take decisions based on an adequate and continuosly updated
knowledge of the evolution of phenomena on the territory.
For Government For Research
For Business For Democracy
Intelligent exploitation of the public information asset by all.
2012, October, 17th 15
16. A big data science platform for regional PSI
The CSI experience
CSI in its 35-year life has grown up an
“Intelligent Public Sector Information Center of Excellence”
(I-PSI-CoE),
a pool of solutions, infrastructures, competences,
methodologies, processes
in the Management, Governance and Valorization
of the public information asset.
2012, October, 17th 16
17. A big data science platform for regional PSI
I-PSI-CoE’s components
I-PSI-CoE is an organic set of
competences,
infrastructures,
solutions,
methodologies,
processes
2012, October, 17th 17
18. A big data science platform for regional PSI
I-PSI-CoE: what it is and its use
What it is
• The Center's role is the treatment of the information in order
to provide to the PA a number of tools for the realization of
more intelligent services: it governs the Public Sector
Information in its different faces so as to make it a strategic
asset.
Its use
• The Center makes activities of
management, govern, exploitation of the Public Sector
Information at 360°: Information Management, Data
Integration (DI), Metadata Management (MM), Design and
Realization of DWH, Analytics, Dashboards, Reporting and
Data Mining.
2012, October, 17th 18
19. A big data science platform for regional PSI
Our expertise
Treatment of public information so as to build added value intelligent services for
the decision support, the information inter-exchange, the public policy and
performance analysis, the fraud and tax evasion detection.
Management of different information typologies (mix of structured and unstructured
data) that have been growing dramatically in quantity: we speak of Digital Content that
include alphanumeric, geographic, text and multimedia information.
Use of effective techniques for the visualization of data, different for different users.
2012, October, 17th 19
20. A big data science platform for regional PSI
The I-PSI-CoE model
The overall service model is based on the set up of the BI core
component.
The different technological layers are:
the infrastructure;
the software solutions for the Information Management and the Business Intelligence;
the data bases;
the metadata structures;
the specific applications.
2012, October, 17th 20
21. A big data science platform for regional PSI
Report on
mainframe
History of Decisional Systems
Stand-alone
applications
at CSI-Piemonte
Web
1980
applications
1990
2000 BICC
mobile
DQ services
2005
Applications on
mainframe 2012
Client-server
applications
Grid
2012, October, 17th Management 21
22. A big data science platform for regional PSI
Organizational History
Statistical center
1st DW project
(mainframe)
(Piedmont region)
1980
First BICC phase:
1990 Centralisation for all customers
2000 BICC From BICC to PSI-CC:
DQ
BI & DQ
2005
2010
Towards I-PSI-CC
2012, October, 17th 22
23. A big data science platform for regional PSI
Paper archives Information
Operational database management
Data warehouse
evolution
Web data
Data from citizens
Sensor data
2012, October, 17th 23
24. A big data science platform for regional PSI
Data sharing evolution (in Piedmont Local Government)
Single Local government database (100%)
Master data shared between local government (80%)
Interoperability (40%)
Open Data (20%)
Linked Open Data
(in progress)
2012, October, 17th 24
25. A big data science platform for regional PSI
Transactional data growing BI application growing
600 600
1200
1000
500 500
800 400 400
Regione Piemonte
Città di Tor ino
600 Città di Tor ino 300 300
Regione Piemonte
Pr ov inc ia di Tor ino
Tolali enti
400 A ltr i 200 200
200 100 100
0 0 0
2005 2008 2009
2001 2003 2005 2006 2007 2008 2009
TOTAL
TYPE OF DB DB
DECISION
PA CUSTOMER OPERATIONAL MAKING
Piedmont Region 731 93 824
Municipality of Turin 108 8 116
Province of Turin 191 48 239
Others 139 14 153
TOTAL 1169 163 1332
2012, October, 17th 25
26. A big data science platform for regional PSI
New segments of data
Some example of
New segments
of big data
in Piedmont
BDP:
IMR: Streaming
Piedmont Digital Sensor network
Health images platform
Library
2012, October, 17th 26
27. A big data science platform for regional PSI
CSI-Piemonte towards SAS Analytics Infrastructure
2012, October, 17th 27
28. A big data science platform for regional PSI
SAS Grid Manager and CSI-Piemonte: Key benefits
SAS Grid Manager: central point for
administration and prioritization provided
by policies
High availability for SAS Application
and eliminate the impact from routine
maintenance
Increased Flexibility: multiple
application run simultaneously and
computing resourses can be allocated
Enhanced Performance: for all
users, more data or complex analysis in
less time
2012, October, 17th 28
29. A big data science platform for regional PSI
Data science evolution guidelines
Information
visualization
Analytics
Real time
monitoring Semantics
as a broker
Net sentiment Information and
competences
in the network
2012, October, 17th 29
30. A big data science platform for regional PSI
Towards Big Data Architecture: some experience
Torino Smart City
Citizen dashboard
Net sentiment in a smart city
Communication Management
Urban security dashboard
Energy dashboard Participation
Knowledge from Social Network data
Hot topics: Spending review
Job search on social network
Social network data
2012, October, 17th 30
31. A big data science platform for regional PSI
Torino smart city Portal: communication
Communication Management
Participation
2012, October, 17th 31
32. A big data science platform for regional PSI
Torino smart city Portal: communication/participation
Citizen sentiment on web
2012, October, 17th 32
33. A big data science platform for regional PSI
Torino smart city dashboard: management
• This DSS is a permanent dynamic and georeferenced system for surveying phenomena
and all the territorial, structural and infrastructural, social, socio-demographic and socio-
economic variables
• It help to determine the urban conditions of the territories and citizen perception
Urban security dashboard
Better understand the relationship between the
indicators in the Dashboard Urban Safety
(CSU) of the City of Turin and the perceived
safety of the public;
Understand the factors that mainly influence the
perceived safety.
The results obtained could provide policy
makers with a tool to help them better
understand what levers of action to increase the
perceived safety of Turin..
2012, October, 17th 33
34. A big data science platform for regional PSI
Torino Urban security dashboard
2012, October, 17th 34
35. A big data science platform for regional PSI
Urban security
data mining Economic assistance rate
Connection time Income
Income
2012, October, 17th 35
36. A big data science platform for regional PSI
Torino Energy dashboard: 3Dview of gas consumption
2012, October, 17th 36
37. A big data science platform for regional PSI
2012, October, 17th 37
38. A big data science platform for regional PSI
Extract knowledge from the net
2012, October, 17th 38
39. A big data science platform for regional PSI
Spending review discussion on Twitter
2012, October, 17th 39
40. A big data science platform for regional PSI
Spending review discussion on Twitter
Authors of discussion
Themes of discussion
2012, October, 17th 40
41. A big data science platform for regional PSI
Mix of administrative data and net data
(SAS Visual analitycs)
2012, October, 17th 41
42. A big data science platform for regional PSI
The internet services improving the quality of life. Yours too.
2012, October, 17th 42