SlideShare ist ein Scribd-Unternehmen logo
1 von 19
Downloaden Sie, um offline zu lesen
Formats and Tools for  Data Trasmission Vincenzo PATRUNO Pristina, Kosovo 7, 8 Dec 2009
EDAMIS Web Application (EWA) EDAMIS Web Portal (EWP) EDAMIS Web Form (EWF)
Formats for data Transmission Gesmes
Data Repository (Warehousing) Architecture Francesco Rizzo - Eurostat NSI Eurostat Pull Requestor eDAMIS Data Input SDMX Registry Intermediate storage Verification / Conversion To SDMX Received data in SDMX-ML Loader register Warehouse storage Eurobase query Dissemination XSL for SDMX-ML P U L L P U S H
The Role of TCO
PUSH & PULL We have normally two different approach to exchange data:  PUSH  and  PULL
PUSH & PULL PUSH  mode means that the data provider takes action to send the data to the party collecting the data.  PULL  mode implies that the data provider makes the data available via the Internet. The data consumer then fetches the data on his own initiative.
Exchange and Sharing of statistical information Emphasis on macro-data (aggregated statistics) Promotes a “ data sharing ” model  Structural  metadata Reference  metadata Statistical  data Statistical  metadata   ,[object Object],[object Object],[object Object],Describe data structure  Describe the contents and the quality of the statistical data SDMX deals with… Marco Pellegrino - Eurostat
SDMX SDMX promotes a “ data sharing ” model to facilitate low-cost, high-quality statistical data and metadata exchange. Data Providers publishes the availability of data/metadata to Data Consumers and the latter are responsible for fetching the data/metadata at will. .
Query SDMX Data SDMX-ML RSS WS NSI Data Sharing Model
Data Hub Architecture Francesco Rizzo - Eurostat NSI NSI NSI NSI SDMX Registry RSS / data registration Dissemination XSL for SDMX-ML Data Portal Query Data query Response Retrieve dataset cache
http://91.194.86.67:8080/CensusHub2
The Census Hub architecture ,[object Object],[object Object],[object Object],Francesco Rizzo - Eurostat
http://bms.istat.it/sodidownload/download.aspx ISTAT SDMX Framework
ISTAT SDMX Framework ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
The NSI perspective on SDMX: benefits ,[object Object],[object Object],[object Object],[object Object],[object Object]
Collective intelligence is a shared or group intelligence that emerges from the collaboration and competition of many individuals The Collective Intelligence
 
We are already in the future Thank You for your attention [email_address]

Weitere ähnliche Inhalte

Was ist angesagt?

Practical Services for research data management
Practical Services for research data managementPractical Services for research data management
Practical Services for research data managementEUDAT
 
Introduction to the FP7 CODE project @ BDBC
Introduction to the FP7 CODE project @ BDBCIntroduction to the FP7 CODE project @ BDBC
Introduction to the FP7 CODE project @ BDBCFlorian Stegmaier
 
EDF2014: Vedran Sabol, Head of the Knowledge Visualisation Area, Know-Center,...
EDF2014: Vedran Sabol, Head of the Knowledge Visualisation Area, Know-Center,...EDF2014: Vedran Sabol, Head of the Knowledge Visualisation Area, Know-Center,...
EDF2014: Vedran Sabol, Head of the Knowledge Visualisation Area, Know-Center,...European Data Forum
 
B2STAGE- how to shift large amounts of data| www.eudat.eu |
B2STAGE- how to shift large amounts of data| www.eudat.eu | B2STAGE- how to shift large amounts of data| www.eudat.eu |
B2STAGE- how to shift large amounts of data| www.eudat.eu | EUDAT
 
BDE SC2 Workshop 3: e-ROSA: infrastructures and stakeholders
BDE SC2 Workshop 3: e-ROSA: infrastructures and stakeholdersBDE SC2 Workshop 3: e-ROSA: infrastructures and stakeholders
BDE SC2 Workshop 3: e-ROSA: infrastructures and stakeholdersBigData_Europe
 
Towards preservation of semantically enriched architectural knowledge
Towards preservation of semantically enriched architectural knowledgeTowards preservation of semantically enriched architectural knowledge
Towards preservation of semantically enriched architectural knowledgeStefan Dietze
 

Was ist angesagt? (7)

Development of a Mobile Application for the C2NET Supply Chain Cloud–based P...
Development of a Mobile Application for the  C2NET Supply Chain Cloud–based P...Development of a Mobile Application for the  C2NET Supply Chain Cloud–based P...
Development of a Mobile Application for the C2NET Supply Chain Cloud–based P...
 
Practical Services for research data management
Practical Services for research data managementPractical Services for research data management
Practical Services for research data management
 
Introduction to the FP7 CODE project @ BDBC
Introduction to the FP7 CODE project @ BDBCIntroduction to the FP7 CODE project @ BDBC
Introduction to the FP7 CODE project @ BDBC
 
EDF2014: Vedran Sabol, Head of the Knowledge Visualisation Area, Know-Center,...
EDF2014: Vedran Sabol, Head of the Knowledge Visualisation Area, Know-Center,...EDF2014: Vedran Sabol, Head of the Knowledge Visualisation Area, Know-Center,...
EDF2014: Vedran Sabol, Head of the Knowledge Visualisation Area, Know-Center,...
 
B2STAGE- how to shift large amounts of data| www.eudat.eu |
B2STAGE- how to shift large amounts of data| www.eudat.eu | B2STAGE- how to shift large amounts of data| www.eudat.eu |
B2STAGE- how to shift large amounts of data| www.eudat.eu |
 
BDE SC2 Workshop 3: e-ROSA: infrastructures and stakeholders
BDE SC2 Workshop 3: e-ROSA: infrastructures and stakeholdersBDE SC2 Workshop 3: e-ROSA: infrastructures and stakeholders
BDE SC2 Workshop 3: e-ROSA: infrastructures and stakeholders
 
Towards preservation of semantically enriched architectural knowledge
Towards preservation of semantically enriched architectural knowledgeTowards preservation of semantically enriched architectural knowledge
Towards preservation of semantically enriched architectural knowledge
 

Ähnlich wie Formats and Tools for Data Transmission

2016 SDMX Experts meeting, How to collect data using SDMX? Hubertus Cloodt, A...
2016 SDMX Experts meeting, How to collect data using SDMX? Hubertus Cloodt, A...2016 SDMX Experts meeting, How to collect data using SDMX? Hubertus Cloodt, A...
2016 SDMX Experts meeting, How to collect data using SDMX? Hubertus Cloodt, A...StatsCommunications
 
Standards Show
Standards ShowStandards Show
Standards Showmcusack
 
Meeting today’s dissemination challenges – Implementing International Standar...
Meeting today’s dissemination challenges – Implementing International Standar...Meeting today’s dissemination challenges – Implementing International Standar...
Meeting today’s dissemination challenges – Implementing International Standar...Jonathan Challener
 
Linking HPC to Data Management - EUDAT Summer School (Giuseppe Fiameni, CINECA)
Linking HPC to Data Management - EUDAT Summer School (Giuseppe Fiameni, CINECA)Linking HPC to Data Management - EUDAT Summer School (Giuseppe Fiameni, CINECA)
Linking HPC to Data Management - EUDAT Summer School (Giuseppe Fiameni, CINECA)EUDAT
 
Survey on Synchronizing File Operations Along with Storage Scalable Mechanism
Survey on Synchronizing File Operations Along with Storage Scalable MechanismSurvey on Synchronizing File Operations Along with Storage Scalable Mechanism
Survey on Synchronizing File Operations Along with Storage Scalable MechanismIRJET Journal
 
Fast Data Strategy Houston Roadshow Presentation
Fast Data Strategy Houston Roadshow PresentationFast Data Strategy Houston Roadshow Presentation
Fast Data Strategy Houston Roadshow PresentationDenodo
 
Establishing data sharing standards to promote global industry development
Establishing data sharing standards to promote global industry developmentEstablishing data sharing standards to promote global industry development
Establishing data sharing standards to promote global industry developmentThorsten Huelsmann
 
Towards a distributed framework to analyze multimodal data.pdf
Towards a distributed framework to analyze multimodal data.pdfTowards a distributed framework to analyze multimodal data.pdf
Towards a distributed framework to analyze multimodal data.pdfCarlosRodrigues517978
 
Autonomous Vehicles And Software Architectures Essay
Autonomous Vehicles And Software Architectures EssayAutonomous Vehicles And Software Architectures Essay
Autonomous Vehicles And Software Architectures EssayLiz Brown
 
Leveraging a big data model in the IT domain
Leveraging a big data model in the IT domainLeveraging a big data model in the IT domain
Leveraging a big data model in the IT domainVSS Monitoring
 
Webinar Industrial Data Space Association: Introduction and Architecture
Webinar Industrial Data Space Association: Introduction and ArchitectureWebinar Industrial Data Space Association: Introduction and Architecture
Webinar Industrial Data Space Association: Introduction and ArchitectureThorsten Huelsmann
 
Anomalous symmetry succession for seek out
Anomalous symmetry succession for seek outAnomalous symmetry succession for seek out
Anomalous symmetry succession for seek outiaemedu
 
The potential of the cloud
The potential of the cloudThe potential of the cloud
The potential of the cloudJisc
 
Data Virtualization: Introduction and Business Value (UK)
Data Virtualization: Introduction and Business Value (UK)Data Virtualization: Introduction and Business Value (UK)
Data Virtualization: Introduction and Business Value (UK)Denodo
 
Data management plans – EUDAT Best practices and case study | www.eudat.eu
Data management plans – EUDAT Best practices and case study | www.eudat.euData management plans – EUDAT Best practices and case study | www.eudat.eu
Data management plans – EUDAT Best practices and case study | www.eudat.euEUDAT
 
MFX P&C Insurance Analytics
MFX P&C Insurance AnalyticsMFX P&C Insurance Analytics
MFX P&C Insurance AnalyticsMFX Fairfax
 

Ähnlich wie Formats and Tools for Data Transmission (20)

Census Hub Project
Census Hub ProjectCensus Hub Project
Census Hub Project
 
2016 SDMX Experts meeting, How to collect data using SDMX? Hubertus Cloodt, A...
2016 SDMX Experts meeting, How to collect data using SDMX? Hubertus Cloodt, A...2016 SDMX Experts meeting, How to collect data using SDMX? Hubertus Cloodt, A...
2016 SDMX Experts meeting, How to collect data using SDMX? Hubertus Cloodt, A...
 
Standards Show
Standards ShowStandards Show
Standards Show
 
Meeting today’s dissemination challenges – Implementing International Standar...
Meeting today’s dissemination challenges – Implementing International Standar...Meeting today’s dissemination challenges – Implementing International Standar...
Meeting today’s dissemination challenges – Implementing International Standar...
 
Sdmx Tools
Sdmx ToolsSdmx Tools
Sdmx Tools
 
Linking HPC to Data Management - EUDAT Summer School (Giuseppe Fiameni, CINECA)
Linking HPC to Data Management - EUDAT Summer School (Giuseppe Fiameni, CINECA)Linking HPC to Data Management - EUDAT Summer School (Giuseppe Fiameni, CINECA)
Linking HPC to Data Management - EUDAT Summer School (Giuseppe Fiameni, CINECA)
 
Survey on Synchronizing File Operations Along with Storage Scalable Mechanism
Survey on Synchronizing File Operations Along with Storage Scalable MechanismSurvey on Synchronizing File Operations Along with Storage Scalable Mechanism
Survey on Synchronizing File Operations Along with Storage Scalable Mechanism
 
Fast Data Strategy Houston Roadshow Presentation
Fast Data Strategy Houston Roadshow PresentationFast Data Strategy Houston Roadshow Presentation
Fast Data Strategy Houston Roadshow Presentation
 
Establishing data sharing standards to promote global industry development
Establishing data sharing standards to promote global industry developmentEstablishing data sharing standards to promote global industry development
Establishing data sharing standards to promote global industry development
 
Towards a distributed framework to analyze multimodal data.pdf
Towards a distributed framework to analyze multimodal data.pdfTowards a distributed framework to analyze multimodal data.pdf
Towards a distributed framework to analyze multimodal data.pdf
 
Harvesting&Metadata Enrich Project EVA 2009
Harvesting&Metadata Enrich Project   EVA 2009Harvesting&Metadata Enrich Project   EVA 2009
Harvesting&Metadata Enrich Project EVA 2009
 
Autonomous Vehicles And Software Architectures Essay
Autonomous Vehicles And Software Architectures EssayAutonomous Vehicles And Software Architectures Essay
Autonomous Vehicles And Software Architectures Essay
 
Leveraging a big data model in the IT domain
Leveraging a big data model in the IT domainLeveraging a big data model in the IT domain
Leveraging a big data model in the IT domain
 
Sdmx2 context
Sdmx2 contextSdmx2 context
Sdmx2 context
 
Webinar Industrial Data Space Association: Introduction and Architecture
Webinar Industrial Data Space Association: Introduction and ArchitectureWebinar Industrial Data Space Association: Introduction and Architecture
Webinar Industrial Data Space Association: Introduction and Architecture
 
Anomalous symmetry succession for seek out
Anomalous symmetry succession for seek outAnomalous symmetry succession for seek out
Anomalous symmetry succession for seek out
 
The potential of the cloud
The potential of the cloudThe potential of the cloud
The potential of the cloud
 
Data Virtualization: Introduction and Business Value (UK)
Data Virtualization: Introduction and Business Value (UK)Data Virtualization: Introduction and Business Value (UK)
Data Virtualization: Introduction and Business Value (UK)
 
Data management plans – EUDAT Best practices and case study | www.eudat.eu
Data management plans – EUDAT Best practices and case study | www.eudat.euData management plans – EUDAT Best practices and case study | www.eudat.eu
Data management plans – EUDAT Best practices and case study | www.eudat.eu
 
MFX P&C Insurance Analytics
MFX P&C Insurance AnalyticsMFX P&C Insurance Analytics
MFX P&C Insurance Analytics
 

Mehr von Vincenzo Patruno

AUMENTARE IL VALORE DEI DATI DELLA STATISTICA PUBBLICA
AUMENTARE IL VALORE DEI DATI DELLA STATISTICA PUBBLICAAUMENTARE IL VALORE DEI DATI DELLA STATISTICA PUBBLICA
AUMENTARE IL VALORE DEI DATI DELLA STATISTICA PUBBLICAVincenzo Patruno
 
Dati pubblici per capire la pandemia
Dati pubblici per capire  la pandemiaDati pubblici per capire  la pandemia
Dati pubblici per capire la pandemiaVincenzo Patruno
 
I dati per capire le emergenze
I dati per capire le emergenzeI dati per capire le emergenze
I dati per capire le emergenzeVincenzo Patruno
 
L'importanza degli Open Data per il monitoraggio della spesa pubblica
L'importanza degli Open Data per il monitoraggio della spesa pubblicaL'importanza degli Open Data per il monitoraggio della spesa pubblica
L'importanza degli Open Data per il monitoraggio della spesa pubblicaVincenzo Patruno
 
La statistica ufficiale e i trasporti marittimi nell'era dei Big Data
La statistica ufficiale e i trasporti marittimi nell'era dei Big DataLa statistica ufficiale e i trasporti marittimi nell'era dei Big Data
La statistica ufficiale e i trasporti marittimi nell'era dei Big DataVincenzo Patruno
 
Aumentare le potenzialità degli Open Data tra spazio e tempo
Aumentare le potenzialità degli Open Data tra spazio e tempoAumentare le potenzialità degli Open Data tra spazio e tempo
Aumentare le potenzialità degli Open Data tra spazio e tempoVincenzo Patruno
 
Hacking civico e Smart Citizen. Chi abita la Smart City?
Hacking civico e Smart Citizen. Chi abita la Smart City?Hacking civico e Smart Citizen. Chi abita la Smart City?
Hacking civico e Smart Citizen. Chi abita la Smart City?Vincenzo Patruno
 
Open Data: come trattarli e visualizzarli quando diventano Big
Open Data: come trattarli e visualizzarli quando diventano BigOpen Data: come trattarli e visualizzarli quando diventano Big
Open Data: come trattarli e visualizzarli quando diventano BigVincenzo Patruno
 
Riusare i dati del turismo per generare valore
Riusare i dati del turismo per generare valoreRiusare i dati del turismo per generare valore
Riusare i dati del turismo per generare valoreVincenzo Patruno
 
Il valore dei dati, le politiche e le strategie di gestione degli stessi e le...
Il valore dei dati, le politiche e le strategie di gestione degli stessi e le...Il valore dei dati, le politiche e le strategie di gestione degli stessi e le...
Il valore dei dati, le politiche e le strategie di gestione degli stessi e le...Vincenzo Patruno
 
Open Data – i benefici per i cittadini, le imprese e la PA
Open Data – i benefici per i cittadini, le imprese e la PAOpen Data – i benefici per i cittadini, le imprese e la PA
Open Data – i benefici per i cittadini, le imprese e la PAVincenzo Patruno
 
Big Data e Open Data per monitorare la città
Big Data e Open Data per monitorare la cittàBig Data e Open Data per monitorare la città
Big Data e Open Data per monitorare la cittàVincenzo Patruno
 
L’innovazione dei dati, dei big data e degli open data
L’innovazione dei dati, dei big data e degli open dataL’innovazione dei dati, dei big data e degli open data
L’innovazione dei dati, dei big data e degli open dataVincenzo Patruno
 
Dati geografici e indicatori territoriali: Il ruolo delle comunità
Dati geografici e indicatori territoriali: Il ruolo delle comunitàDati geografici e indicatori territoriali: Il ruolo delle comunità
Dati geografici e indicatori territoriali: Il ruolo delle comunitàVincenzo Patruno
 
Connettere le applicazioni ai dati. Cosa sono le API, come si utilizzano e p...
Connettere le applicazioni ai dati.  Cosa sono le API, come si utilizzano e p...Connettere le applicazioni ai dati.  Cosa sono le API, come si utilizzano e p...
Connettere le applicazioni ai dati. Cosa sono le API, come si utilizzano e p...Vincenzo Patruno
 
Il valore degli #opendata. Esperienze a confronto
Il valore degli #opendata. Esperienze a confrontoIl valore degli #opendata. Esperienze a confronto
Il valore degli #opendata. Esperienze a confrontoVincenzo Patruno
 
Open Data e le opportunità per il territorio
Open Data e le opportunità per il territorioOpen Data e le opportunità per il territorio
Open Data e le opportunità per il territorioVincenzo Patruno
 
ISTAT: la strategia Open Data e il framework SDMX per lo scambio di dati stat...
ISTAT: la strategia Open Data e il framework SDMX per lo scambio di dati stat...ISTAT: la strategia Open Data e il framework SDMX per lo scambio di dati stat...
ISTAT: la strategia Open Data e il framework SDMX per lo scambio di dati stat...Vincenzo Patruno
 

Mehr von Vincenzo Patruno (20)

Perché aprire i dati
Perché aprire i datiPerché aprire i dati
Perché aprire i dati
 
AUMENTARE IL VALORE DEI DATI DELLA STATISTICA PUBBLICA
AUMENTARE IL VALORE DEI DATI DELLA STATISTICA PUBBLICAAUMENTARE IL VALORE DEI DATI DELLA STATISTICA PUBBLICA
AUMENTARE IL VALORE DEI DATI DELLA STATISTICA PUBBLICA
 
Dati pubblici per capire la pandemia
Dati pubblici per capire  la pandemiaDati pubblici per capire  la pandemia
Dati pubblici per capire la pandemia
 
I dati per capire le emergenze
I dati per capire le emergenzeI dati per capire le emergenze
I dati per capire le emergenze
 
L'importanza degli Open Data per il monitoraggio della spesa pubblica
L'importanza degli Open Data per il monitoraggio della spesa pubblicaL'importanza degli Open Data per il monitoraggio della spesa pubblica
L'importanza degli Open Data per il monitoraggio della spesa pubblica
 
La statistica ufficiale e i trasporti marittimi nell'era dei Big Data
La statistica ufficiale e i trasporti marittimi nell'era dei Big DataLa statistica ufficiale e i trasporti marittimi nell'era dei Big Data
La statistica ufficiale e i trasporti marittimi nell'era dei Big Data
 
Aumentare le potenzialità degli Open Data tra spazio e tempo
Aumentare le potenzialità degli Open Data tra spazio e tempoAumentare le potenzialità degli Open Data tra spazio e tempo
Aumentare le potenzialità degli Open Data tra spazio e tempo
 
Hacking civico e Smart Citizen. Chi abita la Smart City?
Hacking civico e Smart Citizen. Chi abita la Smart City?Hacking civico e Smart Citizen. Chi abita la Smart City?
Hacking civico e Smart Citizen. Chi abita la Smart City?
 
Open Data: come trattarli e visualizzarli quando diventano Big
Open Data: come trattarli e visualizzarli quando diventano BigOpen Data: come trattarli e visualizzarli quando diventano Big
Open Data: come trattarli e visualizzarli quando diventano Big
 
Il valore dei dati
Il valore dei datiIl valore dei dati
Il valore dei dati
 
Riusare i dati del turismo per generare valore
Riusare i dati del turismo per generare valoreRiusare i dati del turismo per generare valore
Riusare i dati del turismo per generare valore
 
Il valore dei dati, le politiche e le strategie di gestione degli stessi e le...
Il valore dei dati, le politiche e le strategie di gestione degli stessi e le...Il valore dei dati, le politiche e le strategie di gestione degli stessi e le...
Il valore dei dati, le politiche e le strategie di gestione degli stessi e le...
 
Open Data – i benefici per i cittadini, le imprese e la PA
Open Data – i benefici per i cittadini, le imprese e la PAOpen Data – i benefici per i cittadini, le imprese e la PA
Open Data – i benefici per i cittadini, le imprese e la PA
 
Big Data e Open Data per monitorare la città
Big Data e Open Data per monitorare la cittàBig Data e Open Data per monitorare la città
Big Data e Open Data per monitorare la città
 
L’innovazione dei dati, dei big data e degli open data
L’innovazione dei dati, dei big data e degli open dataL’innovazione dei dati, dei big data e degli open data
L’innovazione dei dati, dei big data e degli open data
 
Dati geografici e indicatori territoriali: Il ruolo delle comunità
Dati geografici e indicatori territoriali: Il ruolo delle comunitàDati geografici e indicatori territoriali: Il ruolo delle comunità
Dati geografici e indicatori territoriali: Il ruolo delle comunità
 
Connettere le applicazioni ai dati. Cosa sono le API, come si utilizzano e p...
Connettere le applicazioni ai dati.  Cosa sono le API, come si utilizzano e p...Connettere le applicazioni ai dati.  Cosa sono le API, come si utilizzano e p...
Connettere le applicazioni ai dati. Cosa sono le API, come si utilizzano e p...
 
Il valore degli #opendata. Esperienze a confronto
Il valore degli #opendata. Esperienze a confrontoIl valore degli #opendata. Esperienze a confronto
Il valore degli #opendata. Esperienze a confronto
 
Open Data e le opportunità per il territorio
Open Data e le opportunità per il territorioOpen Data e le opportunità per il territorio
Open Data e le opportunità per il territorio
 
ISTAT: la strategia Open Data e il framework SDMX per lo scambio di dati stat...
ISTAT: la strategia Open Data e il framework SDMX per lo scambio di dati stat...ISTAT: la strategia Open Data e il framework SDMX per lo scambio di dati stat...
ISTAT: la strategia Open Data e il framework SDMX per lo scambio di dati stat...
 

Kürzlich hochgeladen

Building AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxBuilding AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxUdaiappa Ramachandran
 
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfIaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfDaniel Santiago Silva Capera
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaborationbruanjhuli
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IES VE
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdfPedro Manuel
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostMatt Ray
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URLRuncy Oommen
 
AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarPrecisely
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioChristian Posta
 
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Will Schroeder
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsSeth Reyes
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Adtran
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureEric D. Schabell
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Websitedgelyza
 
Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.YounusS2
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7DianaGray10
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesMd Hossain Ali
 
NIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopNIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopBachir Benyammi
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemAsko Soukka
 

Kürzlich hochgeladen (20)

Building AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxBuilding AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptx
 
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfIaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
 
201610817 - edge part1
201610817 - edge part1201610817 - edge part1
201610817 - edge part1
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdf
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URL
 
AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity Webinar
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and Istio
 
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and Hazards
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability Adventure
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Website
 
Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
 
NIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopNIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 Workshop
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystem
 

Formats and Tools for Data Transmission

  • 1. Formats and Tools for Data Trasmission Vincenzo PATRUNO Pristina, Kosovo 7, 8 Dec 2009
  • 2. EDAMIS Web Application (EWA) EDAMIS Web Portal (EWP) EDAMIS Web Form (EWF)
  • 3. Formats for data Transmission Gesmes
  • 4. Data Repository (Warehousing) Architecture Francesco Rizzo - Eurostat NSI Eurostat Pull Requestor eDAMIS Data Input SDMX Registry Intermediate storage Verification / Conversion To SDMX Received data in SDMX-ML Loader register Warehouse storage Eurobase query Dissemination XSL for SDMX-ML P U L L P U S H
  • 6. PUSH & PULL We have normally two different approach to exchange data: PUSH and PULL
  • 7. PUSH & PULL PUSH mode means that the data provider takes action to send the data to the party collecting the data. PULL mode implies that the data provider makes the data available via the Internet. The data consumer then fetches the data on his own initiative.
  • 8.
  • 9. SDMX SDMX promotes a “ data sharing ” model to facilitate low-cost, high-quality statistical data and metadata exchange. Data Providers publishes the availability of data/metadata to Data Consumers and the latter are responsible for fetching the data/metadata at will. .
  • 10. Query SDMX Data SDMX-ML RSS WS NSI Data Sharing Model
  • 11. Data Hub Architecture Francesco Rizzo - Eurostat NSI NSI NSI NSI SDMX Registry RSS / data registration Dissemination XSL for SDMX-ML Data Portal Query Data query Response Retrieve dataset cache
  • 13.
  • 15.
  • 16.
  • 17. Collective intelligence is a shared or group intelligence that emerges from the collaboration and competition of many individuals The Collective Intelligence
  • 18.  
  • 19. We are already in the future Thank You for your attention [email_address]

Hinweis der Redaktion

  1. the Single Entry Point allows both push and pull methods. eDAMIS: is now able to recognise and deliver SDMX-ML files an SDMX-ML module for representing validation rules was developed and it is used by the eDAMIS validation engine. the conceptual extension to the SDMX-IM and its XML implementation will be submitted to the SDMX sponsoring organisations for conformance testing and approval. The pull approach concerns the following steps: Step 1: when new data are available, the NSI should: Create an SDMX-ML file containing the new data, or Do nothing if the NSI WS builds SDMX-ML messages upon request Step 2: the NSI should add a new feed entry, including an SDMX-ML Query message describing the new Dataset, to the NSI feed the Pull Requestor reads the new feed entry and: Retrieves the SDMX-ML file from the specified URL, if it resides in a URL, or Uses the Query Message included in the feed to query the NSI WS, if the data are prepared by the NSI WS The Pull Requestor forwards the SDMX-ML dataset to the rest of the modules within Eurostat production environment
  2. UN Statistical Commission 02/2008: SDMX is recognized as “the preferred standard for exchange and sharing of data and metadata in the global statistical community” Further involving national and international statistical agencies Importance of capacity building and outreach (webpage, seminars, workshops, training…) More freely available IT tools……. The focus of SDMX is exchange and sharing of aggregated statistical data (also called macro data) rather than observations of individual statistical units (also called microdata) but in many cases it can be used for microdata. The basic structure of aggregated statistical data is a multidimensional table (also called a cube). Often, but not always, one of the dimensions is time (or reference time), i.e. the time periods or points in time to which the aggregate data refer. The time dimension is often equidistant, having a certain frequency, e.g. yearly or monthly. In such cases, the multidimensional table may be viewed as consisting of a number of time series, each of them being defined by one specific value (member) of each of the other dimensions. Data sharing based on the SDMX reduces the reporting burden of organisations. Allows them to publish data once and let their counterparties “pull” data and related metadata as required. This achieved with the availability of an abstract I nformation M odel capable of supporting any time-series and cross-sectional data, structural metadata and reference metadata (SDMX-IM) standardised XML schemas derived from the model (SDMX-ML) the use of web-services technology. Data sharing process is based on an architecture of central registry services. Registry services provide visibility into the data and metadata existing within the community and support the access and use of this data and metadata by providing a set of triggers for automated processing. The use of standards for all data, metadata, and the registry services themselves is ubiquitous, permitting a high level of automation within a data-sharing community.
  3. Data sharing a group of partners agree on providing access to their data according to standard processes, formats and technologies Data providers can: notify the hub of new sets of data and corresponding structural metadata (measures, dimension, code lists, etc.); make data available directly from their systems through a querying system; Data users can browse the hub to define a dataset of interest via the above structural metadata; retrieve the dataset from the NSIs.