SlideShare ist ein Scribd-Unternehmen logo
1 von 25
Downloaden Sie, um offline zu lesen
Data Intensive Engineering


 Xosé Manuel Carreira Rodríguez
http://www.linkedin.com/in/carreira
        13th December 2012
BRIEF



• In this presentation the possible use of the big
  data technologies in the civil engineering is
  overviewed.
“…probably indicates that these sectors face
 strong systemic barriers to increasing
productivity”
We collect enough data.
  We need to focus on
       1- connecting
 2 – identifying patterns
3- giving confidence level

                       Multiple data sources:

                       Books
                       Experts in the field
                       Information systems
                       Tests and surveying
                       Data repositories
                       Real time sensors
Data quality



• Processing is cheap and access is easy, the
  big problem is data quality.
• Considerable research but highly
  fragmented
Classic definition of Data Quality

• Accuracy
  – The data was recorded correctly.
• Completeness
  – All relevant data was recorded.
• Uniqueness
  – Entities are recorded once.
• Timeliness
  – The data is kept up to date.
     • Special problems in federated data: time consistency.
• Consistency
  – The data agrees with itself.
Finding a modern definition
• Data quality must
  – Reflect the use of the data
  – Lead to improvements in processes
  – Be measurable



• No silver bullets: Use several data quality
  metrics.
What is the problem to solve?
• Do you have a bunch of data and want to:
  – Estimate an unknown parameter from it?
     • True rainfall based on radar observations?
     • Amount of liquid content from in-situ measurements of
       temperature, pressure, etc?
     • Regression
  – Classify what the data correspond to?
     • A water surge?
     • A temperature inversion?
     • A boundary?
     • Classification
• Regression and classification aren’t that
  different                                               11
Case 1: Neural networks for flood
• Neural networks modelling of the rainfall-runoff
  relationship




• No physical model, just data driven model.
• Result: flow forecasting
Case 1: Neural networks for flood




• Input: several past rain gauges
  and flow gauges
• Result: Flow model
Case 1: Neural networks for flood




Training with 1st (larger) set of data
Case 1: Neural networks for flood




Verification with 2nd (smaller) set of data
Simulation
  sample
How can IT help in maintenance ?
• Information Technology has also found applications in
  post commission period of the project.

• IT can provide easy access to various statistics, drawing
  & various other data concerning the project.

• Self check tools can identify the problems in various
  systems like fire fighting, air conditioning & can
  automatically inform concerned service provider.

• IT can also help in prompt reporting of problem & its
  rectification.
Case 2: Bridge Management Systems

• Double click on the
  icon on your desktop



  – Introductory screen is
    displayed
  – Click OK button to
    continue to the Data
    collection form


                                       Page 18
Connecting
Bridge
Management
Systems
to
Asset
Management

             U.S. Department of Transportation
             Federal Highway Administration
Bridges in the U.S.
25% are structurally or functionally deficient
according to ASCE


 140000
 120000
 100000
  80000
  60000
  40000
  20000
     0
          Pre-1909


                      10s


                            20s


                                  30s


                                        40s


                                              50s


                                                    60s


                                                          70s


                                                                80s


                                                                      90s
                     Bridge Construction by Decade
Case 2: Bridge Management Systems
   Typical BMS Expectations
   A tool to evaluate:

   •   Bridge condition and serviceability
   •   Implications of project decisions
   •   Priorities and schedules
   •   Expected budget
   •   Cost of alternative standards
   •   Value of preventive maintenance
You can run a company from a coffee shop
Why not a lab or a civil infraestructure?
Desktop PCs are idle half the day




Desktop PCs tend to be active   But at night, during most of
during the workday.             the year, they’re idle. So
                                we’re only getting half their
                                value (or less).




                                                                24
Finally ,
          it is argued that IT can readily be
used by civil engineers given the low
capital investment levels required.

The “only” requirement is investment in
education among the civil engineers &
recognition of the enormous potential
lying beneath.

Weitere ähnliche Inhalte

Andere mochten auch

Mano miestas Tokijus
Mano miestas TokijusMano miestas Tokijus
Mano miestas Tokijustokyo18
 
第7章 语法制导翻译和中间代码生成
第7章 语法制导翻译和中间代码生成第7章 语法制导翻译和中间代码生成
第7章 语法制导翻译和中间代码生成tjpucompiler
 
Blog pp cultural diversity
Blog pp cultural diversityBlog pp cultural diversity
Blog pp cultural diversityPaulineHeadley
 
PresCare Annual Report 2012-13
PresCare Annual Report 2012-13PresCare Annual Report 2012-13
PresCare Annual Report 2012-13James Woods
 
動畫表演
動畫表演動畫表演
動畫表演zi_yong
 
Catalunya 77 Juliol-agost 2006
Catalunya 77 Juliol-agost 2006 Catalunya 77 Juliol-agost 2006
Catalunya 77 Juliol-agost 2006 Revista Catalunya
 
د _______ _د_____ç_د_خ_è _____ث___â_د__ _د___ç___»___è_ر
 د _______ _د_____ç_د_خ_è _____ث___â_د__ _د___ç___»___è_ر د _______ _د_____ç_د_خ_è _____ث___â_د__ _د___ç___»___è_ر
د _______ _د_____ç_د_خ_è _____ث___â_د__ _د___ç___»___è_رrawan102
 

Andere mochten auch (15)

Mano miestas Tokijus
Mano miestas TokijusMano miestas Tokijus
Mano miestas Tokijus
 
Houston
HoustonHouston
Houston
 
Chapter15 pp ts
Chapter15 pp tsChapter15 pp ts
Chapter15 pp ts
 
конкурс рмо
конкурс рмоконкурс рмо
конкурс рмо
 
File 1
File 1File 1
File 1
 
第7章 语法制导翻译和中间代码生成
第7章 语法制导翻译和中间代码生成第7章 语法制导翻译和中间代码生成
第7章 语法制导翻译和中间代码生成
 
Blog pp cultural diversity
Blog pp cultural diversityBlog pp cultural diversity
Blog pp cultural diversity
 
Tic angela
Tic angelaTic angela
Tic angela
 
PresCare Annual Report 2012-13
PresCare Annual Report 2012-13PresCare Annual Report 2012-13
PresCare Annual Report 2012-13
 
動畫表演
動畫表演動畫表演
動畫表演
 
Catalunya 77 Juliol-agost 2006
Catalunya 77 Juliol-agost 2006 Catalunya 77 Juliol-agost 2006
Catalunya 77 Juliol-agost 2006
 
د _______ _د_____ç_د_خ_è _____ث___â_د__ _د___ç___»___è_ر
 د _______ _د_____ç_د_خ_è _____ث___â_د__ _د___ç___»___è_ر د _______ _د_____ç_د_خ_è _____ث___â_د__ _د___ç___»___è_ر
د _______ _د_____ç_د_خ_è _____ث___â_د__ _د___ç___»___è_ر
 
Artefact Proposal
Artefact ProposalArtefact Proposal
Artefact Proposal
 
K401 L2
K401 L2K401 L2
K401 L2
 
Gamze bilg ödevi
Gamze bilg ödeviGamze bilg ödevi
Gamze bilg ödevi
 

Ähnlich wie Data Intensive Engineering

DeployingAnAdvancedDistribution.pdf
DeployingAnAdvancedDistribution.pdfDeployingAnAdvancedDistribution.pdf
DeployingAnAdvancedDistribution.pdfbayu162365
 
Research Methodology Presentation - Research in Supply Chain Digital Twins
Research Methodology Presentation - Research in Supply Chain Digital TwinsResearch Methodology Presentation - Research in Supply Chain Digital Twins
Research Methodology Presentation - Research in Supply Chain Digital TwinsArwa Abougharib
 
Re-Engineering Engineering
Re-Engineering EngineeringRe-Engineering Engineering
Re-Engineering EngineeringIben Rodriguez
 
Visualizing Your Network Health - Driving Visibility in Increasingly Complex...
Visualizing Your Network Health -  Driving Visibility in Increasingly Complex...Visualizing Your Network Health -  Driving Visibility in Increasingly Complex...
Visualizing Your Network Health - Driving Visibility in Increasingly Complex...DellNMS
 
Network Centric Cloud: Competing in a IT World with a Telecom Approach
Network Centric Cloud: Competing in a IT World with a Telecom ApproachNetwork Centric Cloud: Competing in a IT World with a Telecom Approach
Network Centric Cloud: Competing in a IT World with a Telecom ApproachEduardo Mendez Polo
 
Barga ACM DEBS 2013 Keynote
Barga ACM DEBS 2013 KeynoteBarga ACM DEBS 2013 Keynote
Barga ACM DEBS 2013 KeynoteRoger Barga
 
The New Role of Data in the Changing Energy & Utilities Landscape
The New Role of Data in the Changing Energy & Utilities LandscapeThe New Role of Data in the Changing Energy & Utilities Landscape
The New Role of Data in the Changing Energy & Utilities LandscapeDenodo
 
Cloud Billing: Enabling consumers for pay for what they use
Cloud Billing: Enabling consumers for pay for what they useCloud Billing: Enabling consumers for pay for what they use
Cloud Billing: Enabling consumers for pay for what they useEduardo Mendez Polo
 
Elastic Software Infrastructure to Support the Industrial Internet
Elastic Software Infrastructure to Support the Industrial InternetElastic Software Infrastructure to Support the Industrial Internet
Elastic Software Infrastructure to Support the Industrial InternetReal-Time Innovations (RTI)
 
Visualizing Your Network Health - Know your Network
Visualizing Your Network Health - Know your NetworkVisualizing Your Network Health - Know your Network
Visualizing Your Network Health - Know your NetworkDellNMS
 
Cloud computing
Cloud computingCloud computing
Cloud computingAmit Kumar
 
Data Con LA 2022 - Building Field-level Lineage from Scratch for Modern Data ...
Data Con LA 2022 - Building Field-level Lineage from Scratch for Modern Data ...Data Con LA 2022 - Building Field-level Lineage from Scratch for Modern Data ...
Data Con LA 2022 - Building Field-level Lineage from Scratch for Modern Data ...Data Con LA
 
Harnessing Big Data_UCLA
Harnessing Big Data_UCLAHarnessing Big Data_UCLA
Harnessing Big Data_UCLAPaul Barsch
 
IRJET - A Research on Eloquent Salvation and Productive Outsourcing of Massiv...
IRJET - A Research on Eloquent Salvation and Productive Outsourcing of Massiv...IRJET - A Research on Eloquent Salvation and Productive Outsourcing of Massiv...
IRJET - A Research on Eloquent Salvation and Productive Outsourcing of Massiv...IRJET Journal
 
AI4SE: Challenges and opportunities in the integration of Systems Engineering...
AI4SE: Challenges and opportunities in the integration of Systems Engineering...AI4SE: Challenges and opportunities in the integration of Systems Engineering...
AI4SE: Challenges and opportunities in the integration of Systems Engineering...CARLOS III UNIVERSITY OF MADRID
 
Models Done Better... - UDG2018 - Intertek and DHI
Models Done Better... - UDG2018 - Intertek and DHIModels Done Better... - UDG2018 - Intertek and DHI
Models Done Better... - UDG2018 - Intertek and DHIStephen Flood
 
UK Data Centre Capabilty Presentation Rev.A
UK Data Centre Capabilty Presentation Rev.AUK Data Centre Capabilty Presentation Rev.A
UK Data Centre Capabilty Presentation Rev.AGary Marshall
 
Enerji Sektöründe Endüstriyel IoT Uygulamaları - Şahin Çağlayan (Reengen)
Enerji Sektöründe Endüstriyel IoT Uygulamaları - Şahin Çağlayan (Reengen)Enerji Sektöründe Endüstriyel IoT Uygulamaları - Şahin Çağlayan (Reengen)
Enerji Sektöründe Endüstriyel IoT Uygulamaları - Şahin Çağlayan (Reengen)ideaport
 
System Level Data and Technology Requirements of REV
System Level Data and Technology Requirements of REV System Level Data and Technology Requirements of REV
System Level Data and Technology Requirements of REV Smarter Grid Solutions
 

Ähnlich wie Data Intensive Engineering (20)

DeployingAnAdvancedDistribution.pdf
DeployingAnAdvancedDistribution.pdfDeployingAnAdvancedDistribution.pdf
DeployingAnAdvancedDistribution.pdf
 
Research Methodology Presentation - Research in Supply Chain Digital Twins
Research Methodology Presentation - Research in Supply Chain Digital TwinsResearch Methodology Presentation - Research in Supply Chain Digital Twins
Research Methodology Presentation - Research in Supply Chain Digital Twins
 
Re-Engineering Engineering
Re-Engineering EngineeringRe-Engineering Engineering
Re-Engineering Engineering
 
Visualizing Your Network Health - Driving Visibility in Increasingly Complex...
Visualizing Your Network Health -  Driving Visibility in Increasingly Complex...Visualizing Your Network Health -  Driving Visibility in Increasingly Complex...
Visualizing Your Network Health - Driving Visibility in Increasingly Complex...
 
Network Centric Cloud: Competing in a IT World with a Telecom Approach
Network Centric Cloud: Competing in a IT World with a Telecom ApproachNetwork Centric Cloud: Competing in a IT World with a Telecom Approach
Network Centric Cloud: Competing in a IT World with a Telecom Approach
 
Barga ACM DEBS 2013 Keynote
Barga ACM DEBS 2013 KeynoteBarga ACM DEBS 2013 Keynote
Barga ACM DEBS 2013 Keynote
 
The New Role of Data in the Changing Energy & Utilities Landscape
The New Role of Data in the Changing Energy & Utilities LandscapeThe New Role of Data in the Changing Energy & Utilities Landscape
The New Role of Data in the Changing Energy & Utilities Landscape
 
Cloud Billing: Enabling consumers for pay for what they use
Cloud Billing: Enabling consumers for pay for what they useCloud Billing: Enabling consumers for pay for what they use
Cloud Billing: Enabling consumers for pay for what they use
 
Elastic Software Infrastructure to Support the Industrial Internet
Elastic Software Infrastructure to Support the Industrial InternetElastic Software Infrastructure to Support the Industrial Internet
Elastic Software Infrastructure to Support the Industrial Internet
 
Visualizing Your Network Health - Know your Network
Visualizing Your Network Health - Know your NetworkVisualizing Your Network Health - Know your Network
Visualizing Your Network Health - Know your Network
 
Cloud computing
Cloud computingCloud computing
Cloud computing
 
Data Con LA 2022 - Building Field-level Lineage from Scratch for Modern Data ...
Data Con LA 2022 - Building Field-level Lineage from Scratch for Modern Data ...Data Con LA 2022 - Building Field-level Lineage from Scratch for Modern Data ...
Data Con LA 2022 - Building Field-level Lineage from Scratch for Modern Data ...
 
Harnessing Big Data_UCLA
Harnessing Big Data_UCLAHarnessing Big Data_UCLA
Harnessing Big Data_UCLA
 
IRJET - A Research on Eloquent Salvation and Productive Outsourcing of Massiv...
IRJET - A Research on Eloquent Salvation and Productive Outsourcing of Massiv...IRJET - A Research on Eloquent Salvation and Productive Outsourcing of Massiv...
IRJET - A Research on Eloquent Salvation and Productive Outsourcing of Massiv...
 
AI4SE: Challenges and opportunities in the integration of Systems Engineering...
AI4SE: Challenges and opportunities in the integration of Systems Engineering...AI4SE: Challenges and opportunities in the integration of Systems Engineering...
AI4SE: Challenges and opportunities in the integration of Systems Engineering...
 
Models Done Better... - UDG2018 - Intertek and DHI
Models Done Better... - UDG2018 - Intertek and DHIModels Done Better... - UDG2018 - Intertek and DHI
Models Done Better... - UDG2018 - Intertek and DHI
 
Shikha fdp 62_14july2017
Shikha fdp 62_14july2017Shikha fdp 62_14july2017
Shikha fdp 62_14july2017
 
UK Data Centre Capabilty Presentation Rev.A
UK Data Centre Capabilty Presentation Rev.AUK Data Centre Capabilty Presentation Rev.A
UK Data Centre Capabilty Presentation Rev.A
 
Enerji Sektöründe Endüstriyel IoT Uygulamaları - Şahin Çağlayan (Reengen)
Enerji Sektöründe Endüstriyel IoT Uygulamaları - Şahin Çağlayan (Reengen)Enerji Sektöründe Endüstriyel IoT Uygulamaları - Şahin Çağlayan (Reengen)
Enerji Sektöründe Endüstriyel IoT Uygulamaları - Şahin Çağlayan (Reengen)
 
System Level Data and Technology Requirements of REV
System Level Data and Technology Requirements of REV System Level Data and Technology Requirements of REV
System Level Data and Technology Requirements of REV
 

Kürzlich hochgeladen

Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...gurkirankumar98700
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Paola De la Torre
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersThousandEyes
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024Results
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 

Kürzlich hochgeladen (20)

Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 

Data Intensive Engineering

  • 1. Data Intensive Engineering Xosé Manuel Carreira Rodríguez http://www.linkedin.com/in/carreira 13th December 2012
  • 2. BRIEF • In this presentation the possible use of the big data technologies in the civil engineering is overviewed.
  • 3.
  • 4.
  • 5.
  • 6. “…probably indicates that these sectors face strong systemic barriers to increasing productivity”
  • 7. We collect enough data. We need to focus on 1- connecting 2 – identifying patterns 3- giving confidence level Multiple data sources: Books Experts in the field Information systems Tests and surveying Data repositories Real time sensors
  • 8. Data quality • Processing is cheap and access is easy, the big problem is data quality. • Considerable research but highly fragmented
  • 9. Classic definition of Data Quality • Accuracy – The data was recorded correctly. • Completeness – All relevant data was recorded. • Uniqueness – Entities are recorded once. • Timeliness – The data is kept up to date. • Special problems in federated data: time consistency. • Consistency – The data agrees with itself.
  • 10. Finding a modern definition • Data quality must – Reflect the use of the data – Lead to improvements in processes – Be measurable • No silver bullets: Use several data quality metrics.
  • 11. What is the problem to solve? • Do you have a bunch of data and want to: – Estimate an unknown parameter from it? • True rainfall based on radar observations? • Amount of liquid content from in-situ measurements of temperature, pressure, etc? • Regression – Classify what the data correspond to? • A water surge? • A temperature inversion? • A boundary? • Classification • Regression and classification aren’t that different 11
  • 12. Case 1: Neural networks for flood • Neural networks modelling of the rainfall-runoff relationship • No physical model, just data driven model. • Result: flow forecasting
  • 13. Case 1: Neural networks for flood • Input: several past rain gauges and flow gauges • Result: Flow model
  • 14. Case 1: Neural networks for flood Training with 1st (larger) set of data
  • 15. Case 1: Neural networks for flood Verification with 2nd (smaller) set of data
  • 17. How can IT help in maintenance ? • Information Technology has also found applications in post commission period of the project. • IT can provide easy access to various statistics, drawing & various other data concerning the project. • Self check tools can identify the problems in various systems like fire fighting, air conditioning & can automatically inform concerned service provider. • IT can also help in prompt reporting of problem & its rectification.
  • 18. Case 2: Bridge Management Systems • Double click on the icon on your desktop – Introductory screen is displayed – Click OK button to continue to the Data collection form Page 18
  • 19. Connecting Bridge Management Systems to Asset Management U.S. Department of Transportation Federal Highway Administration
  • 20. Bridges in the U.S. 25% are structurally or functionally deficient according to ASCE 140000 120000 100000 80000 60000 40000 20000 0 Pre-1909 10s 20s 30s 40s 50s 60s 70s 80s 90s Bridge Construction by Decade
  • 21. Case 2: Bridge Management Systems Typical BMS Expectations A tool to evaluate: • Bridge condition and serviceability • Implications of project decisions • Priorities and schedules • Expected budget • Cost of alternative standards • Value of preventive maintenance
  • 22. You can run a company from a coffee shop
  • 23. Why not a lab or a civil infraestructure?
  • 24. Desktop PCs are idle half the day Desktop PCs tend to be active But at night, during most of during the workday. the year, they’re idle. So we’re only getting half their value (or less). 24
  • 25. Finally , it is argued that IT can readily be used by civil engineers given the low capital investment levels required. The “only” requirement is investment in education among the civil engineers & recognition of the enormous potential lying beneath.