SlideShare ist ein Scribd-Unternehmen logo
1 von 22
Downloaden Sie, um offline zu lesen
Saving Energy in Homes with a
Unified Approach to Data and AI
@Dr_Galsworthy
@QubyEnergy
We believe that the future can be better.
Easier, more comfortable, and more sustainable
without compromising on the important things in life.
Worldwide annual energy consumption
109,136,000,000,000 kWh
Source: IEA
109,136,000,000,000 kWh
Worldwide annual energy consumption
Source: IEA
But how much is just wasted?
EU energy saving target for 2030
-32.5%
Source: EU
Source: Eurostat
44%
Households use 44% of all natural gas
and 27% of all electricity in the EU
27%
400,000 connected homes across Europe
Waste Checker
• Efficient appliances expected to save consumers €100 billion annually
by 2020
• We have found that over 40% of household appliances are inefficient or
being used inefficiently
“It looks like you often wash at high
temperatures. Your dishwasher needs
more energy to heat the water.
Washing at 50 degrees, or ECO mode, will
get your utensils just as clean, go ahead
and try it.”
Waste Checker offers personalised advice on
inefficient appliances and behaviours
Source: EU
IoT Data Models Outcomes
Our data-driven services
Central heating
system
Water sensorElectricity sensorGas sensor
IoT Data Models Outcomes
Challenges
1. Over 3 petabytes of IoT data
and rapidly growing
2. Need to process IoT data,
both batch and streaming, in
a reliable and efficient
manner
Terabytes of IoT data daily
Our data-driven services
Challenges
3. Over 1 million unsupervised
models trained daily
4. Struggling to track model
performance and
training/test datasets for a
wide range of algorithms
IoT Data Models Outcomes
DishwasherWashing
machine
Washing
machine
DryerDryer
Patented algorithms
Our data-driven services
Personalised advice
on how to avoid
wasting energy
Challenges
5. Reliable services needed for
hundreds of thousands of
daily users
IoT Data Models Outcomes
Our data-driven services
Our unified data analytics setup
Ingestion of data
from multiple
sources
Our unified data analytics setup
Batch and
streaming on
the same data
Our unified data analytics setup
Scalable pipelines to
support reliable
production services
Our unified data analytics setup
Central place to develop
new algorithms and use
cases, quickly and cost
effectively
Our unified data analytics setup
Unified data analytics is powering Quby’s
transformation into a AI-first company
• Collaboration by multiple groups on same platform
• Data scientists, data engineers, BI analysts, developers,
infra and customer support
• Data team adding more value: less time on infrastructure
• Typical data engineering to scientist ratio = 5:1
• Quby’s ratio DE:MLE:DS = 1:1:1
• Faster development cycles
• Our first data service > 12 months
• Quby now < 8 weeks
Explore a machine learning engineer’s perspective
Wednesday
Saving energy in homes across Europe
• In the last 12 months:
• 87 million inefficient appliance cycles identified
• 67,000,000 kWh of wastage identified and targeted
• A significant reduction in household energy bills when combined with our smart
thermostat to control heating
• Step-by-step we are enabling the transition to a sustainable energy system
Saving Energy in Homes with Unified Data and AI
Saving Energy in Homes with Unified Data and AI

Weitere ähnliche Inhalte

Was ist angesagt?

The Yellowbrick Impact for MicroStrategy
The Yellowbrick Impact for MicroStrategyThe Yellowbrick Impact for MicroStrategy
The Yellowbrick Impact for MicroStrategyYellowbrick Data
 
Software Engineering for Data Scientists
Software Engineering for Data ScientistsSoftware Engineering for Data Scientists
Software Engineering for Data ScientistsDomino Data Lab
 
Building Data Analytics pipelines in the cloud using serverless technology
Building Data Analytics pipelines in the cloud using serverless technologyBuilding Data Analytics pipelines in the cloud using serverless technology
Building Data Analytics pipelines in the cloud using serverless technologyDomino Data Lab
 
Big Data Day LA 2016/ Hadoop/ Spark/ Kafka track - Panel - Interactive Applic...
Big Data Day LA 2016/ Hadoop/ Spark/ Kafka track - Panel - Interactive Applic...Big Data Day LA 2016/ Hadoop/ Spark/ Kafka track - Panel - Interactive Applic...
Big Data Day LA 2016/ Hadoop/ Spark/ Kafka track - Panel - Interactive Applic...Data Con LA
 
Qubole presentation for the Cleveland Big Data and Hadoop Meetup
Qubole presentation for the Cleveland Big Data and Hadoop Meetup   Qubole presentation for the Cleveland Big Data and Hadoop Meetup
Qubole presentation for the Cleveland Big Data and Hadoop Meetup Qubole
 
Business proposal (2) (1)
Business proposal (2) (1)Business proposal (2) (1)
Business proposal (2) (1)Sparsh Jha
 
Xanadu Big Data Platform Technology BMT@ Rackspace Cloud
Xanadu Big Data Platform Technology BMT@ Rackspace Cloud Xanadu Big Data Platform Technology BMT@ Rackspace Cloud
Xanadu Big Data Platform Technology BMT@ Rackspace Cloud Alex G. Lee, Ph.D. Esq. CLP
 
Architecting a Modern Data Warehouse: Enterprise Must-Haves
Architecting a Modern Data Warehouse: Enterprise Must-HavesArchitecting a Modern Data Warehouse: Enterprise Must-Haves
Architecting a Modern Data Warehouse: Enterprise Must-HavesYellowbrick Data
 
Webinar: SnapLogic Fall 2014 Release Brings iPaaS to the Enterprise
Webinar: SnapLogic Fall 2014 Release Brings iPaaS to the EnterpriseWebinar: SnapLogic Fall 2014 Release Brings iPaaS to the Enterprise
Webinar: SnapLogic Fall 2014 Release Brings iPaaS to the EnterpriseSnapLogic
 
Embedding Insight through Prediction Driven Logistics
Embedding Insight through Prediction Driven LogisticsEmbedding Insight through Prediction Driven Logistics
Embedding Insight through Prediction Driven LogisticsDatabricks
 
Visualisation Meets Virtualisation
Visualisation Meets VirtualisationVisualisation Meets Virtualisation
Visualisation Meets VirtualisationDenodo
 
Counting Unique Users in Real-Time: Here's a Challenge for You!
Counting Unique Users in Real-Time: Here's a Challenge for You!Counting Unique Users in Real-Time: Here's a Challenge for You!
Counting Unique Users in Real-Time: Here's a Challenge for You!DataWorks Summit
 
Hopper energyservices
Hopper energyservicesHopper energyservices
Hopper energyserviceshopperdev
 
Overview of big data in cloud computing
Overview of big data in cloud computingOverview of big data in cloud computing
Overview of big data in cloud computingViet-Trung TRAN
 
How to Take Advantage of an Enterprise Data Warehouse in the Cloud
How to Take Advantage of an Enterprise Data Warehouse in the CloudHow to Take Advantage of an Enterprise Data Warehouse in the Cloud
How to Take Advantage of an Enterprise Data Warehouse in the CloudDenodo
 
Making Hadoop based analytics simple for everyone to use
Making Hadoop based analytics simple for everyone to useMaking Hadoop based analytics simple for everyone to use
Making Hadoop based analytics simple for everyone to useSwiss Big Data User Group
 
Applied Data Science Course Part 1: Concepts & your first ML model
Applied Data Science Course Part 1: Concepts & your first ML modelApplied Data Science Course Part 1: Concepts & your first ML model
Applied Data Science Course Part 1: Concepts & your first ML modelDataiku
 
Postgres Vision 2018: AI Needs IA
Postgres Vision 2018: AI Needs IAPostgres Vision 2018: AI Needs IA
Postgres Vision 2018: AI Needs IAEDB
 

Was ist angesagt? (19)

The Yellowbrick Impact for MicroStrategy
The Yellowbrick Impact for MicroStrategyThe Yellowbrick Impact for MicroStrategy
The Yellowbrick Impact for MicroStrategy
 
Software Engineering for Data Scientists
Software Engineering for Data ScientistsSoftware Engineering for Data Scientists
Software Engineering for Data Scientists
 
Building Data Analytics pipelines in the cloud using serverless technology
Building Data Analytics pipelines in the cloud using serverless technologyBuilding Data Analytics pipelines in the cloud using serverless technology
Building Data Analytics pipelines in the cloud using serverless technology
 
Big Data Day LA 2016/ Hadoop/ Spark/ Kafka track - Panel - Interactive Applic...
Big Data Day LA 2016/ Hadoop/ Spark/ Kafka track - Panel - Interactive Applic...Big Data Day LA 2016/ Hadoop/ Spark/ Kafka track - Panel - Interactive Applic...
Big Data Day LA 2016/ Hadoop/ Spark/ Kafka track - Panel - Interactive Applic...
 
Qubole presentation for the Cleveland Big Data and Hadoop Meetup
Qubole presentation for the Cleveland Big Data and Hadoop Meetup   Qubole presentation for the Cleveland Big Data and Hadoop Meetup
Qubole presentation for the Cleveland Big Data and Hadoop Meetup
 
Business proposal (2) (1)
Business proposal (2) (1)Business proposal (2) (1)
Business proposal (2) (1)
 
Xanadu Big Data Platform Technology BMT@ Rackspace Cloud
Xanadu Big Data Platform Technology BMT@ Rackspace Cloud Xanadu Big Data Platform Technology BMT@ Rackspace Cloud
Xanadu Big Data Platform Technology BMT@ Rackspace Cloud
 
Architecting a Modern Data Warehouse: Enterprise Must-Haves
Architecting a Modern Data Warehouse: Enterprise Must-HavesArchitecting a Modern Data Warehouse: Enterprise Must-Haves
Architecting a Modern Data Warehouse: Enterprise Must-Haves
 
Webinar: SnapLogic Fall 2014 Release Brings iPaaS to the Enterprise
Webinar: SnapLogic Fall 2014 Release Brings iPaaS to the EnterpriseWebinar: SnapLogic Fall 2014 Release Brings iPaaS to the Enterprise
Webinar: SnapLogic Fall 2014 Release Brings iPaaS to the Enterprise
 
Embedding Insight through Prediction Driven Logistics
Embedding Insight through Prediction Driven LogisticsEmbedding Insight through Prediction Driven Logistics
Embedding Insight through Prediction Driven Logistics
 
Visualisation Meets Virtualisation
Visualisation Meets VirtualisationVisualisation Meets Virtualisation
Visualisation Meets Virtualisation
 
Data Sharing with Snowflake
Data Sharing with SnowflakeData Sharing with Snowflake
Data Sharing with Snowflake
 
Counting Unique Users in Real-Time: Here's a Challenge for You!
Counting Unique Users in Real-Time: Here's a Challenge for You!Counting Unique Users in Real-Time: Here's a Challenge for You!
Counting Unique Users in Real-Time: Here's a Challenge for You!
 
Hopper energyservices
Hopper energyservicesHopper energyservices
Hopper energyservices
 
Overview of big data in cloud computing
Overview of big data in cloud computingOverview of big data in cloud computing
Overview of big data in cloud computing
 
How to Take Advantage of an Enterprise Data Warehouse in the Cloud
How to Take Advantage of an Enterprise Data Warehouse in the CloudHow to Take Advantage of an Enterprise Data Warehouse in the Cloud
How to Take Advantage of an Enterprise Data Warehouse in the Cloud
 
Making Hadoop based analytics simple for everyone to use
Making Hadoop based analytics simple for everyone to useMaking Hadoop based analytics simple for everyone to use
Making Hadoop based analytics simple for everyone to use
 
Applied Data Science Course Part 1: Concepts & your first ML model
Applied Data Science Course Part 1: Concepts & your first ML modelApplied Data Science Course Part 1: Concepts & your first ML model
Applied Data Science Course Part 1: Concepts & your first ML model
 
Postgres Vision 2018: AI Needs IA
Postgres Vision 2018: AI Needs IAPostgres Vision 2018: AI Needs IA
Postgres Vision 2018: AI Needs IA
 

Ähnlich wie Saving Energy in Homes with Unified Data and AI

Saving Energy in Homes with a Unified Approach to Data and AI
Saving Energy in Homes with a Unified Approach to Data and AISaving Energy in Homes with a Unified Approach to Data and AI
Saving Energy in Homes with a Unified Approach to Data and AIDatabricks
 
CINECA webinar slides: Data Gravity in the Life Sciences: Lessons learned fro...
CINECA webinar slides: Data Gravity in the Life Sciences: Lessons learned fro...CINECA webinar slides: Data Gravity in the Life Sciences: Lessons learned fro...
CINECA webinar slides: Data Gravity in the Life Sciences: Lessons learned fro...CINECAProject
 
Quby - we create toon - Enabling smart energy services using scalable data sc...
Quby - we create toon - Enabling smart energy services using scalable data sc...Quby - we create toon - Enabling smart energy services using scalable data sc...
Quby - we create toon - Enabling smart energy services using scalable data sc...BigDataExpo
 
Schneider Electric Innovation Summit 2016.pptx
Schneider Electric Innovation Summit 2016.pptxSchneider Electric Innovation Summit 2016.pptx
Schneider Electric Innovation Summit 2016.pptxSchneider Electric
 
Prospering from the Energy Revolution: Six in Sixty - Data and Digitalisation
Prospering from the Energy Revolution: Six in Sixty - Data and DigitalisationProspering from the Energy Revolution: Six in Sixty - Data and Digitalisation
Prospering from the Energy Revolution: Six in Sixty - Data and DigitalisationKTN
 
Why are e-Infrastructures useful from a small business perspective?
Why are e-Infrastructures useful from a small business perspective?Why are e-Infrastructures useful from a small business perspective?
Why are e-Infrastructures useful from a small business perspective?Nikos Manouselis
 
BioIT 2018 'Easier integration and enrichment of your data by making public d...
BioIT 2018 'Easier integration and enrichment of your data by making public d...BioIT 2018 'Easier integration and enrichment of your data by making public d...
BioIT 2018 'Easier integration and enrichment of your data by making public d...Hans Constandt
 
AI and Machine Learning for the Connected Home with Stephen Galsworthy
AI and Machine Learning for the Connected Home with Stephen GalsworthyAI and Machine Learning for the Connected Home with Stephen Galsworthy
AI and Machine Learning for the Connected Home with Stephen GalsworthyDatabricks
 
Tedtalkapril20
Tedtalkapril20Tedtalkapril20
Tedtalkapril20Bala Iyer
 
CSRwire & Verizon Webinar_June 26, 2012
CSRwire & Verizon Webinar_June 26, 2012CSRwire & Verizon Webinar_June 26, 2012
CSRwire & Verizon Webinar_June 26, 2012CSRwire
 
How can Digital Twins support Manufacturers on the path to Net-Zero?
How can Digital Twins support Manufacturers on the path to Net-Zero?How can Digital Twins support Manufacturers on the path to Net-Zero?
How can Digital Twins support Manufacturers on the path to Net-Zero?IES VE
 
Convert IoT Data to Cash
Convert IoT Data to CashConvert IoT Data to Cash
Convert IoT Data to CashSeluxit
 
Johnsimmins 2017-05-31-awe-santaclara-simminsv2-170608224518
Johnsimmins 2017-05-31-awe-santaclara-simminsv2-170608224518Johnsimmins 2017-05-31-awe-santaclara-simminsv2-170608224518
Johnsimmins 2017-05-31-awe-santaclara-simminsv2-170608224518Maryam Shabro
 
John Simmins (EPRI): Electric Utility AR: IoT, Smart Cities and all That
John Simmins (EPRI): Electric Utility AR: IoT, Smart Cities and all ThatJohn Simmins (EPRI): Electric Utility AR: IoT, Smart Cities and all That
John Simmins (EPRI): Electric Utility AR: IoT, Smart Cities and all ThatAugmentedWorldExpo
 
Business models for IoT and Wearables
Business models for IoT and WearablesBusiness models for IoT and Wearables
Business models for IoT and WearablesJoseph Wei
 
KJP Almeria Horticulture collaboration 2015 final
KJP Almeria Horticulture collaboration 2015 finalKJP Almeria Horticulture collaboration 2015 final
KJP Almeria Horticulture collaboration 2015 finalKrijn Poppe
 

Ähnlich wie Saving Energy in Homes with Unified Data and AI (20)

Saving Energy in Homes with a Unified Approach to Data and AI
Saving Energy in Homes with a Unified Approach to Data and AISaving Energy in Homes with a Unified Approach to Data and AI
Saving Energy in Homes with a Unified Approach to Data and AI
 
CINECA webinar slides: Data Gravity in the Life Sciences: Lessons learned fro...
CINECA webinar slides: Data Gravity in the Life Sciences: Lessons learned fro...CINECA webinar slides: Data Gravity in the Life Sciences: Lessons learned fro...
CINECA webinar slides: Data Gravity in the Life Sciences: Lessons learned fro...
 
ICT
ICTICT
ICT
 
Quby - we create toon - Enabling smart energy services using scalable data sc...
Quby - we create toon - Enabling smart energy services using scalable data sc...Quby - we create toon - Enabling smart energy services using scalable data sc...
Quby - we create toon - Enabling smart energy services using scalable data sc...
 
Schneider Electric Innovation Summit 2016.pptx
Schneider Electric Innovation Summit 2016.pptxSchneider Electric Innovation Summit 2016.pptx
Schneider Electric Innovation Summit 2016.pptx
 
Prospering from the Energy Revolution: Six in Sixty - Data and Digitalisation
Prospering from the Energy Revolution: Six in Sixty - Data and DigitalisationProspering from the Energy Revolution: Six in Sixty - Data and Digitalisation
Prospering from the Energy Revolution: Six in Sixty - Data and Digitalisation
 
Why are e-Infrastructures useful from a small business perspective?
Why are e-Infrastructures useful from a small business perspective?Why are e-Infrastructures useful from a small business perspective?
Why are e-Infrastructures useful from a small business perspective?
 
BioIT 2018 'Easier integration and enrichment of your data by making public d...
BioIT 2018 'Easier integration and enrichment of your data by making public d...BioIT 2018 'Easier integration and enrichment of your data by making public d...
BioIT 2018 'Easier integration and enrichment of your data by making public d...
 
AI and Machine Learning for the Connected Home with Stephen Galsworthy
AI and Machine Learning for the Connected Home with Stephen GalsworthyAI and Machine Learning for the Connected Home with Stephen Galsworthy
AI and Machine Learning for the Connected Home with Stephen Galsworthy
 
Smart Grid Needs Smart Consumers
Smart Grid Needs Smart ConsumersSmart Grid Needs Smart Consumers
Smart Grid Needs Smart Consumers
 
Sgcp14hampshire
Sgcp14hampshireSgcp14hampshire
Sgcp14hampshire
 
Tedtalkapril20
Tedtalkapril20Tedtalkapril20
Tedtalkapril20
 
CSRwire & Verizon Webinar_June 26, 2012
CSRwire & Verizon Webinar_June 26, 2012CSRwire & Verizon Webinar_June 26, 2012
CSRwire & Verizon Webinar_June 26, 2012
 
How can Digital Twins support Manufacturers on the path to Net-Zero?
How can Digital Twins support Manufacturers on the path to Net-Zero?How can Digital Twins support Manufacturers on the path to Net-Zero?
How can Digital Twins support Manufacturers on the path to Net-Zero?
 
Convert IoT Data to Cash
Convert IoT Data to CashConvert IoT Data to Cash
Convert IoT Data to Cash
 
6-2016.01_jrc_opower_0
6-2016.01_jrc_opower_06-2016.01_jrc_opower_0
6-2016.01_jrc_opower_0
 
Johnsimmins 2017-05-31-awe-santaclara-simminsv2-170608224518
Johnsimmins 2017-05-31-awe-santaclara-simminsv2-170608224518Johnsimmins 2017-05-31-awe-santaclara-simminsv2-170608224518
Johnsimmins 2017-05-31-awe-santaclara-simminsv2-170608224518
 
John Simmins (EPRI): Electric Utility AR: IoT, Smart Cities and all That
John Simmins (EPRI): Electric Utility AR: IoT, Smart Cities and all ThatJohn Simmins (EPRI): Electric Utility AR: IoT, Smart Cities and all That
John Simmins (EPRI): Electric Utility AR: IoT, Smart Cities and all That
 
Business models for IoT and Wearables
Business models for IoT and WearablesBusiness models for IoT and Wearables
Business models for IoT and Wearables
 
KJP Almeria Horticulture collaboration 2015 final
KJP Almeria Horticulture collaboration 2015 finalKJP Almeria Horticulture collaboration 2015 final
KJP Almeria Horticulture collaboration 2015 final
 

Mehr von Databricks

DW Migration Webinar-March 2022.pptx
DW Migration Webinar-March 2022.pptxDW Migration Webinar-March 2022.pptx
DW Migration Webinar-March 2022.pptxDatabricks
 
Data Lakehouse Symposium | Day 1 | Part 1
Data Lakehouse Symposium | Day 1 | Part 1Data Lakehouse Symposium | Day 1 | Part 1
Data Lakehouse Symposium | Day 1 | Part 1Databricks
 
Data Lakehouse Symposium | Day 1 | Part 2
Data Lakehouse Symposium | Day 1 | Part 2Data Lakehouse Symposium | Day 1 | Part 2
Data Lakehouse Symposium | Day 1 | Part 2Databricks
 
Data Lakehouse Symposium | Day 2
Data Lakehouse Symposium | Day 2Data Lakehouse Symposium | Day 2
Data Lakehouse Symposium | Day 2Databricks
 
Data Lakehouse Symposium | Day 4
Data Lakehouse Symposium | Day 4Data Lakehouse Symposium | Day 4
Data Lakehouse Symposium | Day 4Databricks
 
5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop
5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop
5 Critical Steps to Clean Your Data Swamp When Migrating Off of HadoopDatabricks
 
Democratizing Data Quality Through a Centralized Platform
Democratizing Data Quality Through a Centralized PlatformDemocratizing Data Quality Through a Centralized Platform
Democratizing Data Quality Through a Centralized PlatformDatabricks
 
Learn to Use Databricks for Data Science
Learn to Use Databricks for Data ScienceLearn to Use Databricks for Data Science
Learn to Use Databricks for Data ScienceDatabricks
 
Why APM Is Not the Same As ML Monitoring
Why APM Is Not the Same As ML MonitoringWhy APM Is Not the Same As ML Monitoring
Why APM Is Not the Same As ML MonitoringDatabricks
 
The Function, the Context, and the Data—Enabling ML Ops at Stitch Fix
The Function, the Context, and the Data—Enabling ML Ops at Stitch FixThe Function, the Context, and the Data—Enabling ML Ops at Stitch Fix
The Function, the Context, and the Data—Enabling ML Ops at Stitch FixDatabricks
 
Stage Level Scheduling Improving Big Data and AI Integration
Stage Level Scheduling Improving Big Data and AI IntegrationStage Level Scheduling Improving Big Data and AI Integration
Stage Level Scheduling Improving Big Data and AI IntegrationDatabricks
 
Simplify Data Conversion from Spark to TensorFlow and PyTorch
Simplify Data Conversion from Spark to TensorFlow and PyTorchSimplify Data Conversion from Spark to TensorFlow and PyTorch
Simplify Data Conversion from Spark to TensorFlow and PyTorchDatabricks
 
Scaling your Data Pipelines with Apache Spark on Kubernetes
Scaling your Data Pipelines with Apache Spark on KubernetesScaling your Data Pipelines with Apache Spark on Kubernetes
Scaling your Data Pipelines with Apache Spark on KubernetesDatabricks
 
Scaling and Unifying SciKit Learn and Apache Spark Pipelines
Scaling and Unifying SciKit Learn and Apache Spark PipelinesScaling and Unifying SciKit Learn and Apache Spark Pipelines
Scaling and Unifying SciKit Learn and Apache Spark PipelinesDatabricks
 
Sawtooth Windows for Feature Aggregations
Sawtooth Windows for Feature AggregationsSawtooth Windows for Feature Aggregations
Sawtooth Windows for Feature AggregationsDatabricks
 
Redis + Apache Spark = Swiss Army Knife Meets Kitchen Sink
Redis + Apache Spark = Swiss Army Knife Meets Kitchen SinkRedis + Apache Spark = Swiss Army Knife Meets Kitchen Sink
Redis + Apache Spark = Swiss Army Knife Meets Kitchen SinkDatabricks
 
Re-imagine Data Monitoring with whylogs and Spark
Re-imagine Data Monitoring with whylogs and SparkRe-imagine Data Monitoring with whylogs and Spark
Re-imagine Data Monitoring with whylogs and SparkDatabricks
 
Raven: End-to-end Optimization of ML Prediction Queries
Raven: End-to-end Optimization of ML Prediction QueriesRaven: End-to-end Optimization of ML Prediction Queries
Raven: End-to-end Optimization of ML Prediction QueriesDatabricks
 
Processing Large Datasets for ADAS Applications using Apache Spark
Processing Large Datasets for ADAS Applications using Apache SparkProcessing Large Datasets for ADAS Applications using Apache Spark
Processing Large Datasets for ADAS Applications using Apache SparkDatabricks
 
Massive Data Processing in Adobe Using Delta Lake
Massive Data Processing in Adobe Using Delta LakeMassive Data Processing in Adobe Using Delta Lake
Massive Data Processing in Adobe Using Delta LakeDatabricks
 

Mehr von Databricks (20)

DW Migration Webinar-March 2022.pptx
DW Migration Webinar-March 2022.pptxDW Migration Webinar-March 2022.pptx
DW Migration Webinar-March 2022.pptx
 
Data Lakehouse Symposium | Day 1 | Part 1
Data Lakehouse Symposium | Day 1 | Part 1Data Lakehouse Symposium | Day 1 | Part 1
Data Lakehouse Symposium | Day 1 | Part 1
 
Data Lakehouse Symposium | Day 1 | Part 2
Data Lakehouse Symposium | Day 1 | Part 2Data Lakehouse Symposium | Day 1 | Part 2
Data Lakehouse Symposium | Day 1 | Part 2
 
Data Lakehouse Symposium | Day 2
Data Lakehouse Symposium | Day 2Data Lakehouse Symposium | Day 2
Data Lakehouse Symposium | Day 2
 
Data Lakehouse Symposium | Day 4
Data Lakehouse Symposium | Day 4Data Lakehouse Symposium | Day 4
Data Lakehouse Symposium | Day 4
 
5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop
5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop
5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop
 
Democratizing Data Quality Through a Centralized Platform
Democratizing Data Quality Through a Centralized PlatformDemocratizing Data Quality Through a Centralized Platform
Democratizing Data Quality Through a Centralized Platform
 
Learn to Use Databricks for Data Science
Learn to Use Databricks for Data ScienceLearn to Use Databricks for Data Science
Learn to Use Databricks for Data Science
 
Why APM Is Not the Same As ML Monitoring
Why APM Is Not the Same As ML MonitoringWhy APM Is Not the Same As ML Monitoring
Why APM Is Not the Same As ML Monitoring
 
The Function, the Context, and the Data—Enabling ML Ops at Stitch Fix
The Function, the Context, and the Data—Enabling ML Ops at Stitch FixThe Function, the Context, and the Data—Enabling ML Ops at Stitch Fix
The Function, the Context, and the Data—Enabling ML Ops at Stitch Fix
 
Stage Level Scheduling Improving Big Data and AI Integration
Stage Level Scheduling Improving Big Data and AI IntegrationStage Level Scheduling Improving Big Data and AI Integration
Stage Level Scheduling Improving Big Data and AI Integration
 
Simplify Data Conversion from Spark to TensorFlow and PyTorch
Simplify Data Conversion from Spark to TensorFlow and PyTorchSimplify Data Conversion from Spark to TensorFlow and PyTorch
Simplify Data Conversion from Spark to TensorFlow and PyTorch
 
Scaling your Data Pipelines with Apache Spark on Kubernetes
Scaling your Data Pipelines with Apache Spark on KubernetesScaling your Data Pipelines with Apache Spark on Kubernetes
Scaling your Data Pipelines with Apache Spark on Kubernetes
 
Scaling and Unifying SciKit Learn and Apache Spark Pipelines
Scaling and Unifying SciKit Learn and Apache Spark PipelinesScaling and Unifying SciKit Learn and Apache Spark Pipelines
Scaling and Unifying SciKit Learn and Apache Spark Pipelines
 
Sawtooth Windows for Feature Aggregations
Sawtooth Windows for Feature AggregationsSawtooth Windows for Feature Aggregations
Sawtooth Windows for Feature Aggregations
 
Redis + Apache Spark = Swiss Army Knife Meets Kitchen Sink
Redis + Apache Spark = Swiss Army Knife Meets Kitchen SinkRedis + Apache Spark = Swiss Army Knife Meets Kitchen Sink
Redis + Apache Spark = Swiss Army Knife Meets Kitchen Sink
 
Re-imagine Data Monitoring with whylogs and Spark
Re-imagine Data Monitoring with whylogs and SparkRe-imagine Data Monitoring with whylogs and Spark
Re-imagine Data Monitoring with whylogs and Spark
 
Raven: End-to-end Optimization of ML Prediction Queries
Raven: End-to-end Optimization of ML Prediction QueriesRaven: End-to-end Optimization of ML Prediction Queries
Raven: End-to-end Optimization of ML Prediction Queries
 
Processing Large Datasets for ADAS Applications using Apache Spark
Processing Large Datasets for ADAS Applications using Apache SparkProcessing Large Datasets for ADAS Applications using Apache Spark
Processing Large Datasets for ADAS Applications using Apache Spark
 
Massive Data Processing in Adobe Using Delta Lake
Massive Data Processing in Adobe Using Delta LakeMassive Data Processing in Adobe Using Delta Lake
Massive Data Processing in Adobe Using Delta Lake
 

Kürzlich hochgeladen

Decoding Movie Sentiments: Analyzing Reviews with Data Analysis model
Decoding Movie Sentiments: Analyzing Reviews with Data Analysis modelDecoding Movie Sentiments: Analyzing Reviews with Data Analysis model
Decoding Movie Sentiments: Analyzing Reviews with Data Analysis modelBoston Institute of Analytics
 
Student Profile Sample report on improving academic performance by uniting gr...
Student Profile Sample report on improving academic performance by uniting gr...Student Profile Sample report on improving academic performance by uniting gr...
Student Profile Sample report on improving academic performance by uniting gr...Seán Kennedy
 
IBEF report on the Insurance market in India
IBEF report on the Insurance market in IndiaIBEF report on the Insurance market in India
IBEF report on the Insurance market in IndiaManalVerma4
 
What To Do For World Nature Conservation Day by Slidesgo.pptx
What To Do For World Nature Conservation Day by Slidesgo.pptxWhat To Do For World Nature Conservation Day by Slidesgo.pptx
What To Do For World Nature Conservation Day by Slidesgo.pptxSimranPal17
 
Student profile product demonstration on grades, ability, well-being and mind...
Student profile product demonstration on grades, ability, well-being and mind...Student profile product demonstration on grades, ability, well-being and mind...
Student profile product demonstration on grades, ability, well-being and mind...Seán Kennedy
 
Real-Time AI Streaming - AI Max Princeton
Real-Time AI  Streaming - AI Max PrincetonReal-Time AI  Streaming - AI Max Princeton
Real-Time AI Streaming - AI Max PrincetonTimothy Spann
 
Decoding the Heart: Student Presentation on Heart Attack Prediction with Data...
Decoding the Heart: Student Presentation on Heart Attack Prediction with Data...Decoding the Heart: Student Presentation on Heart Attack Prediction with Data...
Decoding the Heart: Student Presentation on Heart Attack Prediction with Data...Boston Institute of Analytics
 
Data Analysis Project : Targeting the Right Customers, Presentation on Bank M...
Data Analysis Project : Targeting the Right Customers, Presentation on Bank M...Data Analysis Project : Targeting the Right Customers, Presentation on Bank M...
Data Analysis Project : Targeting the Right Customers, Presentation on Bank M...Boston Institute of Analytics
 
Semantic Shed - Squashing and Squeezing.pptx
Semantic Shed - Squashing and Squeezing.pptxSemantic Shed - Squashing and Squeezing.pptx
Semantic Shed - Squashing and Squeezing.pptxMike Bennett
 
FAIR, FAIRsharing, FAIR Cookbook and ELIXIR - Sansone SA - Boston 2024
FAIR, FAIRsharing, FAIR Cookbook and ELIXIR - Sansone SA - Boston 2024FAIR, FAIRsharing, FAIR Cookbook and ELIXIR - Sansone SA - Boston 2024
FAIR, FAIRsharing, FAIR Cookbook and ELIXIR - Sansone SA - Boston 2024Susanna-Assunta Sansone
 
Rithik Kumar Singh codealpha pythohn.pdf
Rithik Kumar Singh codealpha pythohn.pdfRithik Kumar Singh codealpha pythohn.pdf
Rithik Kumar Singh codealpha pythohn.pdfrahulyadav957181
 
Networking Case Study prepared by teacher.pptx
Networking Case Study prepared by teacher.pptxNetworking Case Study prepared by teacher.pptx
Networking Case Study prepared by teacher.pptxHimangsuNath
 
World Economic Forum Metaverse Ecosystem By Utpal Chakraborty.pdf
World Economic Forum Metaverse Ecosystem By Utpal Chakraborty.pdfWorld Economic Forum Metaverse Ecosystem By Utpal Chakraborty.pdf
World Economic Forum Metaverse Ecosystem By Utpal Chakraborty.pdfsimulationsindia
 
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...Boston Institute of Analytics
 
Digital Marketing Plan, how digital marketing works
Digital Marketing Plan, how digital marketing worksDigital Marketing Plan, how digital marketing works
Digital Marketing Plan, how digital marketing worksdeepakthakur548787
 
Bank Loan Approval Analysis: A Comprehensive Data Analysis Project
Bank Loan Approval Analysis: A Comprehensive Data Analysis ProjectBank Loan Approval Analysis: A Comprehensive Data Analysis Project
Bank Loan Approval Analysis: A Comprehensive Data Analysis ProjectBoston Institute of Analytics
 
The Power of Data-Driven Storytelling_ Unveiling the Layers of Insight.pptx
The Power of Data-Driven Storytelling_ Unveiling the Layers of Insight.pptxThe Power of Data-Driven Storytelling_ Unveiling the Layers of Insight.pptx
The Power of Data-Driven Storytelling_ Unveiling the Layers of Insight.pptxTasha Penwell
 
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...Dr Arash Najmaei ( Phd., MBA, BSc)
 
Minimizing AI Hallucinations/Confabulations and the Path towards AGI with Exa...
Minimizing AI Hallucinations/Confabulations and the Path towards AGI with Exa...Minimizing AI Hallucinations/Confabulations and the Path towards AGI with Exa...
Minimizing AI Hallucinations/Confabulations and the Path towards AGI with Exa...Thomas Poetter
 
Data Factory in Microsoft Fabric (MsBIP #82)
Data Factory in Microsoft Fabric (MsBIP #82)Data Factory in Microsoft Fabric (MsBIP #82)
Data Factory in Microsoft Fabric (MsBIP #82)Cathrine Wilhelmsen
 

Kürzlich hochgeladen (20)

Decoding Movie Sentiments: Analyzing Reviews with Data Analysis model
Decoding Movie Sentiments: Analyzing Reviews with Data Analysis modelDecoding Movie Sentiments: Analyzing Reviews with Data Analysis model
Decoding Movie Sentiments: Analyzing Reviews with Data Analysis model
 
Student Profile Sample report on improving academic performance by uniting gr...
Student Profile Sample report on improving academic performance by uniting gr...Student Profile Sample report on improving academic performance by uniting gr...
Student Profile Sample report on improving academic performance by uniting gr...
 
IBEF report on the Insurance market in India
IBEF report on the Insurance market in IndiaIBEF report on the Insurance market in India
IBEF report on the Insurance market in India
 
What To Do For World Nature Conservation Day by Slidesgo.pptx
What To Do For World Nature Conservation Day by Slidesgo.pptxWhat To Do For World Nature Conservation Day by Slidesgo.pptx
What To Do For World Nature Conservation Day by Slidesgo.pptx
 
Student profile product demonstration on grades, ability, well-being and mind...
Student profile product demonstration on grades, ability, well-being and mind...Student profile product demonstration on grades, ability, well-being and mind...
Student profile product demonstration on grades, ability, well-being and mind...
 
Real-Time AI Streaming - AI Max Princeton
Real-Time AI  Streaming - AI Max PrincetonReal-Time AI  Streaming - AI Max Princeton
Real-Time AI Streaming - AI Max Princeton
 
Decoding the Heart: Student Presentation on Heart Attack Prediction with Data...
Decoding the Heart: Student Presentation on Heart Attack Prediction with Data...Decoding the Heart: Student Presentation on Heart Attack Prediction with Data...
Decoding the Heart: Student Presentation on Heart Attack Prediction with Data...
 
Data Analysis Project : Targeting the Right Customers, Presentation on Bank M...
Data Analysis Project : Targeting the Right Customers, Presentation on Bank M...Data Analysis Project : Targeting the Right Customers, Presentation on Bank M...
Data Analysis Project : Targeting the Right Customers, Presentation on Bank M...
 
Semantic Shed - Squashing and Squeezing.pptx
Semantic Shed - Squashing and Squeezing.pptxSemantic Shed - Squashing and Squeezing.pptx
Semantic Shed - Squashing and Squeezing.pptx
 
FAIR, FAIRsharing, FAIR Cookbook and ELIXIR - Sansone SA - Boston 2024
FAIR, FAIRsharing, FAIR Cookbook and ELIXIR - Sansone SA - Boston 2024FAIR, FAIRsharing, FAIR Cookbook and ELIXIR - Sansone SA - Boston 2024
FAIR, FAIRsharing, FAIR Cookbook and ELIXIR - Sansone SA - Boston 2024
 
Rithik Kumar Singh codealpha pythohn.pdf
Rithik Kumar Singh codealpha pythohn.pdfRithik Kumar Singh codealpha pythohn.pdf
Rithik Kumar Singh codealpha pythohn.pdf
 
Networking Case Study prepared by teacher.pptx
Networking Case Study prepared by teacher.pptxNetworking Case Study prepared by teacher.pptx
Networking Case Study prepared by teacher.pptx
 
World Economic Forum Metaverse Ecosystem By Utpal Chakraborty.pdf
World Economic Forum Metaverse Ecosystem By Utpal Chakraborty.pdfWorld Economic Forum Metaverse Ecosystem By Utpal Chakraborty.pdf
World Economic Forum Metaverse Ecosystem By Utpal Chakraborty.pdf
 
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
 
Digital Marketing Plan, how digital marketing works
Digital Marketing Plan, how digital marketing worksDigital Marketing Plan, how digital marketing works
Digital Marketing Plan, how digital marketing works
 
Bank Loan Approval Analysis: A Comprehensive Data Analysis Project
Bank Loan Approval Analysis: A Comprehensive Data Analysis ProjectBank Loan Approval Analysis: A Comprehensive Data Analysis Project
Bank Loan Approval Analysis: A Comprehensive Data Analysis Project
 
The Power of Data-Driven Storytelling_ Unveiling the Layers of Insight.pptx
The Power of Data-Driven Storytelling_ Unveiling the Layers of Insight.pptxThe Power of Data-Driven Storytelling_ Unveiling the Layers of Insight.pptx
The Power of Data-Driven Storytelling_ Unveiling the Layers of Insight.pptx
 
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
 
Minimizing AI Hallucinations/Confabulations and the Path towards AGI with Exa...
Minimizing AI Hallucinations/Confabulations and the Path towards AGI with Exa...Minimizing AI Hallucinations/Confabulations and the Path towards AGI with Exa...
Minimizing AI Hallucinations/Confabulations and the Path towards AGI with Exa...
 
Data Factory in Microsoft Fabric (MsBIP #82)
Data Factory in Microsoft Fabric (MsBIP #82)Data Factory in Microsoft Fabric (MsBIP #82)
Data Factory in Microsoft Fabric (MsBIP #82)
 

Saving Energy in Homes with Unified Data and AI

  • 1. Saving Energy in Homes with a Unified Approach to Data and AI @Dr_Galsworthy @QubyEnergy
  • 2. We believe that the future can be better. Easier, more comfortable, and more sustainable without compromising on the important things in life.
  • 3. Worldwide annual energy consumption 109,136,000,000,000 kWh Source: IEA
  • 4. 109,136,000,000,000 kWh Worldwide annual energy consumption Source: IEA But how much is just wasted?
  • 5. EU energy saving target for 2030 -32.5% Source: EU
  • 6. Source: Eurostat 44% Households use 44% of all natural gas and 27% of all electricity in the EU 27%
  • 7. 400,000 connected homes across Europe
  • 8. Waste Checker • Efficient appliances expected to save consumers €100 billion annually by 2020 • We have found that over 40% of household appliances are inefficient or being used inefficiently “It looks like you often wash at high temperatures. Your dishwasher needs more energy to heat the water. Washing at 50 degrees, or ECO mode, will get your utensils just as clean, go ahead and try it.” Waste Checker offers personalised advice on inefficient appliances and behaviours Source: EU
  • 9. IoT Data Models Outcomes Our data-driven services
  • 10. Central heating system Water sensorElectricity sensorGas sensor IoT Data Models Outcomes Challenges 1. Over 3 petabytes of IoT data and rapidly growing 2. Need to process IoT data, both batch and streaming, in a reliable and efficient manner Terabytes of IoT data daily Our data-driven services
  • 11. Challenges 3. Over 1 million unsupervised models trained daily 4. Struggling to track model performance and training/test datasets for a wide range of algorithms IoT Data Models Outcomes DishwasherWashing machine Washing machine DryerDryer Patented algorithms Our data-driven services
  • 12. Personalised advice on how to avoid wasting energy Challenges 5. Reliable services needed for hundreds of thousands of daily users IoT Data Models Outcomes Our data-driven services
  • 13. Our unified data analytics setup
  • 14. Ingestion of data from multiple sources Our unified data analytics setup
  • 15. Batch and streaming on the same data Our unified data analytics setup
  • 16. Scalable pipelines to support reliable production services Our unified data analytics setup
  • 17. Central place to develop new algorithms and use cases, quickly and cost effectively Our unified data analytics setup
  • 18. Unified data analytics is powering Quby’s transformation into a AI-first company • Collaboration by multiple groups on same platform • Data scientists, data engineers, BI analysts, developers, infra and customer support • Data team adding more value: less time on infrastructure • Typical data engineering to scientist ratio = 5:1 • Quby’s ratio DE:MLE:DS = 1:1:1 • Faster development cycles • Our first data service > 12 months • Quby now < 8 weeks
  • 19. Explore a machine learning engineer’s perspective Wednesday
  • 20. Saving energy in homes across Europe • In the last 12 months: • 87 million inefficient appliance cycles identified • 67,000,000 kWh of wastage identified and targeted • A significant reduction in household energy bills when combined with our smart thermostat to control heating • Step-by-step we are enabling the transition to a sustainable energy system