SlideShare ist ein Scribd-Unternehmen logo
1 von 38
Downloaden Sie, um offline zu lesen
WIFI SSID: Spark+AISummit | Password: UnifiedDataAnalytics
Ellissa Verseput, Quby
Making Homes Efficient and Comfortable
Using AI and IoT Data
#UnifiedDataAnalytics #SparkAISummit
Outline
• Why, What, How Quby
• 2 Example Use Cases
– Bill Breakdown (Efficient)
– Thermostat Program Advice (Comfortable)
3
4
We believe the future can be better.
Easier, more comfortable, and more sustainable.
We help businesses and their customers to make this change
without compromising on the important things in life.
5
Z-Wave
Meter adaptors
Boiler
adapters
Gas sensor
Philips Hue
Z-Wave
Central heating
system
Solar panels and power
storage
Smart plugs & smoke detectors
Electricity sensor
Gas
Water
Water sensor
Electricity
Athom Homey Amazon Alexa Google HomeDrebbleOlisto
7#UnifiedDataAnalytics #SparkAISummit
Over 400,000 connected homes across Europe
Our partners:
Outline
ü Why, What, How Quby
• 2 Example Use Cases
– Bill Breakdown (Efficient)
– Thermostat Program Advice (Comfortable)
8
Energy insights gas & electricity
(high frequency)
Waste checker (~7 use cases)
Water insights & saving tips
Solar generation integration
Smart thermostat functionality
Smart home integration
Air quality measurement & insights
Monitoring the home
Smart security solution
Assisted living
Energy insights with low frequency
Dedicated app development for utilities with superior user experience & personal relevance
Home services
Efficient home Comfortable home Trusted home
Current Quby Portfolio
9
Use Case #1
Bill Breakdown
10
Show how different appliances and
activities in the home contribute to the
energy bills
Key Technology: Load Disaggregation
11
Quby’s disaggregation algorithms
12
Patented algorithms can detect appliances from 10 second
resolution electricity meter data
Bill Breakdown Categories for 10sec-data
13
Elec data
Elec bill
14
10sec-data VS 15min-data
High
Resolution
Low
Resolution
Bill Breakdown Categories for 15min-data
15
Elec bill
Elec data
Super Resolution
16
17
Utilizing our large database of high-resolution data, we apply advanced techniques to offer a more
personalized, more dynamic and more accurate bill breakdown service.
Low resolution data
Bill breakdownEnhancement
Most similar
users with high
resolution data
Appliance
detections
High resolution data
User
Similar users
Bill Breakdown Architecture
18
Toon data
collector
P4 data
collector
API
Bill Breakdown for low resolution data
19
Outline
ü Why, What, How Quby
Ø 2 Example Use Cases
• Bill Breakdown (Efficient)
• Thermostat Program Advice (Comfortable)
20
Outline
ü Why, What, How Quby
Ø 2 Example Use Cases
🤯 Bill Breakdown (Efficient)
• Thermostat Program Advice (Comfortable)
21
Use Case #2
Thermostat Program Advice
22
Suggest updates to the Toon users’
thermostat program, such that the program
better reflects their behavioural patterns
Thermostat Program Advice Key Technology
23
Cooling down and
warming up rate
Humidity sensor
Somebody home?
Presence Detection
Non-intrusive Monitoring
24
Proof of Life – Toon can detect when a person is present
Safety – Toon can indicate an active/inactive (elderly) resident
Heating/Lighting – Toon can detect people are active to optimize heating
Training a Machine Learning Model
25
Hour Mon Tues Wed
08:00 Home Away Home
09:00 Away Away Home
10:00 Away Away Home
Hour Mon Tues Wed
08:00 Home Home Home
09:00 Home Away Away
10:00 Away Away Away
Cooling down and
warming up rate
Humidity sensor
We want to track model improvements and reproduce models
Challenge
Solution:
27
This is how we did it
28
• We have saved the best, trained machine learning model in Python,
• but for our production data pipeline we want to use Spark Scala
Challenge
Pandas
UDF
Solution: Pandas UDF
30
Saved
Model
This is how we did it
31
Thermostat Program Advice Architecture
32
Toon data
collector
Presence
Labels
API
Survey
Program Advice
What’s next?
33
8:00
Good to see that mom has
woken up. I was worried
since she complained she
had breathing issues.
16:00
Guess the first thing he
turned on was the game
console. At least, I know
he is back home from
school
12:00
I left for work early
morning, there
shouldn’t be any
recent activity.
Perhaps I should have
the neighbors check
Assisted Living
34
8:00
Good to see that mom has
woken up. I was worried
since she complained she
had breathing issues.
16:00
Guess the first thing he
turned on was the game
console. At least, I know
he is back home from
school
12:00
I left for work early
morning, there
shouldn’t be any
recent activity.
Perhaps I should have
the neighbors check
We can monitor the home to help
people care for their loved ones and
keep their homes safe & warm.
Summary
ü Why, What, How Quby
ü 2 Example Use Cases
ü Bill Breakdown (Efficient)
ü Thermostat Program Advice (Comfortable)
35
This is Quby!
careers@quby.com
linkedin.com/company/quby/
Get in touch
Ellissa Verseput
Machine Learning Engineer
Ellissa.verseput@quby.com
(+31) 6 133 688 21
DON’T FORGET TO RATE
AND REVIEW THE SESSIONS
SEARCH SPARK + AI SUMMIT

Weitere ähnliche Inhalte

Was ist angesagt?

Real-Time Fraud Detection at Scale—Integrating Real-Time Deep-Link Graph Anal...
Real-Time Fraud Detection at Scale—Integrating Real-Time Deep-Link Graph Anal...Real-Time Fraud Detection at Scale—Integrating Real-Time Deep-Link Graph Anal...
Real-Time Fraud Detection at Scale—Integrating Real-Time Deep-Link Graph Anal...Databricks
 
Build Real-Time Applications with Databricks Streaming
Build Real-Time Applications with Databricks StreamingBuild Real-Time Applications with Databricks Streaming
Build Real-Time Applications with Databricks StreamingDatabricks
 
Big Data Day LA 2016/ Data Science Track - The Evolving Data Science Landscap...
Big Data Day LA 2016/ Data Science Track - The Evolving Data Science Landscap...Big Data Day LA 2016/ Data Science Track - The Evolving Data Science Landscap...
Big Data Day LA 2016/ Data Science Track - The Evolving Data Science Landscap...Data Con LA
 
Production ready big ml workflows from zero to hero daniel marcous @ waze
Production ready big ml workflows from zero to hero daniel marcous @ wazeProduction ready big ml workflows from zero to hero daniel marcous @ waze
Production ready big ml workflows from zero to hero daniel marcous @ wazeIdo Shilon
 
Machine Learning for Anomaly Detection, Time Series Modeling, and More
Machine Learning for Anomaly Detection, Time Series Modeling, and MoreMachine Learning for Anomaly Detection, Time Series Modeling, and More
Machine Learning for Anomaly Detection, Time Series Modeling, and MoreElasticsearch
 
Anomaly Detection at Scale!
Anomaly Detection at Scale!Anomaly Detection at Scale!
Anomaly Detection at Scale!Databricks
 
Unifying Streaming and Historical Telemetry Data For Real-time Performance Re...
Unifying Streaming and Historical Telemetry Data For Real-time Performance Re...Unifying Streaming and Historical Telemetry Data For Real-time Performance Re...
Unifying Streaming and Historical Telemetry Data For Real-time Performance Re...Databricks
 
Power Your Delta Lake with Streaming Transactional Changes
 Power Your Delta Lake with Streaming Transactional Changes Power Your Delta Lake with Streaming Transactional Changes
Power Your Delta Lake with Streaming Transactional ChangesDatabricks
 
Scaling Your Skillset with Your Data with Jarrett Garcia (Nielsen)
Scaling Your Skillset with Your Data with Jarrett Garcia (Nielsen)Scaling Your Skillset with Your Data with Jarrett Garcia (Nielsen)
Scaling Your Skillset with Your Data with Jarrett Garcia (Nielsen)Spark Summit
 
Reference architecture for Internet of Things
Reference architecture for Internet of ThingsReference architecture for Internet of Things
Reference architecture for Internet of ThingsSujee Maniyam
 
Cloud Experience: Data-driven Applications Made Simple and Fast
Cloud Experience: Data-driven Applications Made Simple and FastCloud Experience: Data-driven Applications Made Simple and Fast
Cloud Experience: Data-driven Applications Made Simple and FastDatabricks
 
Siscale Lightning Talk: Automated Root Cause Analysis with Elastic Stack
Siscale Lightning Talk: Automated Root Cause Analysis with Elastic StackSiscale Lightning Talk: Automated Root Cause Analysis with Elastic Stack
Siscale Lightning Talk: Automated Root Cause Analysis with Elastic StackElasticsearch
 
Future Grid Overview 2018
Future Grid Overview 2018Future Grid Overview 2018
Future Grid Overview 2018Chris J Law
 
Life is but a Stream
Life is but a StreamLife is but a Stream
Life is but a StreamDatabricks
 
Bridging the Completeness of Big Data on Databricks
Bridging the Completeness of Big Data on DatabricksBridging the Completeness of Big Data on Databricks
Bridging the Completeness of Big Data on DatabricksDatabricks
 
Automated Production Ready ML at Scale
Automated Production Ready ML at ScaleAutomated Production Ready ML at Scale
Automated Production Ready ML at ScaleDatabricks
 
Changing the Way Viacom Looks at Video Performance with Mark Cohen and Michae...
Changing the Way Viacom Looks at Video Performance with Mark Cohen and Michae...Changing the Way Viacom Looks at Video Performance with Mark Cohen and Michae...
Changing the Way Viacom Looks at Video Performance with Mark Cohen and Michae...Databricks
 
Apache Spark Listeners: A Crash Course in Fast, Easy Monitoring
Apache Spark Listeners: A Crash Course in Fast, Easy MonitoringApache Spark Listeners: A Crash Course in Fast, Easy Monitoring
Apache Spark Listeners: A Crash Course in Fast, Easy MonitoringDatabricks
 

Was ist angesagt? (20)

Real-Time Fraud Detection at Scale—Integrating Real-Time Deep-Link Graph Anal...
Real-Time Fraud Detection at Scale—Integrating Real-Time Deep-Link Graph Anal...Real-Time Fraud Detection at Scale—Integrating Real-Time Deep-Link Graph Anal...
Real-Time Fraud Detection at Scale—Integrating Real-Time Deep-Link Graph Anal...
 
Build Real-Time Applications with Databricks Streaming
Build Real-Time Applications with Databricks StreamingBuild Real-Time Applications with Databricks Streaming
Build Real-Time Applications with Databricks Streaming
 
Big Data Day LA 2016/ Data Science Track - The Evolving Data Science Landscap...
Big Data Day LA 2016/ Data Science Track - The Evolving Data Science Landscap...Big Data Day LA 2016/ Data Science Track - The Evolving Data Science Landscap...
Big Data Day LA 2016/ Data Science Track - The Evolving Data Science Landscap...
 
Production ready big ml workflows from zero to hero daniel marcous @ waze
Production ready big ml workflows from zero to hero daniel marcous @ wazeProduction ready big ml workflows from zero to hero daniel marcous @ waze
Production ready big ml workflows from zero to hero daniel marcous @ waze
 
Machine Learning for Anomaly Detection, Time Series Modeling, and More
Machine Learning for Anomaly Detection, Time Series Modeling, and MoreMachine Learning for Anomaly Detection, Time Series Modeling, and More
Machine Learning for Anomaly Detection, Time Series Modeling, and More
 
Anomaly Detection at Scale!
Anomaly Detection at Scale!Anomaly Detection at Scale!
Anomaly Detection at Scale!
 
Unifying Streaming and Historical Telemetry Data For Real-time Performance Re...
Unifying Streaming and Historical Telemetry Data For Real-time Performance Re...Unifying Streaming and Historical Telemetry Data For Real-time Performance Re...
Unifying Streaming and Historical Telemetry Data For Real-time Performance Re...
 
Power Your Delta Lake with Streaming Transactional Changes
 Power Your Delta Lake with Streaming Transactional Changes Power Your Delta Lake with Streaming Transactional Changes
Power Your Delta Lake with Streaming Transactional Changes
 
Stream Analytics
Stream AnalyticsStream Analytics
Stream Analytics
 
Scaling Your Skillset with Your Data with Jarrett Garcia (Nielsen)
Scaling Your Skillset with Your Data with Jarrett Garcia (Nielsen)Scaling Your Skillset with Your Data with Jarrett Garcia (Nielsen)
Scaling Your Skillset with Your Data with Jarrett Garcia (Nielsen)
 
Reference architecture for Internet of Things
Reference architecture for Internet of ThingsReference architecture for Internet of Things
Reference architecture for Internet of Things
 
Cloud Experience: Data-driven Applications Made Simple and Fast
Cloud Experience: Data-driven Applications Made Simple and FastCloud Experience: Data-driven Applications Made Simple and Fast
Cloud Experience: Data-driven Applications Made Simple and Fast
 
Siscale Lightning Talk: Automated Root Cause Analysis with Elastic Stack
Siscale Lightning Talk: Automated Root Cause Analysis with Elastic StackSiscale Lightning Talk: Automated Root Cause Analysis with Elastic Stack
Siscale Lightning Talk: Automated Root Cause Analysis with Elastic Stack
 
Future Grid Overview 2018
Future Grid Overview 2018Future Grid Overview 2018
Future Grid Overview 2018
 
Life is but a Stream
Life is but a StreamLife is but a Stream
Life is but a Stream
 
Bridging the Completeness of Big Data on Databricks
Bridging the Completeness of Big Data on DatabricksBridging the Completeness of Big Data on Databricks
Bridging the Completeness of Big Data on Databricks
 
Automated Production Ready ML at Scale
Automated Production Ready ML at ScaleAutomated Production Ready ML at Scale
Automated Production Ready ML at Scale
 
The Life of an Internet of Things Electron
The Life of an Internet of Things ElectronThe Life of an Internet of Things Electron
The Life of an Internet of Things Electron
 
Changing the Way Viacom Looks at Video Performance with Mark Cohen and Michae...
Changing the Way Viacom Looks at Video Performance with Mark Cohen and Michae...Changing the Way Viacom Looks at Video Performance with Mark Cohen and Michae...
Changing the Way Viacom Looks at Video Performance with Mark Cohen and Michae...
 
Apache Spark Listeners: A Crash Course in Fast, Easy Monitoring
Apache Spark Listeners: A Crash Course in Fast, Easy MonitoringApache Spark Listeners: A Crash Course in Fast, Easy Monitoring
Apache Spark Listeners: A Crash Course in Fast, Easy Monitoring
 

Ähnlich wie Making Homes Efficient and Comfortable Using AI and IoT Data

AI and Machine Learning for the Connected Home with Stephen Galsworthy
AI and Machine Learning for the Connected Home with Stephen GalsworthyAI and Machine Learning for the Connected Home with Stephen Galsworthy
AI and Machine Learning for the Connected Home with Stephen GalsworthyDatabricks
 
Performance trends and alerts with ThingSpeak IoT
Performance trends and alerts with ThingSpeak IoTPerformance trends and alerts with ThingSpeak IoT
Performance trends and alerts with ThingSpeak IoTAnoush Najarian
 
Saving Energy in Homes with a Unified Approach to Data and AI
Saving Energy in Homes with a Unified Approach to Data and AISaving Energy in Homes with a Unified Approach to Data and AI
Saving Energy in Homes with a Unified Approach to Data and AIDatabricks
 
Quby - we create toon - Enabling smart energy services using scalable data sc...
Quby - we create toon - Enabling smart energy services using scalable data sc...Quby - we create toon - Enabling smart energy services using scalable data sc...
Quby - we create toon - Enabling smart energy services using scalable data sc...BigDataExpo
 
Smart Homes, Smart Farms, Smart Cities and the Internet of Things.
Smart Homes, Smart Farms, Smart Cities and the Internet of Things.Smart Homes, Smart Farms, Smart Cities and the Internet of Things.
Smart Homes, Smart Farms, Smart Cities and the Internet of Things.J. Scott Christianson
 
Smart Fire Detection using Pi and AWS
Smart Fire Detection using Pi and AWSSmart Fire Detection using Pi and AWS
Smart Fire Detection using Pi and AWSakshaykokane09
 
Advanced data science algorithms applied to scalable stream processing by Dav...
Advanced data science algorithms applied to scalable stream processing by Dav...Advanced data science algorithms applied to scalable stream processing by Dav...
Advanced data science algorithms applied to scalable stream processing by Dav...Big Data Spain
 
NSTA 2013 Denver - ArduBlock and Arduino
NSTA 2013 Denver - ArduBlock and ArduinoNSTA 2013 Denver - ArduBlock and Arduino
NSTA 2013 Denver - ArduBlock and ArduinoBrian Huang
 
2016 Ohio Craft Brewer's Conference - Brewery Automation - John Blystone
2016 Ohio Craft Brewer's Conference - Brewery Automation - John Blystone2016 Ohio Craft Brewer's Conference - Brewery Automation - John Blystone
2016 Ohio Craft Brewer's Conference - Brewery Automation - John BlystoneJohn Blystone
 
Graduation Project on "SMART HOMES & RENEWABLE ENERGY" PowerPoint Presentation
Graduation Project on "SMART HOMES & RENEWABLE ENERGY" PowerPoint PresentationGraduation Project on "SMART HOMES & RENEWABLE ENERGY" PowerPoint Presentation
Graduation Project on "SMART HOMES & RENEWABLE ENERGY" PowerPoint PresentationAhmed Khalil Ibrahim
 
Forecasting 'What-if' Scenarios in Retail Using ML-Powered Interactive Tools
Forecasting 'What-if' Scenarios in Retail Using ML-Powered Interactive ToolsForecasting 'What-if' Scenarios in Retail Using ML-Powered Interactive Tools
Forecasting 'What-if' Scenarios in Retail Using ML-Powered Interactive ToolsDatabricks
 
Creating an Internet of Everything
Creating an Internet of Everything Creating an Internet of Everything
Creating an Internet of Everything AllSeen Alliance
 
ch1-What are Things?
ch1-What are Things?ch1-What are Things?
ch1-What are Things?ssuser06ea42
 
Making the Smart Home More Insightful
Making the Smart Home More InsightfulMaking the Smart Home More Insightful
Making the Smart Home More InsightfulVectorform
 
Convert IoT Data to Cash
Convert IoT Data to CashConvert IoT Data to Cash
Convert IoT Data to CashSeluxit
 
Accelerating algorithmic and hardware advancements for power efficient on-dev...
Accelerating algorithmic and hardware advancements for power efficient on-dev...Accelerating algorithmic and hardware advancements for power efficient on-dev...
Accelerating algorithmic and hardware advancements for power efficient on-dev...Qualcomm Research
 
Use Machine Learning to Get the Most out of Your Big Data Clusters
Use Machine Learning to Get the Most out of Your Big Data ClustersUse Machine Learning to Get the Most out of Your Big Data Clusters
Use Machine Learning to Get the Most out of Your Big Data ClustersDatabricks
 
Final Year Project For Computer Science
Final Year Project For  Computer ScienceFinal Year Project For  Computer Science
Final Year Project For Computer ScienceSimplilearn
 
World of IoT by Microsoft Co #iotconfua
World of IoT by Microsoft Co #iotconfuaWorld of IoT by Microsoft Co #iotconfua
World of IoT by Microsoft Co #iotconfuaAndy Shutka
 

Ähnlich wie Making Homes Efficient and Comfortable Using AI and IoT Data (20)

AI and Machine Learning for the Connected Home with Stephen Galsworthy
AI and Machine Learning for the Connected Home with Stephen GalsworthyAI and Machine Learning for the Connected Home with Stephen Galsworthy
AI and Machine Learning for the Connected Home with Stephen Galsworthy
 
Performance trends and alerts with ThingSpeak IoT
Performance trends and alerts with ThingSpeak IoTPerformance trends and alerts with ThingSpeak IoT
Performance trends and alerts with ThingSpeak IoT
 
Saving Energy in Homes with a Unified Approach to Data and AI
Saving Energy in Homes with a Unified Approach to Data and AISaving Energy in Homes with a Unified Approach to Data and AI
Saving Energy in Homes with a Unified Approach to Data and AI
 
Quby - we create toon - Enabling smart energy services using scalable data sc...
Quby - we create toon - Enabling smart energy services using scalable data sc...Quby - we create toon - Enabling smart energy services using scalable data sc...
Quby - we create toon - Enabling smart energy services using scalable data sc...
 
Smart Homes, Smart Farms, Smart Cities and the Internet of Things.
Smart Homes, Smart Farms, Smart Cities and the Internet of Things.Smart Homes, Smart Farms, Smart Cities and the Internet of Things.
Smart Homes, Smart Farms, Smart Cities and the Internet of Things.
 
Smart Fire Detection using Pi and AWS
Smart Fire Detection using Pi and AWSSmart Fire Detection using Pi and AWS
Smart Fire Detection using Pi and AWS
 
Advanced data science algorithms applied to scalable stream processing by Dav...
Advanced data science algorithms applied to scalable stream processing by Dav...Advanced data science algorithms applied to scalable stream processing by Dav...
Advanced data science algorithms applied to scalable stream processing by Dav...
 
NSTA 2013 Denver - ArduBlock and Arduino
NSTA 2013 Denver - ArduBlock and ArduinoNSTA 2013 Denver - ArduBlock and Arduino
NSTA 2013 Denver - ArduBlock and Arduino
 
2016 Ohio Craft Brewer's Conference - Brewery Automation - John Blystone
2016 Ohio Craft Brewer's Conference - Brewery Automation - John Blystone2016 Ohio Craft Brewer's Conference - Brewery Automation - John Blystone
2016 Ohio Craft Brewer's Conference - Brewery Automation - John Blystone
 
Graduation Project on "SMART HOMES & RENEWABLE ENERGY" PowerPoint Presentation
Graduation Project on "SMART HOMES & RENEWABLE ENERGY" PowerPoint PresentationGraduation Project on "SMART HOMES & RENEWABLE ENERGY" PowerPoint Presentation
Graduation Project on "SMART HOMES & RENEWABLE ENERGY" PowerPoint Presentation
 
Forecasting 'What-if' Scenarios in Retail Using ML-Powered Interactive Tools
Forecasting 'What-if' Scenarios in Retail Using ML-Powered Interactive ToolsForecasting 'What-if' Scenarios in Retail Using ML-Powered Interactive Tools
Forecasting 'What-if' Scenarios in Retail Using ML-Powered Interactive Tools
 
Creating an Internet of Everything
Creating an Internet of Everything Creating an Internet of Everything
Creating an Internet of Everything
 
ch1-What are Things?
ch1-What are Things?ch1-What are Things?
ch1-What are Things?
 
Making the Smart Home More Insightful
Making the Smart Home More InsightfulMaking the Smart Home More Insightful
Making the Smart Home More Insightful
 
Making the Smart Home More Insightful
Making the Smart Home More InsightfulMaking the Smart Home More Insightful
Making the Smart Home More Insightful
 
Convert IoT Data to Cash
Convert IoT Data to CashConvert IoT Data to Cash
Convert IoT Data to Cash
 
Accelerating algorithmic and hardware advancements for power efficient on-dev...
Accelerating algorithmic and hardware advancements for power efficient on-dev...Accelerating algorithmic and hardware advancements for power efficient on-dev...
Accelerating algorithmic and hardware advancements for power efficient on-dev...
 
Use Machine Learning to Get the Most out of Your Big Data Clusters
Use Machine Learning to Get the Most out of Your Big Data ClustersUse Machine Learning to Get the Most out of Your Big Data Clusters
Use Machine Learning to Get the Most out of Your Big Data Clusters
 
Final Year Project For Computer Science
Final Year Project For  Computer ScienceFinal Year Project For  Computer Science
Final Year Project For Computer Science
 
World of IoT by Microsoft Co #iotconfua
World of IoT by Microsoft Co #iotconfuaWorld of IoT by Microsoft Co #iotconfua
World of IoT by Microsoft Co #iotconfua
 

Mehr von Databricks

DW Migration Webinar-March 2022.pptx
DW Migration Webinar-March 2022.pptxDW Migration Webinar-March 2022.pptx
DW Migration Webinar-March 2022.pptxDatabricks
 
Data Lakehouse Symposium | Day 1 | Part 1
Data Lakehouse Symposium | Day 1 | Part 1Data Lakehouse Symposium | Day 1 | Part 1
Data Lakehouse Symposium | Day 1 | Part 1Databricks
 
Data Lakehouse Symposium | Day 1 | Part 2
Data Lakehouse Symposium | Day 1 | Part 2Data Lakehouse Symposium | Day 1 | Part 2
Data Lakehouse Symposium | Day 1 | Part 2Databricks
 
Data Lakehouse Symposium | Day 2
Data Lakehouse Symposium | Day 2Data Lakehouse Symposium | Day 2
Data Lakehouse Symposium | Day 2Databricks
 
Data Lakehouse Symposium | Day 4
Data Lakehouse Symposium | Day 4Data Lakehouse Symposium | Day 4
Data Lakehouse Symposium | Day 4Databricks
 
5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop
5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop
5 Critical Steps to Clean Your Data Swamp When Migrating Off of HadoopDatabricks
 
Democratizing Data Quality Through a Centralized Platform
Democratizing Data Quality Through a Centralized PlatformDemocratizing Data Quality Through a Centralized Platform
Democratizing Data Quality Through a Centralized PlatformDatabricks
 
Learn to Use Databricks for Data Science
Learn to Use Databricks for Data ScienceLearn to Use Databricks for Data Science
Learn to Use Databricks for Data ScienceDatabricks
 
Why APM Is Not the Same As ML Monitoring
Why APM Is Not the Same As ML MonitoringWhy APM Is Not the Same As ML Monitoring
Why APM Is Not the Same As ML MonitoringDatabricks
 
The Function, the Context, and the Data—Enabling ML Ops at Stitch Fix
The Function, the Context, and the Data—Enabling ML Ops at Stitch FixThe Function, the Context, and the Data—Enabling ML Ops at Stitch Fix
The Function, the Context, and the Data—Enabling ML Ops at Stitch FixDatabricks
 
Stage Level Scheduling Improving Big Data and AI Integration
Stage Level Scheduling Improving Big Data and AI IntegrationStage Level Scheduling Improving Big Data and AI Integration
Stage Level Scheduling Improving Big Data and AI IntegrationDatabricks
 
Simplify Data Conversion from Spark to TensorFlow and PyTorch
Simplify Data Conversion from Spark to TensorFlow and PyTorchSimplify Data Conversion from Spark to TensorFlow and PyTorch
Simplify Data Conversion from Spark to TensorFlow and PyTorchDatabricks
 
Scaling your Data Pipelines with Apache Spark on Kubernetes
Scaling your Data Pipelines with Apache Spark on KubernetesScaling your Data Pipelines with Apache Spark on Kubernetes
Scaling your Data Pipelines with Apache Spark on KubernetesDatabricks
 
Scaling and Unifying SciKit Learn and Apache Spark Pipelines
Scaling and Unifying SciKit Learn and Apache Spark PipelinesScaling and Unifying SciKit Learn and Apache Spark Pipelines
Scaling and Unifying SciKit Learn and Apache Spark PipelinesDatabricks
 
Sawtooth Windows for Feature Aggregations
Sawtooth Windows for Feature AggregationsSawtooth Windows for Feature Aggregations
Sawtooth Windows for Feature AggregationsDatabricks
 
Redis + Apache Spark = Swiss Army Knife Meets Kitchen Sink
Redis + Apache Spark = Swiss Army Knife Meets Kitchen SinkRedis + Apache Spark = Swiss Army Knife Meets Kitchen Sink
Redis + Apache Spark = Swiss Army Knife Meets Kitchen SinkDatabricks
 
Re-imagine Data Monitoring with whylogs and Spark
Re-imagine Data Monitoring with whylogs and SparkRe-imagine Data Monitoring with whylogs and Spark
Re-imagine Data Monitoring with whylogs and SparkDatabricks
 
Raven: End-to-end Optimization of ML Prediction Queries
Raven: End-to-end Optimization of ML Prediction QueriesRaven: End-to-end Optimization of ML Prediction Queries
Raven: End-to-end Optimization of ML Prediction QueriesDatabricks
 
Processing Large Datasets for ADAS Applications using Apache Spark
Processing Large Datasets for ADAS Applications using Apache SparkProcessing Large Datasets for ADAS Applications using Apache Spark
Processing Large Datasets for ADAS Applications using Apache SparkDatabricks
 
Massive Data Processing in Adobe Using Delta Lake
Massive Data Processing in Adobe Using Delta LakeMassive Data Processing in Adobe Using Delta Lake
Massive Data Processing in Adobe Using Delta LakeDatabricks
 

Mehr von Databricks (20)

DW Migration Webinar-March 2022.pptx
DW Migration Webinar-March 2022.pptxDW Migration Webinar-March 2022.pptx
DW Migration Webinar-March 2022.pptx
 
Data Lakehouse Symposium | Day 1 | Part 1
Data Lakehouse Symposium | Day 1 | Part 1Data Lakehouse Symposium | Day 1 | Part 1
Data Lakehouse Symposium | Day 1 | Part 1
 
Data Lakehouse Symposium | Day 1 | Part 2
Data Lakehouse Symposium | Day 1 | Part 2Data Lakehouse Symposium | Day 1 | Part 2
Data Lakehouse Symposium | Day 1 | Part 2
 
Data Lakehouse Symposium | Day 2
Data Lakehouse Symposium | Day 2Data Lakehouse Symposium | Day 2
Data Lakehouse Symposium | Day 2
 
Data Lakehouse Symposium | Day 4
Data Lakehouse Symposium | Day 4Data Lakehouse Symposium | Day 4
Data Lakehouse Symposium | Day 4
 
5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop
5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop
5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop
 
Democratizing Data Quality Through a Centralized Platform
Democratizing Data Quality Through a Centralized PlatformDemocratizing Data Quality Through a Centralized Platform
Democratizing Data Quality Through a Centralized Platform
 
Learn to Use Databricks for Data Science
Learn to Use Databricks for Data ScienceLearn to Use Databricks for Data Science
Learn to Use Databricks for Data Science
 
Why APM Is Not the Same As ML Monitoring
Why APM Is Not the Same As ML MonitoringWhy APM Is Not the Same As ML Monitoring
Why APM Is Not the Same As ML Monitoring
 
The Function, the Context, and the Data—Enabling ML Ops at Stitch Fix
The Function, the Context, and the Data—Enabling ML Ops at Stitch FixThe Function, the Context, and the Data—Enabling ML Ops at Stitch Fix
The Function, the Context, and the Data—Enabling ML Ops at Stitch Fix
 
Stage Level Scheduling Improving Big Data and AI Integration
Stage Level Scheduling Improving Big Data and AI IntegrationStage Level Scheduling Improving Big Data and AI Integration
Stage Level Scheduling Improving Big Data and AI Integration
 
Simplify Data Conversion from Spark to TensorFlow and PyTorch
Simplify Data Conversion from Spark to TensorFlow and PyTorchSimplify Data Conversion from Spark to TensorFlow and PyTorch
Simplify Data Conversion from Spark to TensorFlow and PyTorch
 
Scaling your Data Pipelines with Apache Spark on Kubernetes
Scaling your Data Pipelines with Apache Spark on KubernetesScaling your Data Pipelines with Apache Spark on Kubernetes
Scaling your Data Pipelines with Apache Spark on Kubernetes
 
Scaling and Unifying SciKit Learn and Apache Spark Pipelines
Scaling and Unifying SciKit Learn and Apache Spark PipelinesScaling and Unifying SciKit Learn and Apache Spark Pipelines
Scaling and Unifying SciKit Learn and Apache Spark Pipelines
 
Sawtooth Windows for Feature Aggregations
Sawtooth Windows for Feature AggregationsSawtooth Windows for Feature Aggregations
Sawtooth Windows for Feature Aggregations
 
Redis + Apache Spark = Swiss Army Knife Meets Kitchen Sink
Redis + Apache Spark = Swiss Army Knife Meets Kitchen SinkRedis + Apache Spark = Swiss Army Knife Meets Kitchen Sink
Redis + Apache Spark = Swiss Army Knife Meets Kitchen Sink
 
Re-imagine Data Monitoring with whylogs and Spark
Re-imagine Data Monitoring with whylogs and SparkRe-imagine Data Monitoring with whylogs and Spark
Re-imagine Data Monitoring with whylogs and Spark
 
Raven: End-to-end Optimization of ML Prediction Queries
Raven: End-to-end Optimization of ML Prediction QueriesRaven: End-to-end Optimization of ML Prediction Queries
Raven: End-to-end Optimization of ML Prediction Queries
 
Processing Large Datasets for ADAS Applications using Apache Spark
Processing Large Datasets for ADAS Applications using Apache SparkProcessing Large Datasets for ADAS Applications using Apache Spark
Processing Large Datasets for ADAS Applications using Apache Spark
 
Massive Data Processing in Adobe Using Delta Lake
Massive Data Processing in Adobe Using Delta LakeMassive Data Processing in Adobe Using Delta Lake
Massive Data Processing in Adobe Using Delta Lake
 

Kürzlich hochgeladen

ChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics InfrastructureChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics Infrastructuresonikadigital1
 
Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...PrithaVashisht1
 
Mapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptxMapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptxVenkatasubramani13
 
Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023Vladislav Solodkiy
 
5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best Practices5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best PracticesDataArchiva
 
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptxTINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptxDwiAyuSitiHartinah
 
The Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayerThe Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayerPavel Šabatka
 
MEASURES OF DISPERSION I BSc Botany .ppt
MEASURES OF DISPERSION I BSc Botany .pptMEASURES OF DISPERSION I BSc Botany .ppt
MEASURES OF DISPERSION I BSc Botany .pptaigil2
 
How is Real-Time Analytics Different from Traditional OLAP?
How is Real-Time Analytics Different from Traditional OLAP?How is Real-Time Analytics Different from Traditional OLAP?
How is Real-Time Analytics Different from Traditional OLAP?sonikadigital1
 
CI, CD -Tools to integrate without manual intervention
CI, CD -Tools to integrate without manual interventionCI, CD -Tools to integrate without manual intervention
CI, CD -Tools to integrate without manual interventionajayrajaganeshkayala
 
YourView Panel Book.pptx YourView Panel Book.
YourView Panel Book.pptx YourView Panel Book.YourView Panel Book.pptx YourView Panel Book.
YourView Panel Book.pptx YourView Panel Book.JasonViviers2
 
Master's Thesis - Data Science - Presentation
Master's Thesis - Data Science - PresentationMaster's Thesis - Data Science - Presentation
Master's Thesis - Data Science - PresentationGiorgio Carbone
 
Virtuosoft SmartSync Product Introduction
Virtuosoft SmartSync Product IntroductionVirtuosoft SmartSync Product Introduction
Virtuosoft SmartSync Product Introductionsanjaymuralee1
 
SFBA Splunk Usergroup meeting March 13, 2024
SFBA Splunk Usergroup meeting March 13, 2024SFBA Splunk Usergroup meeting March 13, 2024
SFBA Splunk Usergroup meeting March 13, 2024Becky Burwell
 
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024Guido X Jansen
 
Strategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
Strategic CX: A Deep Dive into Voice of the Customer Insights for ClarityStrategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
Strategic CX: A Deep Dive into Voice of the Customer Insights for ClarityAggregage
 
AI for Sustainable Development Goals (SDGs)
AI for Sustainable Development Goals (SDGs)AI for Sustainable Development Goals (SDGs)
AI for Sustainable Development Goals (SDGs)Data & Analytics Magazin
 

Kürzlich hochgeladen (17)

ChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics InfrastructureChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics Infrastructure
 
Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...
 
Mapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptxMapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptx
 
Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023
 
5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best Practices5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best Practices
 
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptxTINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
 
The Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayerThe Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayer
 
MEASURES OF DISPERSION I BSc Botany .ppt
MEASURES OF DISPERSION I BSc Botany .pptMEASURES OF DISPERSION I BSc Botany .ppt
MEASURES OF DISPERSION I BSc Botany .ppt
 
How is Real-Time Analytics Different from Traditional OLAP?
How is Real-Time Analytics Different from Traditional OLAP?How is Real-Time Analytics Different from Traditional OLAP?
How is Real-Time Analytics Different from Traditional OLAP?
 
CI, CD -Tools to integrate without manual intervention
CI, CD -Tools to integrate without manual interventionCI, CD -Tools to integrate without manual intervention
CI, CD -Tools to integrate without manual intervention
 
YourView Panel Book.pptx YourView Panel Book.
YourView Panel Book.pptx YourView Panel Book.YourView Panel Book.pptx YourView Panel Book.
YourView Panel Book.pptx YourView Panel Book.
 
Master's Thesis - Data Science - Presentation
Master's Thesis - Data Science - PresentationMaster's Thesis - Data Science - Presentation
Master's Thesis - Data Science - Presentation
 
Virtuosoft SmartSync Product Introduction
Virtuosoft SmartSync Product IntroductionVirtuosoft SmartSync Product Introduction
Virtuosoft SmartSync Product Introduction
 
SFBA Splunk Usergroup meeting March 13, 2024
SFBA Splunk Usergroup meeting March 13, 2024SFBA Splunk Usergroup meeting March 13, 2024
SFBA Splunk Usergroup meeting March 13, 2024
 
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
 
Strategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
Strategic CX: A Deep Dive into Voice of the Customer Insights for ClarityStrategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
Strategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
 
AI for Sustainable Development Goals (SDGs)
AI for Sustainable Development Goals (SDGs)AI for Sustainable Development Goals (SDGs)
AI for Sustainable Development Goals (SDGs)
 

Making Homes Efficient and Comfortable Using AI and IoT Data

  • 1. WIFI SSID: Spark+AISummit | Password: UnifiedDataAnalytics
  • 2. Ellissa Verseput, Quby Making Homes Efficient and Comfortable Using AI and IoT Data #UnifiedDataAnalytics #SparkAISummit
  • 3. Outline • Why, What, How Quby • 2 Example Use Cases – Bill Breakdown (Efficient) – Thermostat Program Advice (Comfortable) 3
  • 4. 4 We believe the future can be better. Easier, more comfortable, and more sustainable. We help businesses and their customers to make this change without compromising on the important things in life.
  • 5. 5
  • 6. Z-Wave Meter adaptors Boiler adapters Gas sensor Philips Hue Z-Wave Central heating system Solar panels and power storage Smart plugs & smoke detectors Electricity sensor Gas Water Water sensor Electricity Athom Homey Amazon Alexa Google HomeDrebbleOlisto
  • 7. 7#UnifiedDataAnalytics #SparkAISummit Over 400,000 connected homes across Europe Our partners:
  • 8. Outline ü Why, What, How Quby • 2 Example Use Cases – Bill Breakdown (Efficient) – Thermostat Program Advice (Comfortable) 8
  • 9. Energy insights gas & electricity (high frequency) Waste checker (~7 use cases) Water insights & saving tips Solar generation integration Smart thermostat functionality Smart home integration Air quality measurement & insights Monitoring the home Smart security solution Assisted living Energy insights with low frequency Dedicated app development for utilities with superior user experience & personal relevance Home services Efficient home Comfortable home Trusted home Current Quby Portfolio 9
  • 10. Use Case #1 Bill Breakdown 10 Show how different appliances and activities in the home contribute to the energy bills
  • 11. Key Technology: Load Disaggregation 11
  • 12. Quby’s disaggregation algorithms 12 Patented algorithms can detect appliances from 10 second resolution electricity meter data
  • 13. Bill Breakdown Categories for 10sec-data 13 Elec data Elec bill
  • 15. Bill Breakdown Categories for 15min-data 15 Elec bill Elec data
  • 17. 17 Utilizing our large database of high-resolution data, we apply advanced techniques to offer a more personalized, more dynamic and more accurate bill breakdown service. Low resolution data Bill breakdownEnhancement Most similar users with high resolution data Appliance detections High resolution data User Similar users
  • 18. Bill Breakdown Architecture 18 Toon data collector P4 data collector API
  • 19. Bill Breakdown for low resolution data 19
  • 20. Outline ü Why, What, How Quby Ø 2 Example Use Cases • Bill Breakdown (Efficient) • Thermostat Program Advice (Comfortable) 20
  • 21. Outline ü Why, What, How Quby Ø 2 Example Use Cases 🤯 Bill Breakdown (Efficient) • Thermostat Program Advice (Comfortable) 21
  • 22. Use Case #2 Thermostat Program Advice 22 Suggest updates to the Toon users’ thermostat program, such that the program better reflects their behavioural patterns
  • 23. Thermostat Program Advice Key Technology 23 Cooling down and warming up rate Humidity sensor Somebody home? Presence Detection
  • 24. Non-intrusive Monitoring 24 Proof of Life – Toon can detect when a person is present Safety – Toon can indicate an active/inactive (elderly) resident Heating/Lighting – Toon can detect people are active to optimize heating
  • 25. Training a Machine Learning Model 25 Hour Mon Tues Wed 08:00 Home Away Home 09:00 Away Away Home 10:00 Away Away Home Hour Mon Tues Wed 08:00 Home Home Home 09:00 Home Away Away 10:00 Away Away Away Cooling down and warming up rate Humidity sensor
  • 26. We want to track model improvements and reproduce models Challenge
  • 28. This is how we did it 28
  • 29. • We have saved the best, trained machine learning model in Python, • but for our production data pipeline we want to use Spark Scala Challenge
  • 31. This is how we did it 31
  • 32. Thermostat Program Advice Architecture 32 Toon data collector Presence Labels API Survey Program Advice
  • 33. What’s next? 33 8:00 Good to see that mom has woken up. I was worried since she complained she had breathing issues. 16:00 Guess the first thing he turned on was the game console. At least, I know he is back home from school 12:00 I left for work early morning, there shouldn’t be any recent activity. Perhaps I should have the neighbors check
  • 34. Assisted Living 34 8:00 Good to see that mom has woken up. I was worried since she complained she had breathing issues. 16:00 Guess the first thing he turned on was the game console. At least, I know he is back home from school 12:00 I left for work early morning, there shouldn’t be any recent activity. Perhaps I should have the neighbors check We can monitor the home to help people care for their loved ones and keep their homes safe & warm.
  • 35. Summary ü Why, What, How Quby ü 2 Example Use Cases ü Bill Breakdown (Efficient) ü Thermostat Program Advice (Comfortable) 35
  • 37. Ellissa Verseput Machine Learning Engineer Ellissa.verseput@quby.com (+31) 6 133 688 21
  • 38. DON’T FORGET TO RATE AND REVIEW THE SESSIONS SEARCH SPARK + AI SUMMIT