Deliver Your Modern Data Warehouse (Microsoft Tech Summit Oslo 2018)

•

2 gefällt mir•1,165 views

Cathrine Wilhelmsen

Deliver Your Modern Data Warehouse (Presented at Microsoft Tech Summit in Oslo on December 6th, 2018)

Daten & Analysen

Deliver Your Modern
Data Warehouse
Cathrine Wilhelmsen, Inmeta
@cathrinew | cathrinew.net

Ingest
Azure
Data Factory
Store
Azure
Blob Storage
Prep & Train
Azure
Databricks
Model & Serve
Azure SQL Data Warehouse
Azure Analysis Services
Analyze
Power BI
ADF Blob
Databric
ks
DW AS PBI

Azure Data Factory
Hybrid data integration pipelines
Scalable ETL/ELT workflows
SSIS lift and shift
ADF

Azure Data Factory: Data Flows
Data transformation at scale
Runs on Azure Databricks
Visual editor, no-code experience
ADF

Azure Blob Storage
Massively scalable object storage
Any type of unstructured data
Premium, Hot, Cool, Archive
Blob

Azure Data Lake Storage Gen2
Scale / cost benefits of Azure Blob Storage
Reliability / performance benefits of Hadoop File System
Optimized for Analytics & AI
Blob

Prep & Train:
Azure Databricks
Databricks

Azure Databricks
Spark-based analytics platform
Collaborative notebook experience
From data preparation to machine learning
Databric
ks

DW
Model & Serve:
Azure SQL Data Warehouse

Azure SQL Data Warehouse
Fully managed enterprise cloud data warehouse
Scale compute and storage separately
Pause and resume when needed
DW

AS
Model & Serve:
Azure Analysis Services

Azure Analysis Services
Enterprise-grade "Analytics as a Service"
Fully managed and highly scalable
Pause and resume when needed
AS

Power BI
Interactive, real-time dashboards and reports
Visually explore and analyze data
From data to insight to action
PBI

@cathrinew
cathrinew.net
hi@cathrinew.net
Thank you! :)

Empfohlen

Pipelines and Packages: Introduction to Azure Data Factory (Techorama NL 2019)Cathrine Wilhelmsen

Tools and Tips For Data Warehouse Developers (SQLGLA)Cathrine Wilhelmsen

ETL in the Cloud With Microsoft AzureMark Kromer

DataOps for the Modern Data Warehouse on Microsoft Azure @ NDCOslo 2020 - Lac...Lace Lofranco

Microsoft Azure BI Solutions in the CloudMark Kromer

Running cost effective big data workloads with Azure Synapse and ADLS (MS Ign...Michael Rys

Unified Data Analytics: Helping Data Teams Solve the World’s Toughest ProblemsDatabricks

Eugene Polonichko "Architecture of modern data warehouse"Lviv Startup Club

Empfohlen

Pipelines and Packages: Introduction to Azure Data Factory (Techorama NL 2019)Cathrine Wilhelmsen

Tools and Tips For Data Warehouse Developers (SQLGLA)Cathrine Wilhelmsen

ETL in the Cloud With Microsoft AzureMark Kromer

DataOps for the Modern Data Warehouse on Microsoft Azure @ NDCOslo 2020 - Lac...Lace Lofranco

Microsoft Azure BI Solutions in the CloudMark Kromer

Running cost effective big data workloads with Azure Synapse and ADLS (MS Ign...Michael Rys

Unified Data Analytics: Helping Data Teams Solve the World’s Toughest ProblemsDatabricks

Eugene Polonichko "Architecture of modern data warehouse"Lviv Startup Club

Introduction to Azure Data FactorySlava Kokaev

Microsoft Build 2018 Analytic Solutions with Azure Data Factory and Azure SQL...Mark Kromer

Intro to Azure Data Factory v1Eric Bragas

Building Data Lakes with Apache AirflowGary Stafford

BTUG - Dec 2014 - Hybrid Connectivity OptionsMichael Stephenson

Azure Data Factory for Azure Data WeekMark Kromer

A developer's introduction to big data processing with Azure DatabricksMicrosoft Tech Community

SharePoint User Group - Leeds - 2015-09-02Michael Stephenson

Azure Synapse Analytics Teaser (Microsoft TechX Oslo 2019)Cathrine Wilhelmsen

Integration Monday - Analysing StackExchange data with Azure Data LakeTom Kerkhove

Azure Synapse 101 Webinar PresentationMatthew W. Bowers

J1 T1 4 - Azure Data Factory vs SSIS - Regis BaccaroMS Cloud Summit

Modern Data architecture DesignKujambu Murugesan

Develop scalable analytical solutions with Azure Data Factory & Azure SQL Dat...Microsoft Tech Community

Super charged prototypingMichael Stephenson

Modern data warehouseRakesh Jayaram

Azure Databricks—Apache Spark as a Service with Sascha DittmannDatabricks

R in Power BIEric Bragas

Azure Data Factory for Redmond SQL PASS UG Sept 2018Mark Kromer

Part 3 - Modern Data Warehouse with Azure SynapseNilesh Gule

Afternoons with Azure - Azure Data ServicesCCG

Azure Data Lake Intro (SQLBits 2016)Michael Rys

Weitere ähnliche Inhalte

Was ist angesagt?

Introduction to Azure Data FactorySlava Kokaev

Microsoft Build 2018 Analytic Solutions with Azure Data Factory and Azure SQL...Mark Kromer

Intro to Azure Data Factory v1Eric Bragas

Building Data Lakes with Apache AirflowGary Stafford

BTUG - Dec 2014 - Hybrid Connectivity OptionsMichael Stephenson

Azure Data Factory for Azure Data WeekMark Kromer

A developer's introduction to big data processing with Azure DatabricksMicrosoft Tech Community

SharePoint User Group - Leeds - 2015-09-02Michael Stephenson

Azure Synapse Analytics Teaser (Microsoft TechX Oslo 2019)Cathrine Wilhelmsen

Integration Monday - Analysing StackExchange data with Azure Data LakeTom Kerkhove

Azure Synapse 101 Webinar PresentationMatthew W. Bowers

J1 T1 4 - Azure Data Factory vs SSIS - Regis BaccaroMS Cloud Summit

Modern Data architecture DesignKujambu Murugesan

Develop scalable analytical solutions with Azure Data Factory & Azure SQL Dat...Microsoft Tech Community

Super charged prototypingMichael Stephenson

Modern data warehouseRakesh Jayaram

Azure Databricks—Apache Spark as a Service with Sascha DittmannDatabricks

R in Power BIEric Bragas

Azure Data Factory for Redmond SQL PASS UG Sept 2018Mark Kromer

Part 3 - Modern Data Warehouse with Azure SynapseNilesh Gule

Was ist angesagt? (20)

Introduction to Azure Data Factory

Microsoft Build 2018 Analytic Solutions with Azure Data Factory and Azure SQL...

Intro to Azure Data Factory v1

Building Data Lakes with Apache Airflow

BTUG - Dec 2014 - Hybrid Connectivity Options

Azure Data Factory for Azure Data Week

A developer's introduction to big data processing with Azure Databricks

SharePoint User Group - Leeds - 2015-09-02

Azure Synapse Analytics Teaser (Microsoft TechX Oslo 2019)

Integration Monday - Analysing StackExchange data with Azure Data Lake

Azure Synapse 101 Webinar Presentation

J1 T1 4 - Azure Data Factory vs SSIS - Regis Baccaro

Modern Data architecture Design

Develop scalable analytical solutions with Azure Data Factory & Azure SQL Dat...

Super charged prototyping

Modern data warehouse

Azure Databricks—Apache Spark as a Service with Sascha Dittmann

R in Power BI

Azure Data Factory for Redmond SQL PASS UG Sept 2018

Part 3 - Modern Data Warehouse with Azure Synapse

Ähnlich wie Deliver Your Modern Data Warehouse (Microsoft Tech Summit Oslo 2018)

Afternoons with Azure - Azure Data ServicesCCG

Azure Data Lake Intro (SQLBits 2016)Michael Rys

Modern dataintegration azuredatafactory_ssisGaurav Malhotra

Big Data Analytics from Azure Cloud to Power BI MobileRoy Kim

Azure fundamental -IntroductionManishK55

Modern Business Intelligence and Advanced AnalyticsCollective Intelligence Inc.

Solucion de BI en AzureMaximiliano Accotto

PASS_Summit_2019_Azure_Storage_Options_for_AnalyticsDustin Vannoy

Data Analysis - Journey Through the CloudIan Massingham

Journey Through the Cloud - Data AnalysisAmazon Web Services

Owning Your Own (Data) Lake HouseData Con LA

Power BI for Big Data and the New Look of Big Data SolutionsJames Serra

New capabilities for modern data integration in the cloudMicrosoft Tech Community

Data Analytics Meetup: Introduction to Azure Data Lake Storage CCG

Azure Days 2019: Business Intelligence auf Azure (Marco Amhof & Yves Mauron)Trivadis

Modern data warehouseElena Lopez

Exploring Microsoft Azure InfrastructuresCCG

Modern Analytics Academy - Data Modeling (1).pptxssuser290967

Introducing Azure SQL Data WarehouseJames Serra

A lap around microsofts business intelligence platformIke Ellis

Ähnlich wie Deliver Your Modern Data Warehouse (Microsoft Tech Summit Oslo 2018) (20)

Afternoons with Azure - Azure Data Services

Azure Data Lake Intro (SQLBits 2016)

Modern dataintegration azuredatafactory_ssis

Big Data Analytics from Azure Cloud to Power BI Mobile

Azure fundamental -Introduction

Modern Business Intelligence and Advanced Analytics

Solucion de BI en Azure

PASS_Summit_2019_Azure_Storage_Options_for_Analytics

Data Analysis - Journey Through the Cloud

Journey Through the Cloud - Data Analysis

Owning Your Own (Data) Lake House

Power BI for Big Data and the New Look of Big Data Solutions

New capabilities for modern data integration in the cloud

Data Analytics Meetup: Introduction to Azure Data Lake Storage

Azure Days 2019: Business Intelligence auf Azure (Marco Amhof & Yves Mauron)

Modern data warehouse

Exploring Microsoft Azure Infrastructures

Modern Analytics Academy - Data Modeling (1).pptx

Introducing Azure SQL Data Warehouse

A lap around microsofts business intelligence platform

Mehr von Cathrine Wilhelmsen

Data Factory in Microsoft Fabric (MsBIP #82)Cathrine Wilhelmsen

Getting Started: Data Factory in Microsoft Fabric (Microsoft Fabric Community...Cathrine Wilhelmsen

Choosing Between Microsoft Fabric, Azure Synapse Analytics and Azure Data Fac...Cathrine Wilhelmsen

Website Analytics in My Pocket using Microsoft Fabric (SQLBits 2024)Cathrine Wilhelmsen

Data Integration using Data Factory in Microsoft Fabric (ESPC Microsoft Fabri...Cathrine Wilhelmsen

Choosing between Fabric, Synapse and Databricks (Data Left Unattended 2023)Cathrine Wilhelmsen

Data Integration with Data Factory (Microsoft Fabric Day Oslo 2023)Cathrine Wilhelmsen

The Battle of the Data Transformation Tools (PASS Data Community Summit 2023)Cathrine Wilhelmsen

Visually Transform Data in Azure Data Factory or Azure Synapse Analytics (PAS...Cathrine Wilhelmsen

Building an End-to-End Solution in Microsoft Fabric: From Dataverse to Power ...Cathrine Wilhelmsen

Website Analytics in my Pocket using Microsoft Fabric (AdaCon 2023)Cathrine Wilhelmsen

Choosing Between Microsoft Fabric, Azure Synapse Analytics and Azure Data Fac...Cathrine Wilhelmsen

Stressed, Depressed, or Burned Out? The Warning Signs You Shouldn't Ignore (D...Cathrine Wilhelmsen

Stressed, Depressed, or Burned Out? The Warning Signs You Shouldn't Ignore (S...Cathrine Wilhelmsen

"I can't keep up!" - Turning Discomfort into Personal Growth in a Fast-Paced ...Cathrine Wilhelmsen

Lessons Learned: Implementing Azure Synapse Analytics in a Rapidly-Changing S...Cathrine Wilhelmsen

6 Tips for Building Confidence as a Public Speaker (SQLBits 2022)Cathrine Wilhelmsen

Lessons Learned: Understanding Pipeline Pricing in Azure Data Factory and Azu...Cathrine Wilhelmsen

Pipelines and Data Flows: Introduction to Data Integration in Azure Synapse A...Cathrine Wilhelmsen

Mehr von Cathrine Wilhelmsen (20)

Data Factory in Microsoft Fabric (MsBIP #82)

Getting Started: Data Factory in Microsoft Fabric (Microsoft Fabric Community...

Choosing Between Microsoft Fabric, Azure Synapse Analytics and Azure Data Fac...

Website Analytics in My Pocket using Microsoft Fabric (SQLBits 2024)

Data Integration using Data Factory in Microsoft Fabric (ESPC Microsoft Fabri...

Choosing between Fabric, Synapse and Databricks (Data Left Unattended 2023)

Data Integration with Data Factory (Microsoft Fabric Day Oslo 2023)

The Battle of the Data Transformation Tools (PASS Data Community Summit 2023)

Visually Transform Data in Azure Data Factory or Azure Synapse Analytics (PAS...

Building an End-to-End Solution in Microsoft Fabric: From Dataverse to Power ...

Website Analytics in my Pocket using Microsoft Fabric (AdaCon 2023)

Choosing Between Microsoft Fabric, Azure Synapse Analytics and Azure Data Fac...

Stressed, Depressed, or Burned Out? The Warning Signs You Shouldn't Ignore (D...

Stressed, Depressed, or Burned Out? The Warning Signs You Shouldn't Ignore (S...

"I can't keep up!" - Turning Discomfort into Personal Growth in a Fast-Paced ...

Lessons Learned: Implementing Azure Synapse Analytics in a Rapidly-Changing S...

6 Tips for Building Confidence as a Public Speaker (SQLBits 2022)

Lessons Learned: Understanding Pipeline Pricing in Azure Data Factory and Azu...

Pipelines and Data Flows: Introduction to Data Integration in Azure Synapse A...

Kürzlich hochgeladen

NO1 Certified Black Magic Specialist Expert Amil baba in Lahore Islamabad Raw...Amil Baba Dawood bangali

INTRODUCTION TO Natural language processingsocarem879

Minimizing AI Hallucinations/Confabulations and the Path towards AGI with Exa...Thomas Poetter

Decoding the Heart: Student Presentation on Heart Attack Prediction with Data...Boston Institute of Analytics

Semantic Shed - Squashing and Squeezing.pptxMike Bennett

modul pembelajaran robotic Workshop _ by Slidesgo.pptxaleedritatuxx

convolutional neural network and its applications.pdfSubhamKumar3239

Advanced Machine Learning for Business ProfessionalsVICTOR MAESTRE RAMIREZ

Conf42-LLM_Adding Generative AI to Real-Time Streaming PipelinesTimothy Spann

Digital Marketing Plan, how digital marketing worksdeepakthakur548787

Unveiling the Role of Social Media Suspect Investigators in Preventing Online...Milind Agarwal

FAIR, FAIRsharing, FAIR Cookbook and ELIXIR - Sansone SA - Boston 2024Susanna-Assunta Sansone

Networking Case Study prepared by teacher.pptxHimangsuNath

Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...Boston Institute of Analytics

SMOTE and K-Fold Cross Validation-Presentation.pptxHaritikaChhatwal1

Decoding Patterns: Customer Churn Prediction Data Analysis ProjectBoston Institute of Analytics

English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdfblazblazml

Data Analysis Project : Targeting the Right Customers, Presentation on Bank M...Boston Institute of Analytics

Student profile product demonstration on grades, ability, well-being and mind...Seán Kennedy

Predictive Analysis for Loan Default Presentation : Data Analysis Project PPTBoston Institute of Analytics

Kürzlich hochgeladen (20)

NO1 Certified Black Magic Specialist Expert Amil baba in Lahore Islamabad Raw...

INTRODUCTION TO Natural language processing

Minimizing AI Hallucinations/Confabulations and the Path towards AGI with Exa...

Decoding the Heart: Student Presentation on Heart Attack Prediction with Data...

Semantic Shed - Squashing and Squeezing.pptx

modul pembelajaran robotic Workshop _ by Slidesgo.pptx

convolutional neural network and its applications.pdf

Advanced Machine Learning for Business Professionals

Conf42-LLM_Adding Generative AI to Real-Time Streaming Pipelines

Digital Marketing Plan, how digital marketing works

Unveiling the Role of Social Media Suspect Investigators in Preventing Online...

FAIR, FAIRsharing, FAIR Cookbook and ELIXIR - Sansone SA - Boston 2024

Networking Case Study prepared by teacher.pptx

Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...

SMOTE and K-Fold Cross Validation-Presentation.pptx

Decoding Patterns: Customer Churn Prediction Data Analysis Project

English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdf

Data Analysis Project : Targeting the Right Customers, Presentation on Bank M...

Student profile product demonstration on grades, ability, well-being and mind...

Predictive Analysis for Loan Default Presentation : Data Analysis Project PPT

Deliver Your Modern Data Warehouse (Microsoft Tech Summit Oslo 2018)

1. Deliver Your Modern Data Warehouse Cathrine Wilhelmsen, Inmeta @cathrinew | cathrinew.net

2. Modern Data Warehouse

3. All Data Any Scale Intelligent Insights

4. ADF Blob Databric ks DW AS PBI

5. Ingest Azure Data Factory Store Azure Blob Storage Prep & Train Azure Databricks Model & Serve Azure SQL Data Warehouse Azure Analysis Services Analyze Power BI ADF Blob Databric ks DW AS PBI

6. Ingest: Azure Data Factory ADF

7. Azure Data Factory Hybrid data integration pipelines Scalable ETL/ELT workflows SSIS lift and shift ADF

8. Azure Data Factory ADF

9. Azure Data Factory: Data Flows Data transformation at scale Runs on Azure Databricks Visual editor, no-code experience ADF

10. Azure Data Factory: Data Flows ADF

11. Store: Azure Blob Storage Blob

12. Azure Blob Storage Massively scalable object storage Any type of unstructured data Premium, Hot, Cool, Archive Blob

13. Azure Data Lake Storage Gen2 Scale / cost benefits of Azure Blob Storage Reliability / performance benefits of Hadoop File System Optimized for Analytics & AI Blob

14. Prep & Train: Azure Databricks Databricks

15. Azure Databricks Spark-based analytics platform Collaborative notebook experience From data preparation to machine learning Databric ks

16. Azure Databricks Databric ks

17. DW Model & Serve: Azure SQL Data Warehouse

18. Azure SQL Data Warehouse Fully managed enterprise cloud data warehouse Scale compute and storage separately Pause and resume when needed DW

19. Azure SQL Data Warehouse DW

20. AS Model & Serve: Azure Analysis Services

21. Azure Analysis Services Enterprise-grade "Analytics as a Service" Fully managed and highly scalable Pause and resume when needed AS

22. PBI Analyze: Power BI

23. Power BI Interactive, real-time dashboards and reports Visually explore and analyze data From data to insight to action PBI

24. Power BI PBI

25. Ingest Azure Data Factory Store Azure Blob Storage Prep & Train Azure Databricks Model & Serve Azure SQL Data Warehouse Azure Analysis Services Analyze Power BI ADF Blob Databric ks DW AS PBI

26. ADF Blob Databricks DW AS PBI

27. Modern Data Warehouse

28. Insights Data Action

29. @cathrinew cathrinew.net hi@cathrinew.net Thank you! :)