SlideShare ist ein Scribd-Unternehmen logo
1 von 25
Downloaden Sie, um offline zu lesen
12.12.2015
Real-Time PowerBI:
API, Events, Hubs and Streams
Davide Mauri
dmauri@solidq.com
@mauridb
12.12.2015
12.12.2015
Thank you to our AWESOME sponsors!
12.12.2015
Davide Mauri
 Microsoft SQL Server MVP
 Works with SQL Server from 6.5, on BI from 2003
 Specialized in Data Solution Architecture, Database
Design, Performance Tuning, High-Performance Data
Warehousing, BI, Big Data
 President of UGISS (Italian SQL Server UG)
 Regular Speaker @ SQL Server events
 Consulting & Training, Mentor @ SolidQ
 E-mail: dmauri@solidq.com
 Twitter: @mauridb
 Blog: http://sqlblog.com/blogs/davide_mauri/default.aspx
12.12.2015
PowerBI
 You all know what is that, right?
12.12.2015
What about REAL TIME dashboards?
Two possible ways:
https://msdn.microsoft.com/library/mt267603.aspx
12.12.2015
First Option: PowerBI API
12.12.2015
Power BI API Workflow
https://msdn.microsoft.com/en-us/library/dn877544.aspx
12.12.2015
Power BI & Your App
 As many (all?) other Microsoft product, Power BI is a
also (mainly?) platform
 Rich set of REST API
 REST: REpresentational State Transfer (REST)
 http://www.restapitutorial.com/lessons/whatisrest.html
 Allows to interact and manage almost all Power BI
objects
 Allows the creation of automatic updated (near) real-
time dashboard
12.12.2015
Power BI & Your App
 What you can do via Power BI REST API?
 Get and create Datasets.
 Get Tables and update Table schema.
 Add Rows and Delete Rows.
 Get Groups.
 Create Import, Get Imports, Get Import from GUID, and Get
Import by File Path.
 Dashboard operations: Get Dashboards and Get Tiles.
 Power BI REST API Limitations / Throttling
 https://msdn.microsoft.com/en-US/library/dn950053.aspx
12.12.2015
Power BI & Your App
 Authentication needed
 Azure Active Directory
 Via OAuth2
 Full interactive documentation of Power BI REST
API available here:
 http://docs.powerbi.apiary.io/
12.12.2015
Demo
apiary.io
12.12.2015
Integrate Power BI With Your App
 Create a user account using Azure AD
 Add a new Application from the Azure
Management Portal
 https://manage.windowsazure.com
 Allow Application to access Power BI
 Grant Application Delegated Permissions
 Get Client ID
12.12.2015
Integrate Power BI With Your App
 Authenticate against Azure AD
 Use Microsoft.IdentityModel.Clients.ActiveDirectory Library
 From NuGet. Latest version as of today: 2.19.208020213
 Get the token
 New or Refreshed one
 Call the desired REST API specifying the Bearer Token
in the Header
 Receive the JSON answer
 JSON.NET strongly recommended 
12.12.2015
Demo
PowerBI Client Console
12.12.2015
Integration via Event Hub and Stream Analytics
 Event hubs allows to ingest *a lot* of events
 Up to millions per second
 Again, REST API
 Assembly with Object Model available on GitHub
 WindowsAzure.ServiceBus (as of today: 3.0.9)
 API for Sending events
 But also for managing Event Hubs
12.12.2015
Demo
Event Hubs Client Console
12.12.2015
Second Option: Streaming Data
12.12.2015
Lambda Architecture
 Fits in the lambda architecture vision
 Real time and “batch” analytics
 http://lambda-architecture.net/
12.12.2015
Integration via Event Hub and Stream Analytics
 Azure Stream Analytics allows you to execute
streaming queries
 Like StreamInsight or Apache Storm
 Inputs and Outputs has to ben defined
 Streaming or Reference Data supported
 Can use Event hubs as a Streaming Source
12.12.2015
Integration via Event Hub and Stream Analytics
 Use Streaming SQL to
 Transform/Aggregate Streaming data
 Send results to an output
 One of the output can be PowerBI
 This enables the creation of Real-Time Dashboard
 That are automatically refreshed
12.12.2015
Demo
Power BI & Stream Analytics
12.12.2015
Third Option: PowerBI DirectQuery
12.12.2015
Non-Streamed Data
 Another option is Azure SQL/DW + PowerBI with
Direct Query
 Stream Analytics will output to an Azure SQL Database
 100% Lambda Architecture
 Merging can be done via Views or via Power Query
 No Streaming so no automatic chart updates
 You don’t need to refresh data, since we’re using Direct
Query
12.12.2015
Questions?
12.12.2015
Thanks!!!

Weitere ähnliche Inhalte

Was ist angesagt?

Microsoft Power BI Overview
Microsoft Power BI OverviewMicrosoft Power BI Overview
Microsoft Power BI OverviewNetwoven Inc.
 
What Is Power BI? | Introduction To Microsoft Power BI | Power BI Training | ...
What Is Power BI? | Introduction To Microsoft Power BI | Power BI Training | ...What Is Power BI? | Introduction To Microsoft Power BI | Power BI Training | ...
What Is Power BI? | Introduction To Microsoft Power BI | Power BI Training | ...Edureka!
 
Introduction to Power BI to make smart decisions
Introduction to Power BI to make smart decisionsIntroduction to Power BI to make smart decisions
Introduction to Power BI to make smart decisionsVIVEK GURURANI
 
Power BI - Bring your data together
Power BI - Bring your data togetherPower BI - Bring your data together
Power BI - Bring your data togetherStéphane Fréchette
 
Building a Dashboard in an hour with Power Pivot and Power BI
Building a Dashboard in an hour with Power Pivot and Power BIBuilding a Dashboard in an hour with Power Pivot and Power BI
Building a Dashboard in an hour with Power Pivot and Power BINR Computer Learning Center
 
Data Lakehouse Symposium | Day 4
Data Lakehouse Symposium | Day 4Data Lakehouse Symposium | Day 4
Data Lakehouse Symposium | Day 4Databricks
 
Power bi introduction
Power bi introductionPower bi introduction
Power bi introductionBishwadeb Dey
 
Data Modeling on Azure for Analytics
Data Modeling on Azure for AnalyticsData Modeling on Azure for Analytics
Data Modeling on Azure for AnalyticsIke Ellis
 
Introduction to power BI
Introduction to power BIIntroduction to power BI
Introduction to power BIRamar Bose
 
Microsoft Power BI
Microsoft Power BIMicrosoft Power BI
Microsoft Power BIGeetika
 
Cepta The Future of Data with Power BI
Cepta The Future of Data with Power BICepta The Future of Data with Power BI
Cepta The Future of Data with Power BIKellyn Pot'Vin-Gorman
 
Self-Service Business Intelligence with Power BI
Self-Service Business Intelligence with Power BISelf-Service Business Intelligence with Power BI
Self-Service Business Intelligence with Power BITheresa Lubelski
 
Power BI Report Server Enterprise Architecture, Tools to Publish reports and ...
Power BI Report Server Enterprise Architecture, Tools to Publish reports and ...Power BI Report Server Enterprise Architecture, Tools to Publish reports and ...
Power BI Report Server Enterprise Architecture, Tools to Publish reports and ...Vishal Pawar
 
What is Power BI
What is Power BIWhat is Power BI
What is Power BIDries Vyvey
 
Learn why Microsoft Power BI is an Undisputed Market Leader?
Learn why Microsoft Power BI is an Undisputed Market Leader?Learn why Microsoft Power BI is an Undisputed Market Leader?
Learn why Microsoft Power BI is an Undisputed Market Leader?Visual_BI
 
Microsoft Power BI Technical Overview
Microsoft Power BI Technical OverviewMicrosoft Power BI Technical Overview
Microsoft Power BI Technical OverviewDavid J Rosenthal
 

Was ist angesagt? (20)

Microsoft Power BI Overview
Microsoft Power BI OverviewMicrosoft Power BI Overview
Microsoft Power BI Overview
 
What Is Power BI? | Introduction To Microsoft Power BI | Power BI Training | ...
What Is Power BI? | Introduction To Microsoft Power BI | Power BI Training | ...What Is Power BI? | Introduction To Microsoft Power BI | Power BI Training | ...
What Is Power BI? | Introduction To Microsoft Power BI | Power BI Training | ...
 
Power BI visuals
Power BI visualsPower BI visuals
Power BI visuals
 
Power bi
Power biPower bi
Power bi
 
Introduction to Power BI to make smart decisions
Introduction to Power BI to make smart decisionsIntroduction to Power BI to make smart decisions
Introduction to Power BI to make smart decisions
 
Power BI - Bring your data together
Power BI - Bring your data togetherPower BI - Bring your data together
Power BI - Bring your data together
 
Building a Dashboard in an hour with Power Pivot and Power BI
Building a Dashboard in an hour with Power Pivot and Power BIBuilding a Dashboard in an hour with Power Pivot and Power BI
Building a Dashboard in an hour with Power Pivot and Power BI
 
Data Lakehouse Symposium | Day 4
Data Lakehouse Symposium | Day 4Data Lakehouse Symposium | Day 4
Data Lakehouse Symposium | Day 4
 
Power bi introduction
Power bi introductionPower bi introduction
Power bi introduction
 
Data Modeling on Azure for Analytics
Data Modeling on Azure for AnalyticsData Modeling on Azure for Analytics
Data Modeling on Azure for Analytics
 
Introduction to power BI
Introduction to power BIIntroduction to power BI
Introduction to power BI
 
Microsoft Power BI
Microsoft Power BIMicrosoft Power BI
Microsoft Power BI
 
Cepta The Future of Data with Power BI
Cepta The Future of Data with Power BICepta The Future of Data with Power BI
Cepta The Future of Data with Power BI
 
Power BI
Power BIPower BI
Power BI
 
Power bi
Power biPower bi
Power bi
 
Self-Service Business Intelligence with Power BI
Self-Service Business Intelligence with Power BISelf-Service Business Intelligence with Power BI
Self-Service Business Intelligence with Power BI
 
Power BI Report Server Enterprise Architecture, Tools to Publish reports and ...
Power BI Report Server Enterprise Architecture, Tools to Publish reports and ...Power BI Report Server Enterprise Architecture, Tools to Publish reports and ...
Power BI Report Server Enterprise Architecture, Tools to Publish reports and ...
 
What is Power BI
What is Power BIWhat is Power BI
What is Power BI
 
Learn why Microsoft Power BI is an Undisputed Market Leader?
Learn why Microsoft Power BI is an Undisputed Market Leader?Learn why Microsoft Power BI is an Undisputed Market Leader?
Learn why Microsoft Power BI is an Undisputed Market Leader?
 
Microsoft Power BI Technical Overview
Microsoft Power BI Technical OverviewMicrosoft Power BI Technical Overview
Microsoft Power BI Technical Overview
 

Andere mochten auch

Dashboarding with Microsoft: Datazen & Power BI
Dashboarding with Microsoft: Datazen & Power BIDashboarding with Microsoft: Datazen & Power BI
Dashboarding with Microsoft: Datazen & Power BIDavide Mauri
 
Bring your data to life with Power BI
Bring your data to life with Power BIBring your data to life with Power BI
Bring your data to life with Power BIMicrosoft Österreich
 
Automating the testing of your bi solution with n bi
Automating the testing of your bi solution with n biAutomating the testing of your bi solution with n bi
Automating the testing of your bi solution with n biCédric Charlier
 
Datarace: IoT e Big Data (Italian)
Datarace: IoT e Big Data (Italian)Datarace: IoT e Big Data (Italian)
Datarace: IoT e Big Data (Italian)Davide Mauri
 
Iris Multi-Class Classifier with Azure ML
Iris Multi-Class Classifier with Azure MLIris Multi-Class Classifier with Azure ML
Iris Multi-Class Classifier with Azure MLDavide Mauri
 
SQL Server 2016 Temporal Tables
SQL Server 2016 Temporal TablesSQL Server 2016 Temporal Tables
SQL Server 2016 Temporal TablesDavide Mauri
 
Azure Machine Learning
Azure Machine LearningAzure Machine Learning
Azure Machine LearningDavide Mauri
 
AzureML - Creating and Using Machine Learning Solutions (Italian)
AzureML - Creating and Using Machine Learning Solutions (Italian)AzureML - Creating and Using Machine Learning Solutions (Italian)
AzureML - Creating and Using Machine Learning Solutions (Italian)Davide Mauri
 
SSIS Monitoring Deep Dive
SSIS Monitoring Deep DiveSSIS Monitoring Deep Dive
SSIS Monitoring Deep DiveDavide Mauri
 
SQL Server 2016 What's New For Developers
SQL Server 2016  What's New For DevelopersSQL Server 2016  What's New For Developers
SQL Server 2016 What's New For DevelopersDavide Mauri
 
Agile Data Warehousing
Agile Data WarehousingAgile Data Warehousing
Agile Data WarehousingDavide Mauri
 
BIML: BI to the next level
BIML: BI to the next levelBIML: BI to the next level
BIML: BI to the next levelDavide Mauri
 
Azure Machine Learning (Italian)
Azure Machine Learning (Italian)Azure Machine Learning (Italian)
Azure Machine Learning (Italian)Davide Mauri
 
Temporal Snapshot Fact Tables
Temporal Snapshot Fact TablesTemporal Snapshot Fact Tables
Temporal Snapshot Fact TablesDavide Mauri
 
Azure ML: from basic to integration with custom applications
Azure ML: from basic to integration with custom applicationsAzure ML: from basic to integration with custom applications
Azure ML: from basic to integration with custom applicationsDavide Mauri
 
Les 4 phases du management de projet
Les 4 phases du management de projetLes 4 phases du management de projet
Les 4 phases du management de projetAntonin GAUNAND
 
Automatiser les tests des développements BI grâce à NBi
Automatiser les tests des développements BI grâce à NBiAutomatiser les tests des développements BI grâce à NBi
Automatiser les tests des développements BI grâce à NBiCédric Charlier
 
Azure event hubs, Stream Analytics & Power BI (by Sam Vanhoutte)
Azure event hubs, Stream Analytics & Power BI (by Sam Vanhoutte)Azure event hubs, Stream Analytics & Power BI (by Sam Vanhoutte)
Azure event hubs, Stream Analytics & Power BI (by Sam Vanhoutte)Codit
 

Andere mochten auch (19)

Dashboarding with Microsoft: Datazen & Power BI
Dashboarding with Microsoft: Datazen & Power BIDashboarding with Microsoft: Datazen & Power BI
Dashboarding with Microsoft: Datazen & Power BI
 
Bring your data to life with Power BI
Bring your data to life with Power BIBring your data to life with Power BI
Bring your data to life with Power BI
 
Automating the testing of your bi solution with n bi
Automating the testing of your bi solution with n biAutomating the testing of your bi solution with n bi
Automating the testing of your bi solution with n bi
 
Datarace: IoT e Big Data (Italian)
Datarace: IoT e Big Data (Italian)Datarace: IoT e Big Data (Italian)
Datarace: IoT e Big Data (Italian)
 
Iris Multi-Class Classifier with Azure ML
Iris Multi-Class Classifier with Azure MLIris Multi-Class Classifier with Azure ML
Iris Multi-Class Classifier with Azure ML
 
SQL Server 2016 Temporal Tables
SQL Server 2016 Temporal TablesSQL Server 2016 Temporal Tables
SQL Server 2016 Temporal Tables
 
Azure Machine Learning
Azure Machine LearningAzure Machine Learning
Azure Machine Learning
 
Data modeling facts
Data modeling factsData modeling facts
Data modeling facts
 
AzureML - Creating and Using Machine Learning Solutions (Italian)
AzureML - Creating and Using Machine Learning Solutions (Italian)AzureML - Creating and Using Machine Learning Solutions (Italian)
AzureML - Creating and Using Machine Learning Solutions (Italian)
 
SSIS Monitoring Deep Dive
SSIS Monitoring Deep DiveSSIS Monitoring Deep Dive
SSIS Monitoring Deep Dive
 
SQL Server 2016 What's New For Developers
SQL Server 2016  What's New For DevelopersSQL Server 2016  What's New For Developers
SQL Server 2016 What's New For Developers
 
Agile Data Warehousing
Agile Data WarehousingAgile Data Warehousing
Agile Data Warehousing
 
BIML: BI to the next level
BIML: BI to the next levelBIML: BI to the next level
BIML: BI to the next level
 
Azure Machine Learning (Italian)
Azure Machine Learning (Italian)Azure Machine Learning (Italian)
Azure Machine Learning (Italian)
 
Temporal Snapshot Fact Tables
Temporal Snapshot Fact TablesTemporal Snapshot Fact Tables
Temporal Snapshot Fact Tables
 
Azure ML: from basic to integration with custom applications
Azure ML: from basic to integration with custom applicationsAzure ML: from basic to integration with custom applications
Azure ML: from basic to integration with custom applications
 
Les 4 phases du management de projet
Les 4 phases du management de projetLes 4 phases du management de projet
Les 4 phases du management de projet
 
Automatiser les tests des développements BI grâce à NBi
Automatiser les tests des développements BI grâce à NBiAutomatiser les tests des développements BI grâce à NBi
Automatiser les tests des développements BI grâce à NBi
 
Azure event hubs, Stream Analytics & Power BI (by Sam Vanhoutte)
Azure event hubs, Stream Analytics & Power BI (by Sam Vanhoutte)Azure event hubs, Stream Analytics & Power BI (by Sam Vanhoutte)
Azure event hubs, Stream Analytics & Power BI (by Sam Vanhoutte)
 

Ähnlich wie Real Time Power BI

Power BI for Big Data and the New Look of Big Data Solutions
Power BI for Big Data and the New Look of Big Data SolutionsPower BI for Big Data and the New Look of Big Data Solutions
Power BI for Big Data and the New Look of Big Data SolutionsJames Serra
 
Sql server and cloud
Sql server and cloudSql server and cloud
Sql server and cloudKiki Noviandi
 
Power BI Report Server: a Deep Dive for PASS Business Analytics Virtual Group
Power BI Report Server: a Deep Dive for PASS Business Analytics Virtual GroupPower BI Report Server: a Deep Dive for PASS Business Analytics Virtual Group
Power BI Report Server: a Deep Dive for PASS Business Analytics Virtual GroupLuca Gualtieri
 
Microsoft gets a life on sql and power bi
Microsoft gets a life on sql and power biMicrosoft gets a life on sql and power bi
Microsoft gets a life on sql and power biOmar Khan
 
Power BI for Developers @ SQLSaturday #420 (Paris)
Power BI for Developers @ SQLSaturday #420 (Paris)Power BI for Developers @ SQLSaturday #420 (Paris)
Power BI for Developers @ SQLSaturday #420 (Paris)Rui Romano
 
Modern Business Intelligence and Advanced Analytics
Modern Business Intelligence and Advanced AnalyticsModern Business Intelligence and Advanced Analytics
Modern Business Intelligence and Advanced AnalyticsCollective Intelligence Inc.
 
EWUG - Bridging the legacy gap in modern workplaces
EWUG - Bridging the legacy gap in modern workplacesEWUG - Bridging the legacy gap in modern workplaces
EWUG - Bridging the legacy gap in modern workplacesPeter Selch Dahl
 
Embed Interactive Reports in Your Apps
Embed Interactive Reports in Your AppsEmbed Interactive Reports in Your Apps
Embed Interactive Reports in Your AppsTeo Lachev
 
Delivering Real-Time Power BI Dashboards
Delivering Real-Time Power BI DashboardsDelivering Real-Time Power BI Dashboards
Delivering Real-Time Power BI DashboardsYugo Shimizu
 
Enterprise Ready - What's New in Data Center
Enterprise Ready - What's New in Data CenterEnterprise Ready - What's New in Data Center
Enterprise Ready - What's New in Data CenterAtlassian
 
Capture the Cloud with Azure
Capture the Cloud with AzureCapture the Cloud with Azure
Capture the Cloud with AzureShahed Chowdhuri
 
Introduction to Azure Stream Analytics
Introduction to Azure Stream AnalyticsIntroduction to Azure Stream Analytics
Introduction to Azure Stream AnalyticsSlava Kokaev
 
Analyzing & Visualizing Cloud Data With Power BI
Analyzing & Visualizing Cloud Data With Power BIAnalyzing & Visualizing Cloud Data With Power BI
Analyzing & Visualizing Cloud Data With Power BIRichard Harbridge
 
Sql server analysis_services_datasheet
Sql server analysis_services_datasheetSql server analysis_services_datasheet
Sql server analysis_services_datasheetPuneet Jha
 
Introducing Power BI Embedded
Introducing Power BI EmbeddedIntroducing Power BI Embedded
Introducing Power BI EmbeddedMostafa
 
Azure Stream Analytics
Azure Stream AnalyticsAzure Stream Analytics
Azure Stream AnalyticsMarco Parenzan
 
Microsoft & Pyramid Analytics: What the Microsoft and Pyramid Analytics' Stra...
Microsoft & Pyramid Analytics: What the Microsoft and Pyramid Analytics' Stra...Microsoft & Pyramid Analytics: What the Microsoft and Pyramid Analytics' Stra...
Microsoft & Pyramid Analytics: What the Microsoft and Pyramid Analytics' Stra...Pyramid Analytics
 
SQL Server 2019 Big Data Cluster
SQL Server 2019 Big Data ClusterSQL Server 2019 Big Data Cluster
SQL Server 2019 Big Data ClusterMaximiliano Accotto
 
Big Data Analytics from Azure Cloud to Power BI Mobile
Big Data Analytics from Azure Cloud to Power BI MobileBig Data Analytics from Azure Cloud to Power BI Mobile
Big Data Analytics from Azure Cloud to Power BI MobileRoy Kim
 

Ähnlich wie Real Time Power BI (20)

Power BI for Big Data and the New Look of Big Data Solutions
Power BI for Big Data and the New Look of Big Data SolutionsPower BI for Big Data and the New Look of Big Data Solutions
Power BI for Big Data and the New Look of Big Data Solutions
 
Sql server and cloud
Sql server and cloudSql server and cloud
Sql server and cloud
 
Power BI Report Server: a Deep Dive for PASS Business Analytics Virtual Group
Power BI Report Server: a Deep Dive for PASS Business Analytics Virtual GroupPower BI Report Server: a Deep Dive for PASS Business Analytics Virtual Group
Power BI Report Server: a Deep Dive for PASS Business Analytics Virtual Group
 
Microsoft gets a life on sql and power bi
Microsoft gets a life on sql and power biMicrosoft gets a life on sql and power bi
Microsoft gets a life on sql and power bi
 
Power BI for Developers @ SQLSaturday #420 (Paris)
Power BI for Developers @ SQLSaturday #420 (Paris)Power BI for Developers @ SQLSaturday #420 (Paris)
Power BI for Developers @ SQLSaturday #420 (Paris)
 
Modern Business Intelligence and Advanced Analytics
Modern Business Intelligence and Advanced AnalyticsModern Business Intelligence and Advanced Analytics
Modern Business Intelligence and Advanced Analytics
 
EWUG - Bridging the legacy gap in modern workplaces
EWUG - Bridging the legacy gap in modern workplacesEWUG - Bridging the legacy gap in modern workplaces
EWUG - Bridging the legacy gap in modern workplaces
 
Embed Interactive Reports in Your Apps
Embed Interactive Reports in Your AppsEmbed Interactive Reports in Your Apps
Embed Interactive Reports in Your Apps
 
Delivering Real-Time Power BI Dashboards
Delivering Real-Time Power BI DashboardsDelivering Real-Time Power BI Dashboards
Delivering Real-Time Power BI Dashboards
 
Enterprise Ready - What's New in Data Center
Enterprise Ready - What's New in Data CenterEnterprise Ready - What's New in Data Center
Enterprise Ready - What's New in Data Center
 
Capture the Cloud with Azure
Capture the Cloud with AzureCapture the Cloud with Azure
Capture the Cloud with Azure
 
Introduction to Azure Stream Analytics
Introduction to Azure Stream AnalyticsIntroduction to Azure Stream Analytics
Introduction to Azure Stream Analytics
 
Analyzing & Visualizing Cloud Data With Power BI
Analyzing & Visualizing Cloud Data With Power BIAnalyzing & Visualizing Cloud Data With Power BI
Analyzing & Visualizing Cloud Data With Power BI
 
DevIntersection2015-Hybrid2015Final2.pptx
DevIntersection2015-Hybrid2015Final2.pptxDevIntersection2015-Hybrid2015Final2.pptx
DevIntersection2015-Hybrid2015Final2.pptx
 
Sql server analysis_services_datasheet
Sql server analysis_services_datasheetSql server analysis_services_datasheet
Sql server analysis_services_datasheet
 
Introducing Power BI Embedded
Introducing Power BI EmbeddedIntroducing Power BI Embedded
Introducing Power BI Embedded
 
Azure Stream Analytics
Azure Stream AnalyticsAzure Stream Analytics
Azure Stream Analytics
 
Microsoft & Pyramid Analytics: What the Microsoft and Pyramid Analytics' Stra...
Microsoft & Pyramid Analytics: What the Microsoft and Pyramid Analytics' Stra...Microsoft & Pyramid Analytics: What the Microsoft and Pyramid Analytics' Stra...
Microsoft & Pyramid Analytics: What the Microsoft and Pyramid Analytics' Stra...
 
SQL Server 2019 Big Data Cluster
SQL Server 2019 Big Data ClusterSQL Server 2019 Big Data Cluster
SQL Server 2019 Big Data Cluster
 
Big Data Analytics from Azure Cloud to Power BI Mobile
Big Data Analytics from Azure Cloud to Power BI MobileBig Data Analytics from Azure Cloud to Power BI Mobile
Big Data Analytics from Azure Cloud to Power BI Mobile
 

Mehr von Davide Mauri

Azure serverless Full-Stack kickstart
Azure serverless Full-Stack kickstartAzure serverless Full-Stack kickstart
Azure serverless Full-Stack kickstartDavide Mauri
 
Agile Data Warehousing
Agile Data WarehousingAgile Data Warehousing
Agile Data WarehousingDavide Mauri
 
Dapper: the microORM that will change your life
Dapper: the microORM that will change your lifeDapper: the microORM that will change your life
Dapper: the microORM that will change your lifeDavide Mauri
 
When indexes are not enough
When indexes are not enoughWhen indexes are not enough
When indexes are not enoughDavide Mauri
 
Building a Real-Time IoT monitoring application with Azure
Building a Real-Time IoT monitoring application with AzureBuilding a Real-Time IoT monitoring application with Azure
Building a Real-Time IoT monitoring application with AzureDavide Mauri
 
SSIS Monitoring Deep Dive
SSIS Monitoring Deep DiveSSIS Monitoring Deep Dive
SSIS Monitoring Deep DiveDavide Mauri
 
Azure SQL & SQL Server 2016 JSON
Azure SQL & SQL Server 2016 JSONAzure SQL & SQL Server 2016 JSON
Azure SQL & SQL Server 2016 JSONDavide Mauri
 
SQL Server & SQL Azure Temporal Tables - V2
SQL Server & SQL Azure Temporal Tables - V2SQL Server & SQL Azure Temporal Tables - V2
SQL Server & SQL Azure Temporal Tables - V2Davide Mauri
 
Azure Stream Analytics
Azure Stream AnalyticsAzure Stream Analytics
Azure Stream AnalyticsDavide Mauri
 
Event Hub & Azure Stream Analytics
Event Hub & Azure Stream AnalyticsEvent Hub & Azure Stream Analytics
Event Hub & Azure Stream AnalyticsDavide Mauri
 
SQL Server 2016 JSON
SQL Server 2016 JSONSQL Server 2016 JSON
SQL Server 2016 JSONDavide Mauri
 
Back to the roots - SQL Server Indexing
Back to the roots - SQL Server IndexingBack to the roots - SQL Server Indexing
Back to the roots - SQL Server IndexingDavide Mauri
 
Schema less table & dynamic schema
Schema less table & dynamic schemaSchema less table & dynamic schema
Schema less table & dynamic schemaDavide Mauri
 
Data Science Overview
Data Science OverviewData Science Overview
Data Science OverviewDavide Mauri
 
Delayed durability
Delayed durabilityDelayed durability
Delayed durabilityDavide Mauri
 
Hekaton: In-memory tables
Hekaton: In-memory tablesHekaton: In-memory tables
Hekaton: In-memory tablesDavide Mauri
 
Hardware planning & sizing for sql server
Hardware planning & sizing for sql serverHardware planning & sizing for sql server
Hardware planning & sizing for sql serverDavide Mauri
 

Mehr von Davide Mauri (18)

Azure serverless Full-Stack kickstart
Azure serverless Full-Stack kickstartAzure serverless Full-Stack kickstart
Azure serverless Full-Stack kickstart
 
Agile Data Warehousing
Agile Data WarehousingAgile Data Warehousing
Agile Data Warehousing
 
Dapper: the microORM that will change your life
Dapper: the microORM that will change your lifeDapper: the microORM that will change your life
Dapper: the microORM that will change your life
 
When indexes are not enough
When indexes are not enoughWhen indexes are not enough
When indexes are not enough
 
Building a Real-Time IoT monitoring application with Azure
Building a Real-Time IoT monitoring application with AzureBuilding a Real-Time IoT monitoring application with Azure
Building a Real-Time IoT monitoring application with Azure
 
SSIS Monitoring Deep Dive
SSIS Monitoring Deep DiveSSIS Monitoring Deep Dive
SSIS Monitoring Deep Dive
 
Azure SQL & SQL Server 2016 JSON
Azure SQL & SQL Server 2016 JSONAzure SQL & SQL Server 2016 JSON
Azure SQL & SQL Server 2016 JSON
 
SQL Server & SQL Azure Temporal Tables - V2
SQL Server & SQL Azure Temporal Tables - V2SQL Server & SQL Azure Temporal Tables - V2
SQL Server & SQL Azure Temporal Tables - V2
 
Azure Stream Analytics
Azure Stream AnalyticsAzure Stream Analytics
Azure Stream Analytics
 
Event Hub & Azure Stream Analytics
Event Hub & Azure Stream AnalyticsEvent Hub & Azure Stream Analytics
Event Hub & Azure Stream Analytics
 
SQL Server 2016 JSON
SQL Server 2016 JSONSQL Server 2016 JSON
SQL Server 2016 JSON
 
Back to the roots - SQL Server Indexing
Back to the roots - SQL Server IndexingBack to the roots - SQL Server Indexing
Back to the roots - SQL Server Indexing
 
Schema less table & dynamic schema
Schema less table & dynamic schemaSchema less table & dynamic schema
Schema less table & dynamic schema
 
Data juice
Data juiceData juice
Data juice
 
Data Science Overview
Data Science OverviewData Science Overview
Data Science Overview
 
Delayed durability
Delayed durabilityDelayed durability
Delayed durability
 
Hekaton: In-memory tables
Hekaton: In-memory tablesHekaton: In-memory tables
Hekaton: In-memory tables
 
Hardware planning & sizing for sql server
Hardware planning & sizing for sql serverHardware planning & sizing for sql server
Hardware planning & sizing for sql server
 

Kürzlich hochgeladen

TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptxTINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptxDwiAyuSitiHartinah
 
Optimal Decision Making - Cost Reduction in Logistics
Optimal Decision Making - Cost Reduction in LogisticsOptimal Decision Making - Cost Reduction in Logistics
Optimal Decision Making - Cost Reduction in LogisticsThinkInnovation
 
CI, CD -Tools to integrate without manual intervention
CI, CD -Tools to integrate without manual interventionCI, CD -Tools to integrate without manual intervention
CI, CD -Tools to integrate without manual interventionajayrajaganeshkayala
 
Strategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
Strategic CX: A Deep Dive into Voice of the Customer Insights for ClarityStrategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
Strategic CX: A Deep Dive into Voice of the Customer Insights for ClarityAggregage
 
Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023Vladislav Solodkiy
 
How is Real-Time Analytics Different from Traditional OLAP?
How is Real-Time Analytics Different from Traditional OLAP?How is Real-Time Analytics Different from Traditional OLAP?
How is Real-Time Analytics Different from Traditional OLAP?sonikadigital1
 
Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...PrithaVashisht1
 
ChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics InfrastructureChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics Infrastructuresonikadigital1
 
CCS336-Cloud-Services-Management-Lecture-Notes-1.pptx
CCS336-Cloud-Services-Management-Lecture-Notes-1.pptxCCS336-Cloud-Services-Management-Lecture-Notes-1.pptx
CCS336-Cloud-Services-Management-Lecture-Notes-1.pptxdhiyaneswaranv1
 
Virtuosoft SmartSync Product Introduction
Virtuosoft SmartSync Product IntroductionVirtuosoft SmartSync Product Introduction
Virtuosoft SmartSync Product Introductionsanjaymuralee1
 
Master's Thesis - Data Science - Presentation
Master's Thesis - Data Science - PresentationMaster's Thesis - Data Science - Presentation
Master's Thesis - Data Science - PresentationGiorgio Carbone
 
Rock Songs common codes and conventions.pptx
Rock Songs common codes and conventions.pptxRock Songs common codes and conventions.pptx
Rock Songs common codes and conventions.pptxFinatron037
 
Mapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptxMapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptxVenkatasubramani13
 
The Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayerThe Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayerPavel Šabatka
 
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024Guido X Jansen
 
5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best Practices5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best PracticesDataArchiva
 

Kürzlich hochgeladen (16)

TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptxTINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
 
Optimal Decision Making - Cost Reduction in Logistics
Optimal Decision Making - Cost Reduction in LogisticsOptimal Decision Making - Cost Reduction in Logistics
Optimal Decision Making - Cost Reduction in Logistics
 
CI, CD -Tools to integrate without manual intervention
CI, CD -Tools to integrate without manual interventionCI, CD -Tools to integrate without manual intervention
CI, CD -Tools to integrate without manual intervention
 
Strategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
Strategic CX: A Deep Dive into Voice of the Customer Insights for ClarityStrategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
Strategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
 
Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023
 
How is Real-Time Analytics Different from Traditional OLAP?
How is Real-Time Analytics Different from Traditional OLAP?How is Real-Time Analytics Different from Traditional OLAP?
How is Real-Time Analytics Different from Traditional OLAP?
 
Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...
 
ChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics InfrastructureChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics Infrastructure
 
CCS336-Cloud-Services-Management-Lecture-Notes-1.pptx
CCS336-Cloud-Services-Management-Lecture-Notes-1.pptxCCS336-Cloud-Services-Management-Lecture-Notes-1.pptx
CCS336-Cloud-Services-Management-Lecture-Notes-1.pptx
 
Virtuosoft SmartSync Product Introduction
Virtuosoft SmartSync Product IntroductionVirtuosoft SmartSync Product Introduction
Virtuosoft SmartSync Product Introduction
 
Master's Thesis - Data Science - Presentation
Master's Thesis - Data Science - PresentationMaster's Thesis - Data Science - Presentation
Master's Thesis - Data Science - Presentation
 
Rock Songs common codes and conventions.pptx
Rock Songs common codes and conventions.pptxRock Songs common codes and conventions.pptx
Rock Songs common codes and conventions.pptx
 
Mapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptxMapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptx
 
The Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayerThe Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayer
 
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
 
5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best Practices5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best Practices
 

Real Time Power BI

  • 1. 12.12.2015 Real-Time PowerBI: API, Events, Hubs and Streams Davide Mauri dmauri@solidq.com @mauridb 12.12.2015
  • 2. 12.12.2015 Thank you to our AWESOME sponsors!
  • 3. 12.12.2015 Davide Mauri  Microsoft SQL Server MVP  Works with SQL Server from 6.5, on BI from 2003  Specialized in Data Solution Architecture, Database Design, Performance Tuning, High-Performance Data Warehousing, BI, Big Data  President of UGISS (Italian SQL Server UG)  Regular Speaker @ SQL Server events  Consulting & Training, Mentor @ SolidQ  E-mail: dmauri@solidq.com  Twitter: @mauridb  Blog: http://sqlblog.com/blogs/davide_mauri/default.aspx
  • 4. 12.12.2015 PowerBI  You all know what is that, right?
  • 5. 12.12.2015 What about REAL TIME dashboards? Two possible ways: https://msdn.microsoft.com/library/mt267603.aspx
  • 7. 12.12.2015 Power BI API Workflow https://msdn.microsoft.com/en-us/library/dn877544.aspx
  • 8. 12.12.2015 Power BI & Your App  As many (all?) other Microsoft product, Power BI is a also (mainly?) platform  Rich set of REST API  REST: REpresentational State Transfer (REST)  http://www.restapitutorial.com/lessons/whatisrest.html  Allows to interact and manage almost all Power BI objects  Allows the creation of automatic updated (near) real- time dashboard
  • 9. 12.12.2015 Power BI & Your App  What you can do via Power BI REST API?  Get and create Datasets.  Get Tables and update Table schema.  Add Rows and Delete Rows.  Get Groups.  Create Import, Get Imports, Get Import from GUID, and Get Import by File Path.  Dashboard operations: Get Dashboards and Get Tiles.  Power BI REST API Limitations / Throttling  https://msdn.microsoft.com/en-US/library/dn950053.aspx
  • 10. 12.12.2015 Power BI & Your App  Authentication needed  Azure Active Directory  Via OAuth2  Full interactive documentation of Power BI REST API available here:  http://docs.powerbi.apiary.io/
  • 12. 12.12.2015 Integrate Power BI With Your App  Create a user account using Azure AD  Add a new Application from the Azure Management Portal  https://manage.windowsazure.com  Allow Application to access Power BI  Grant Application Delegated Permissions  Get Client ID
  • 13. 12.12.2015 Integrate Power BI With Your App  Authenticate against Azure AD  Use Microsoft.IdentityModel.Clients.ActiveDirectory Library  From NuGet. Latest version as of today: 2.19.208020213  Get the token  New or Refreshed one  Call the desired REST API specifying the Bearer Token in the Header  Receive the JSON answer  JSON.NET strongly recommended 
  • 15. 12.12.2015 Integration via Event Hub and Stream Analytics  Event hubs allows to ingest *a lot* of events  Up to millions per second  Again, REST API  Assembly with Object Model available on GitHub  WindowsAzure.ServiceBus (as of today: 3.0.9)  API for Sending events  But also for managing Event Hubs
  • 18. 12.12.2015 Lambda Architecture  Fits in the lambda architecture vision  Real time and “batch” analytics  http://lambda-architecture.net/
  • 19. 12.12.2015 Integration via Event Hub and Stream Analytics  Azure Stream Analytics allows you to execute streaming queries  Like StreamInsight or Apache Storm  Inputs and Outputs has to ben defined  Streaming or Reference Data supported  Can use Event hubs as a Streaming Source
  • 20. 12.12.2015 Integration via Event Hub and Stream Analytics  Use Streaming SQL to  Transform/Aggregate Streaming data  Send results to an output  One of the output can be PowerBI  This enables the creation of Real-Time Dashboard  That are automatically refreshed
  • 21. 12.12.2015 Demo Power BI & Stream Analytics
  • 23. 12.12.2015 Non-Streamed Data  Another option is Azure SQL/DW + PowerBI with Direct Query  Stream Analytics will output to an Azure SQL Database  100% Lambda Architecture  Merging can be done via Views or via Power Query  No Streaming so no automatic chart updates  You don’t need to refresh data, since we’re using Direct Query

Hinweis der Redaktion

  1. https://msdn.microsoft.com/en-us/library/dn877542.aspx
  2. https://azure.microsoft.com/en-us/documentation/articles/event-hubs-programming-guide/