SlideShare ist ein Scribd-Unternehmen logo
1 von 37
Data Opportunities with Azure
Marco Parenzan
Azure Weekly – January 20th, 2015
Marco Parenzan
Training and Speaking with 1nn0va
Microsoft MVP 2014 for Microsoft Azure
Training and planning with ITS Kennedy
www.slideshare.net/marco.parenzan
marco [dot] parenzan [at] libero [dot] it
www.innovazionefvg.net
Developer and Architect in .NET and Web
Cloud Developer
Loves functional programming
Some videogames for fun
Data Legacy WITHOUT Azure
 It’s common having just ONE data store in our toolbox
 Typically it’s a relational database (either Microsoft SQL server or
other SQL vendors)
ď‚š Traditional hosting providers had just few combinations of data and
hosting capabilities
ď‚š Is Azure just another data (and hosting) opportunity?
Data WITH Azure
ď‚š Azure give you many opportunities handling you data
ď‚š Not just relational
ď‚š Not just small
ď‚š Not just monolithic
ď‚š Not just table
ď‚š Not just fields
 ….
One Scenario
ď‚š You have an ASP.NET MVC application
ď‚š But ASP.NET WebForms, PHP, Java is the same
ď‚š You have a relational DB in SQL Server
 But having a MySQL, Postgre, “Oracle”, is the same
Opportunity
Enhance you SQL-BASED ASP.NET
experience with AZURE
Is Azure just a new hosting opportunity?
Yes, it’s an operational opportunity. You can solve your issues
about
ď‚š Deployment
ď‚š Security
ď‚š Maintenance
ď‚š (some) Scalability
Is Azure just a new hosting opportunity?
No, it’s also an architectural opportunity, but only if you write
some code
ď‚š Cache your data
ď‚š Search your data
ď‚š Query your data
Agenda
ď‚š Operational opportunities in Azure
ď‚š Developer opportunities in Azure
Handle relational data with IaaS: Pro
ď‚š Free to choose your OS
ď‚š Full power of a Relational DB
ď‚š Simple Scaling Up
 “partial” licencing
ď‚š Pay Per Use (no CAPEX)
ď‚š Full power control
ď‚š Ready images (no installation)
ď‚š With specific configurations
ď‚š Just Click, Name, choose, deploy
Handle relational data with IaaS: Cons
ď‚š OPEX: highest
ď‚š Relational (non open) DBMS are expensive
ď‚š Bits+Management
ď‚š You have to be a real Administrator
ď‚š Scalability: you can ONLY scale up
ď‚š Current sharding needs application to be updated
ď‚š Current sharding is in experimentation stage
DEMO
SQL Server in a Azure VM
Handle relational data with SaaS
 You don’t want to handle management issues
 You don’t want vertical scalability-related issues
 You don’t need special infrastructural architecture
 “PaaS if possibile, IaaS if really needed”
Handle relational data with SaaS: Pro
ď‚š OPEX: lower than IaaS
ď‚š Bits+Management
ď‚š Full power of a Relational DB
ď‚š Editions
ď‚š Clustering
ď‚š CPU+Memory
ď‚š No licencing (No CAPEX)
ď‚š Pay Per Use (OPEX)
ď‚š No need for images
Handle relational data with SaaS: Cons
ď‚š OPEX: lower, than IaaS
ď‚š Partial power of a Relational DB
ď‚š Configure what is just available
ď‚š Scalability: can ONLY scale up
Migrating your on-premise SQL to SQL Azure
ď‚š Not all features of On-Premise SQL are available in SQL Azure
 A “backup” is not enough to bring DB to the cloud
ď‚š Exporting a script
ď‚š Last December 2014 update have great news
ď‚š Some tools are available, updated
ď‚š Developer Way: Database Project, targeting SQL Azure
ď‚š Operations Way: Database | Tasks | Deploy to Windows Azure SQL Database
ď‚š https://sqlazuremw.codeplex.com/
DEMO
Migrate your SQL Database to SQL Azure
Host your Web Application in a Azure Web Site
ď‚š Publish your Web Application in a Web Sites
ď‚š Seconds (minutes) to go
ď‚š Configure DB access in web.config
DEMO
Publish your web app to Azure Web Site
in Visual Studio 2013
Stateful web application
ď‚š Statefulness is the state that influences the computation of every
request in a web application
ď‚š State avoids horizontal scalability
ď‚š State is evil, but you have it!
Bring state OUTSIDE your web server
ď‚š Redis as an efficient in memory key/value store
ď‚š Configure ASP.NET MVC to use Redis (declarative approach)
ď‚š Session State is taken OUTSIDE web application
ď‚š State can be shared between two or more instances (scaling out!)
DEMO
Configure ASP.NET using REDIS
Latency in a cloud environment is an issue
ď‚š In a cloud environment, database is FAR from app hosting
 Query result set can “arrive” long…
ď‚š How many times is a query executed? How many times same data
are retrieved?
ď‚š In a pay per use environment, queries costs?
ď‚š SQL licensing
ď‚š Bandwidth
Programming approach to Redis
ď‚š Implements a cache-aside pattern
ď‚š http://azure.microsoft.com/en-us/documentation/infographics/cloud-design-patterns/
ď‚š Query cache first
ď‚š If not found, Query data source and store result in cache
ď‚š Cache invalidation rules have to be handled
ď‚š Explicit
ď‚š Timeout
ď‚š Find many .NET clients in nuget
ď‚š Example Stack Exchange implementation
DEMO
Search inside your data
 Search on relational DB is tipically “field-oriented” search
 Search in the web is more “context free”, “full text” search
ď‚š Handling text is not simple
Azure Search
ď‚š A search-as-a-service solution allowing developers to incorporate great
search experiences into applications without managing infrastructure or
needing to become search experts.
ď‚š You acquire immediately all text search experience
ď‚š You acquire immediately support for languages
ď‚š It is based on Elastic Search
ď‚š Bullet proof, state of the art, search implementation
ď‚š It is independent from a specific data source
ď‚š You need to publish your data EXPLICITLY to the search service
DEMO
Latencies with data
 As already told, data is “far” from app
ď‚š You can have issues with timeouts
ď‚š You have to retry a query
Data that scale out
ď‚š You can handle scalability in two ways
 Scale up: increase power of your “hardware” to improve
application responsiveness
 But you cannot avoid programming issues, like “locks”
ď‚š Scale out: partition data. Divide data horizontally (by key) to
distribute data between instances.
 Problem: SQL db don’t partition
Entity Framework to the rescue
ď‚š All issues can be solved at application level with Entity Framework
(EF6)
ď‚š Well, with some help from external code
ď‚š Not native implementations
ď‚š Not the best solutions in Cloud
DEMO
Conclusions
Recap Operations
ď‚š Migrate your DB to SQL Azure
ď‚š Or the equivalent DaaS for the RDBMS you like (https://www.cleardb.com/, for
example)
ď‚š Use IaaS only if you really (really) need
ď‚š Publish your app on Web Site
Developer Recap
ď‚š Create a Redis instance
ď‚š Configure SessionState if you use Session in ASP.NET
 Implement cache-aside pattern to avoid repeated queries – this is the same for
every db you use
ď‚š Create an Azure Search instance
ď‚š Enhance your experience in text search!
ď‚š Improve EF experience
ď‚š Handle retries (in cloud is mandatory)
ď‚š Partition your data if you have very big datasets
Conclusions
ď‚š Consider Azure as a Platform opportunity for your application
ď‚š Consider Azure as a Data Platform opportunity for your application
ď‚š You cannot move your application without making improvements
to your architecture
ď‚š Make an assessment to check all issues with your legacy chooses
ď‚š Evaluate all other data opportunities in Azure
Thank You! - Q&A
Marco Parenzan
Azure Weekly – January 20th, 2015
Email: marco.parenzan@live.it
Slideshare: http://www.slideshare.net/marcoparenzan
GitHub: https://www.gihtub.cob/marcoparenzan
Twitter: http://twitter.com/marco_parenzan

Weitere ähnliche Inhalte

Was ist angesagt?

Webinar Slides: MySQL HA/DR/Geo-Scale - High Noon #4: MS Azure Database MySQL
Webinar Slides: MySQL HA/DR/Geo-Scale - High Noon #4: MS Azure Database MySQLWebinar Slides: MySQL HA/DR/Geo-Scale - High Noon #4: MS Azure Database MySQL
Webinar Slides: MySQL HA/DR/Geo-Scale - High Noon #4: MS Azure Database MySQL
Continuent
 
Deploying asp.net and mvc applications to azure
Deploying asp.net and mvc applications to azureDeploying asp.net and mvc applications to azure
Deploying asp.net and mvc applications to azure
Glyn Darkin
 

Was ist angesagt? (20)

SPSMadrid Get sql spinning with SharePoint. Best practice for the back end
SPSMadrid Get sql spinning with SharePoint. Best practice for the back endSPSMadrid Get sql spinning with SharePoint. Best practice for the back end
SPSMadrid Get sql spinning with SharePoint. Best practice for the back end
 
Introduction to Machine Learning on Azure
Introduction to Machine Learning on AzureIntroduction to Machine Learning on Azure
Introduction to Machine Learning on Azure
 
How to Win When Migrating to Azure
How to Win When Migrating to AzureHow to Win When Migrating to Azure
How to Win When Migrating to Azure
 
Scalable web architecture
Scalable web architectureScalable web architecture
Scalable web architecture
 
Data Migration and Data-Tier Applications with SQL Azure
Data Migration and Data-Tier Applications with SQL AzureData Migration and Data-Tier Applications with SQL Azure
Data Migration and Data-Tier Applications with SQL Azure
 
Develop Your Own Path On Microsoft Azure
Develop Your Own Path On Microsoft AzureDevelop Your Own Path On Microsoft Azure
Develop Your Own Path On Microsoft Azure
 
Mastering azure devOps - Dot Net Tricks
Mastering azure devOps - Dot Net TricksMastering azure devOps - Dot Net Tricks
Mastering azure devOps - Dot Net Tricks
 
Scalable Web Architecture
Scalable Web ArchitectureScalable Web Architecture
Scalable Web Architecture
 
Webinar Slides: MySQL HA/DR/Geo-Scale - High Noon #4: MS Azure Database MySQL
Webinar Slides: MySQL HA/DR/Geo-Scale - High Noon #4: MS Azure Database MySQLWebinar Slides: MySQL HA/DR/Geo-Scale - High Noon #4: MS Azure Database MySQL
Webinar Slides: MySQL HA/DR/Geo-Scale - High Noon #4: MS Azure Database MySQL
 
O365Con19 - Developing Timerjob and Eventhandler Equivalents - Adis Jugo
O365Con19 - Developing Timerjob and Eventhandler Equivalents - Adis JugoO365Con19 - Developing Timerjob and Eventhandler Equivalents - Adis Jugo
O365Con19 - Developing Timerjob and Eventhandler Equivalents - Adis Jugo
 
Azure in Developer Perspective
Azure in Developer PerspectiveAzure in Developer Perspective
Azure in Developer Perspective
 
Azure Cosmos DB
Azure Cosmos DBAzure Cosmos DB
Azure Cosmos DB
 
Microsoft Azure - Office 365 Overwrite
Microsoft Azure - Office 365 OverwriteMicrosoft Azure - Office 365 Overwrite
Microsoft Azure - Office 365 Overwrite
 
Deploying asp.net and mvc applications to azure
Deploying asp.net and mvc applications to azureDeploying asp.net and mvc applications to azure
Deploying asp.net and mvc applications to azure
 
Azure Services Platform
Azure Services PlatformAzure Services Platform
Azure Services Platform
 
Cloud Computing and Microsoft Azure
Cloud Computing and Microsoft AzureCloud Computing and Microsoft Azure
Cloud Computing and Microsoft Azure
 
Microsoft Azure en empresa - Ponencia Nunsys Microsoft Day
Microsoft Azure en empresa - Ponencia Nunsys Microsoft Day Microsoft Azure en empresa - Ponencia Nunsys Microsoft Day
Microsoft Azure en empresa - Ponencia Nunsys Microsoft Day
 
Snowflake SnowPro Certification Exam Cheat Sheet
Snowflake SnowPro Certification Exam Cheat SheetSnowflake SnowPro Certification Exam Cheat Sheet
Snowflake SnowPro Certification Exam Cheat Sheet
 
PASS Summit 2020
PASS Summit 2020PASS Summit 2020
PASS Summit 2020
 
Machine Learning in SQL Server 2019
Machine Learning in SQL Server 2019Machine Learning in SQL Server 2019
Machine Learning in SQL Server 2019
 

Andere mochten auch

PresentaciĂłn RECAPACICLA. IES Villa de VĂ­car 2011-2012
PresentaciĂłn RECAPACICLA. IES Villa de VĂ­car 2011-2012PresentaciĂłn RECAPACICLA. IES Villa de VĂ­car 2011-2012
PresentaciĂłn RECAPACICLA. IES Villa de VĂ­car 2011-2012
Milagros Becerra
 
Youtalent 2013 copia
Youtalent 2013 copiaYoutalent 2013 copia
Youtalent 2013 copia
Daniel Bursztyn
 
Normas campeonato mundial de resistencia
Normas campeonato mundial de resistenciaNormas campeonato mundial de resistencia
Normas campeonato mundial de resistencia
ferchugt5
 
Autoestima en la adolescencia analisis
Autoestima en la adolescencia analisisAutoestima en la adolescencia analisis
Autoestima en la adolescencia analisis
Chispita161290
 
Aloe vera en la cultura dominicana 1
Aloe vera en la cultura dominicana 1Aloe vera en la cultura dominicana 1
Aloe vera en la cultura dominicana 1
JoseMed35
 
Classic blue minivan side view power point slides and ppt diagram templates
Classic blue minivan side view power point slides and ppt diagram templates Classic blue minivan side view power point slides and ppt diagram templates
Classic blue minivan side view power point slides and ppt diagram templates
SlideTeam.net
 

Andere mochten auch (20)

A domboru betuk es a RoboBraille
A domboru betuk es a RoboBrailleA domboru betuk es a RoboBraille
A domboru betuk es a RoboBraille
 
PresentaciĂłn RECAPACICLA. IES Villa de VĂ­car 2011-2012
PresentaciĂłn RECAPACICLA. IES Villa de VĂ­car 2011-2012PresentaciĂłn RECAPACICLA. IES Villa de VĂ­car 2011-2012
PresentaciĂłn RECAPACICLA. IES Villa de VĂ­car 2011-2012
 
Marcas americanas
Marcas americanasMarcas americanas
Marcas americanas
 
Youtalent 2013 copia
Youtalent 2013 copiaYoutalent 2013 copia
Youtalent 2013 copia
 
Workcube ERP CRM Functions
Workcube ERP CRM FunctionsWorkcube ERP CRM Functions
Workcube ERP CRM Functions
 
Alarmorning
AlarmorningAlarmorning
Alarmorning
 
Normas campeonato mundial de resistencia
Normas campeonato mundial de resistenciaNormas campeonato mundial de resistencia
Normas campeonato mundial de resistencia
 
Bullshit bingo
Bullshit bingoBullshit bingo
Bullshit bingo
 
Power ea d
Power ea dPower ea d
Power ea d
 
Autoestima en la adolescencia analisis
Autoestima en la adolescencia analisisAutoestima en la adolescencia analisis
Autoestima en la adolescencia analisis
 
Aloe vera en la cultura dominicana 1
Aloe vera en la cultura dominicana 1Aloe vera en la cultura dominicana 1
Aloe vera en la cultura dominicana 1
 
Infinity brandcom - Outdoor Advertising, BTL, Ambient Media
Infinity brandcom - Outdoor Advertising, BTL, Ambient MediaInfinity brandcom - Outdoor Advertising, BTL, Ambient Media
Infinity brandcom - Outdoor Advertising, BTL, Ambient Media
 
Hello tv presentation sfr 180101
Hello tv presentation sfr 180101Hello tv presentation sfr 180101
Hello tv presentation sfr 180101
 
Classic blue minivan side view power point slides and ppt diagram templates
Classic blue minivan side view power point slides and ppt diagram templates Classic blue minivan side view power point slides and ppt diagram templates
Classic blue minivan side view power point slides and ppt diagram templates
 
La noche de los asesinos
La noche de los asesinosLa noche de los asesinos
La noche de los asesinos
 
Uji ef organik agrodyke pada padi
Uji ef organik agrodyke pada padiUji ef organik agrodyke pada padi
Uji ef organik agrodyke pada padi
 
PROuniversitas
PROuniversitasPROuniversitas
PROuniversitas
 
SPC Europe Training Week - Real World Challenges in Enterprise Search
SPC Europe Training Week - Real World Challenges in Enterprise SearchSPC Europe Training Week - Real World Challenges in Enterprise Search
SPC Europe Training Week - Real World Challenges in Enterprise Search
 
EL_SISTEMA_SOLAR
EL_SISTEMA_SOLAREL_SISTEMA_SOLAR
EL_SISTEMA_SOLAR
 
dossier NL
dossier NLdossier NL
dossier NL
 

Ă„hnlich wie Azure Weekly - 2015.01.20 - Marco Parenzan - Data Opportunities with Azure

Databases in the Cloud - DevDay Austin 2017 Day 2
Databases in the Cloud - DevDay Austin 2017 Day 2Databases in the Cloud - DevDay Austin 2017 Day 2
Databases in the Cloud - DevDay Austin 2017 Day 2
Amazon Web Services
 
Web20expo Scalable Web Arch
Web20expo Scalable Web ArchWeb20expo Scalable Web Arch
Web20expo Scalable Web Arch
guest18a0f1
 

Ă„hnlich wie Azure Weekly - 2015.01.20 - Marco Parenzan - Data Opportunities with Azure (20)

Azure Data.pptx
Azure Data.pptxAzure Data.pptx
Azure Data.pptx
 
Afternoons with Azure - Azure Data Services
Afternoons with Azure - Azure Data ServicesAfternoons with Azure - Azure Data Services
Afternoons with Azure - Azure Data Services
 
SQL Saturday Redmond 2019 ETL Patterns in the Cloud
SQL Saturday Redmond 2019 ETL Patterns in the CloudSQL Saturday Redmond 2019 ETL Patterns in the Cloud
SQL Saturday Redmond 2019 ETL Patterns in the Cloud
 
Azure Data Factory ETL Patterns in the Cloud
Azure Data Factory ETL Patterns in the CloudAzure Data Factory ETL Patterns in the Cloud
Azure Data Factory ETL Patterns in the Cloud
 
Deploying your Application to SQLRally
Deploying your Application to SQLRallyDeploying your Application to SQLRally
Deploying your Application to SQLRally
 
Deploying data tier applications sql saturday dc
Deploying data tier applications sql saturday dcDeploying data tier applications sql saturday dc
Deploying data tier applications sql saturday dc
 
SQL Azure the database in the cloud
SQL Azure the database in the cloud SQL Azure the database in the cloud
SQL Azure the database in the cloud
 
50 Shades of SharePoint: SharePoint 2013 Insanity Demystified
50 Shades of SharePoint: SharePoint 2013 Insanity Demystified50 Shades of SharePoint: SharePoint 2013 Insanity Demystified
50 Shades of SharePoint: SharePoint 2013 Insanity Demystified
 
Databases in the Cloud - DevDay Austin 2017 Day 2
Databases in the Cloud - DevDay Austin 2017 Day 2Databases in the Cloud - DevDay Austin 2017 Day 2
Databases in the Cloud - DevDay Austin 2017 Day 2
 
Web20expo Scalable Web Arch
Web20expo Scalable Web ArchWeb20expo Scalable Web Arch
Web20expo Scalable Web Arch
 
Web20expo Scalable Web Arch
Web20expo Scalable Web ArchWeb20expo Scalable Web Arch
Web20expo Scalable Web Arch
 
Web20expo Scalable Web Arch
Web20expo Scalable Web ArchWeb20expo Scalable Web Arch
Web20expo Scalable Web Arch
 
Above the cloud joarder kamal
Above the cloud   joarder kamalAbove the cloud   joarder kamal
Above the cloud joarder kamal
 
Azure Databricks is Easier Than You Think
Azure Databricks is Easier Than You ThinkAzure Databricks is Easier Than You Think
Azure Databricks is Easier Than You Think
 
SQL or NoSQL, is this the question? - George Grammatikos
SQL or NoSQL, is this the question? - George GrammatikosSQL or NoSQL, is this the question? - George Grammatikos
SQL or NoSQL, is this the question? - George Grammatikos
 
SQL Azure Overview for Bizspark day
SQL Azure Overview for Bizspark daySQL Azure Overview for Bizspark day
SQL Azure Overview for Bizspark day
 
Microsoft Azure
Microsoft AzureMicrosoft Azure
Microsoft Azure
 
ArcReady - Architecting For The Cloud
ArcReady - Architecting For The CloudArcReady - Architecting For The Cloud
ArcReady - Architecting For The Cloud
 
Azure for ug
Azure for ugAzure for ug
Azure for ug
 
Sql Azure Pass
Sql Azure PassSql Azure Pass
Sql Azure Pass
 

Mehr von Marco Parenzan

Mehr von Marco Parenzan (20)

Azure IoT Central per lo SCADA engineer
Azure IoT Central per lo SCADA engineerAzure IoT Central per lo SCADA engineer
Azure IoT Central per lo SCADA engineer
 
Azure Hybrid @ Home
Azure Hybrid @ HomeAzure Hybrid @ Home
Azure Hybrid @ Home
 
Static abstract members nelle interfacce di C# 11 e dintorni di .NET 7.pptx
Static abstract members nelle interfacce di C# 11 e dintorni di .NET 7.pptxStatic abstract members nelle interfacce di C# 11 e dintorni di .NET 7.pptx
Static abstract members nelle interfacce di C# 11 e dintorni di .NET 7.pptx
 
Azure Synapse Analytics for your IoT Solutions
Azure Synapse Analytics for your IoT SolutionsAzure Synapse Analytics for your IoT Solutions
Azure Synapse Analytics for your IoT Solutions
 
Power BI Streaming Data Flow e Azure IoT Central
Power BI Streaming Data Flow e Azure IoT Central Power BI Streaming Data Flow e Azure IoT Central
Power BI Streaming Data Flow e Azure IoT Central
 
Power BI Streaming Data Flow e Azure IoT Central
Power BI Streaming Data Flow e Azure IoT CentralPower BI Streaming Data Flow e Azure IoT Central
Power BI Streaming Data Flow e Azure IoT Central
 
Power BI Streaming Data Flow e Azure IoT Central
Power BI Streaming Data Flow e Azure IoT CentralPower BI Streaming Data Flow e Azure IoT Central
Power BI Streaming Data Flow e Azure IoT Central
 
Developing Actors in Azure with .net
Developing Actors in Azure with .netDeveloping Actors in Azure with .net
Developing Actors in Azure with .net
 
Math with .NET for you and Azure
Math with .NET for you and AzureMath with .NET for you and Azure
Math with .NET for you and Azure
 
Power BI data flow and Azure IoT Central
Power BI data flow and Azure IoT CentralPower BI data flow and Azure IoT Central
Power BI data flow and Azure IoT Central
 
.net for fun: write a Christmas videogame
.net for fun: write a Christmas videogame.net for fun: write a Christmas videogame
.net for fun: write a Christmas videogame
 
Building IoT infrastructure on edge with .net, Raspberry PI and ESP32 to conn...
Building IoT infrastructure on edge with .net, Raspberry PI and ESP32 to conn...Building IoT infrastructure on edge with .net, Raspberry PI and ESP32 to conn...
Building IoT infrastructure on edge with .net, Raspberry PI and ESP32 to conn...
 
Anomaly Detection with Azure and .NET
Anomaly Detection with Azure and .NETAnomaly Detection with Azure and .NET
Anomaly Detection with Azure and .NET
 
Deploy Microsoft Azure Data Solutions
Deploy Microsoft Azure Data SolutionsDeploy Microsoft Azure Data Solutions
Deploy Microsoft Azure Data Solutions
 
Deep Dive Time Series Anomaly Detection in Azure with dotnet
Deep Dive Time Series Anomaly Detection in Azure with dotnetDeep Dive Time Series Anomaly Detection in Azure with dotnet
Deep Dive Time Series Anomaly Detection in Azure with dotnet
 
Azure IoT Central
Azure IoT CentralAzure IoT Central
Azure IoT Central
 
Anomaly Detection with Azure and .net
Anomaly Detection with Azure and .netAnomaly Detection with Azure and .net
Anomaly Detection with Azure and .net
 
Code Generation for Azure with .net
Code Generation for Azure with .netCode Generation for Azure with .net
Code Generation for Azure with .net
 
Running Kafka and Spark on Raspberry PI with Azure and some .net magic
Running Kafka and Spark on Raspberry PI with Azure and some .net magicRunning Kafka and Spark on Raspberry PI with Azure and some .net magic
Running Kafka and Spark on Raspberry PI with Azure and some .net magic
 
Time Series Anomaly Detection with Azure and .NETT
Time Series Anomaly Detection with Azure and .NETTTime Series Anomaly Detection with Azure and .NETT
Time Series Anomaly Detection with Azure and .NETT
 

KĂĽrzlich hochgeladen

CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
TECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service providerTECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service provider
mohitmore19
 
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
Health
 

KĂĽrzlich hochgeladen (20)

Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
 
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
 
How To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected WorkerHow To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected Worker
 
Right Money Management App For Your Financial Goals
Right Money Management App For Your Financial GoalsRight Money Management App For Your Financial Goals
Right Money Management App For Your Financial Goals
 
AI & Machine Learning Presentation Template
AI & Machine Learning Presentation TemplateAI & Machine Learning Presentation Template
AI & Machine Learning Presentation Template
 
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
 
TECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service providerTECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service provider
 
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfThe Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
 
Diamond Application Development Crafting Solutions with Precision
Diamond Application Development Crafting Solutions with PrecisionDiamond Application Development Crafting Solutions with Precision
Diamond Application Development Crafting Solutions with Precision
 
8257 interfacing 2 in microprocessor for btech students
8257 interfacing 2 in microprocessor for btech students8257 interfacing 2 in microprocessor for btech students
8257 interfacing 2 in microprocessor for btech students
 
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
 
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
 
5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdf5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdf
 
VTU technical seminar 8Th Sem on Scikit-learn
VTU technical seminar 8Th Sem on Scikit-learnVTU technical seminar 8Th Sem on Scikit-learn
VTU technical seminar 8Th Sem on Scikit-learn
 
Vip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS Live
Vip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS LiveVip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS Live
Vip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS Live
 
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
 
Define the academic and professional writing..pdf
Define the academic and professional writing..pdfDefine the academic and professional writing..pdf
Define the academic and professional writing..pdf
 
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
 
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsUnveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
 
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
 

Azure Weekly - 2015.01.20 - Marco Parenzan - Data Opportunities with Azure

  • 1. Data Opportunities with Azure Marco Parenzan Azure Weekly – January 20th, 2015
  • 2. Marco Parenzan Training and Speaking with 1nn0va Microsoft MVP 2014 for Microsoft Azure Training and planning with ITS Kennedy www.slideshare.net/marco.parenzan marco [dot] parenzan [at] libero [dot] it www.innovazionefvg.net Developer and Architect in .NET and Web Cloud Developer Loves functional programming Some videogames for fun
  • 3. Data Legacy WITHOUT Azure ď‚š It’s common having just ONE data store in our toolbox ď‚š Typically it’s a relational database (either Microsoft SQL server or other SQL vendors) ď‚š Traditional hosting providers had just few combinations of data and hosting capabilities ď‚š Is Azure just another data (and hosting) opportunity?
  • 4. Data WITH Azure ď‚š Azure give you many opportunities handling you data ď‚š Not just relational ď‚š Not just small ď‚š Not just monolithic ď‚š Not just table ď‚š Not just fields ď‚š ….
  • 5. One Scenario ď‚š You have an ASP.NET MVC application ď‚š But ASP.NET WebForms, PHP, Java is the same ď‚š You have a relational DB in SQL Server ď‚š But having a MySQL, Postgre, “Oracle”, is the same
  • 6. Opportunity Enhance you SQL-BASED ASP.NET experience with AZURE
  • 7. Is Azure just a new hosting opportunity? ď‚šYes, it’s an operational opportunity. You can solve your issues about ď‚š Deployment ď‚š Security ď‚š Maintenance ď‚š (some) Scalability
  • 8. Is Azure just a new hosting opportunity? ď‚šNo, it’s also an architectural opportunity, but only if you write some code ď‚š Cache your data ď‚š Search your data ď‚š Query your data
  • 9. Agenda ď‚š Operational opportunities in Azure ď‚š Developer opportunities in Azure
  • 10. Handle relational data with IaaS: Pro ď‚š Free to choose your OS ď‚š Full power of a Relational DB ď‚š Simple Scaling Up ď‚š “partial” licencing ď‚š Pay Per Use (no CAPEX) ď‚š Full power control ď‚š Ready images (no installation) ď‚š With specific configurations ď‚š Just Click, Name, choose, deploy
  • 11. Handle relational data with IaaS: Cons ď‚š OPEX: highest ď‚š Relational (non open) DBMS are expensive ď‚š Bits+Management ď‚š You have to be a real Administrator ď‚š Scalability: you can ONLY scale up ď‚š Current sharding needs application to be updated ď‚š Current sharding is in experimentation stage
  • 12. DEMO SQL Server in a Azure VM
  • 13. Handle relational data with SaaS ď‚š You don’t want to handle management issues ď‚š You don’t want vertical scalability-related issues ď‚š You don’t need special infrastructural architecture ď‚š “PaaS if possibile, IaaS if really needed”
  • 14. Handle relational data with SaaS: Pro ď‚š OPEX: lower than IaaS ď‚š Bits+Management ď‚š Full power of a Relational DB ď‚š Editions ď‚š Clustering ď‚š CPU+Memory ď‚š No licencing (No CAPEX) ď‚š Pay Per Use (OPEX) ď‚š No need for images
  • 15. Handle relational data with SaaS: Cons ď‚š OPEX: lower, than IaaS ď‚š Partial power of a Relational DB ď‚š Configure what is just available ď‚š Scalability: can ONLY scale up
  • 16. Migrating your on-premise SQL to SQL Azure ď‚š Not all features of On-Premise SQL are available in SQL Azure ď‚š A “backup” is not enough to bring DB to the cloud ď‚š Exporting a script ď‚š Last December 2014 update have great news ď‚š Some tools are available, updated ď‚š Developer Way: Database Project, targeting SQL Azure ď‚š Operations Way: Database | Tasks | Deploy to Windows Azure SQL Database ď‚š https://sqlazuremw.codeplex.com/
  • 17. DEMO Migrate your SQL Database to SQL Azure
  • 18. Host your Web Application in a Azure Web Site ď‚š Publish your Web Application in a Web Sites ď‚š Seconds (minutes) to go ď‚š Configure DB access in web.config
  • 19. DEMO Publish your web app to Azure Web Site in Visual Studio 2013
  • 20. Stateful web application ď‚š Statefulness is the state that influences the computation of every request in a web application ď‚š State avoids horizontal scalability ď‚š State is evil, but you have it!
  • 21. Bring state OUTSIDE your web server ď‚š Redis as an efficient in memory key/value store ď‚š Configure ASP.NET MVC to use Redis (declarative approach) ď‚š Session State is taken OUTSIDE web application ď‚š State can be shared between two or more instances (scaling out!)
  • 23. Latency in a cloud environment is an issue ď‚š In a cloud environment, database is FAR from app hosting ď‚š Query result set can “arrive” long… ď‚š How many times is a query executed? How many times same data are retrieved? ď‚š In a pay per use environment, queries costs? ď‚š SQL licensing ď‚š Bandwidth
  • 24. Programming approach to Redis ď‚š Implements a cache-aside pattern ď‚š http://azure.microsoft.com/en-us/documentation/infographics/cloud-design-patterns/ ď‚š Query cache first ď‚š If not found, Query data source and store result in cache ď‚š Cache invalidation rules have to be handled ď‚š Explicit ď‚š Timeout ď‚š Find many .NET clients in nuget ď‚š Example Stack Exchange implementation
  • 25. DEMO
  • 26. Search inside your data ď‚š Search on relational DB is tipically “field-oriented” search ď‚š Search in the web is more “context free”, “full text” search ď‚š Handling text is not simple
  • 27. Azure Search ď‚š A search-as-a-service solution allowing developers to incorporate great search experiences into applications without managing infrastructure or needing to become search experts. ď‚š You acquire immediately all text search experience ď‚š You acquire immediately support for languages ď‚š It is based on Elastic Search ď‚š Bullet proof, state of the art, search implementation ď‚š It is independent from a specific data source ď‚š You need to publish your data EXPLICITLY to the search service
  • 28. DEMO
  • 29. Latencies with data ď‚š As already told, data is “far” from app ď‚š You can have issues with timeouts ď‚š You have to retry a query
  • 30. Data that scale out ď‚š You can handle scalability in two ways ď‚š Scale up: increase power of your “hardware” to improve application responsiveness ď‚š But you cannot avoid programming issues, like “locks” ď‚š Scale out: partition data. Divide data horizontally (by key) to distribute data between instances. ď‚š Problem: SQL db don’t partition
  • 31. Entity Framework to the rescue ď‚š All issues can be solved at application level with Entity Framework (EF6) ď‚š Well, with some help from external code ď‚š Not native implementations ď‚š Not the best solutions in Cloud
  • 32. DEMO
  • 34. Recap Operations ď‚š Migrate your DB to SQL Azure ď‚š Or the equivalent DaaS for the RDBMS you like (https://www.cleardb.com/, for example) ď‚š Use IaaS only if you really (really) need ď‚š Publish your app on Web Site
  • 35. Developer Recap ď‚š Create a Redis instance ď‚š Configure SessionState if you use Session in ASP.NET ď‚š Implement cache-aside pattern to avoid repeated queries – this is the same for every db you use ď‚š Create an Azure Search instance ď‚š Enhance your experience in text search! ď‚š Improve EF experience ď‚š Handle retries (in cloud is mandatory) ď‚š Partition your data if you have very big datasets
  • 36. Conclusions ď‚š Consider Azure as a Platform opportunity for your application ď‚š Consider Azure as a Data Platform opportunity for your application ď‚š You cannot move your application without making improvements to your architecture ď‚š Make an assessment to check all issues with your legacy chooses ď‚š Evaluate all other data opportunities in Azure
  • 37. Thank You! - Q&A Marco Parenzan Azure Weekly – January 20th, 2015 Email: marco.parenzan@live.it Slideshare: http://www.slideshare.net/marcoparenzan GitHub: https://www.gihtub.cob/marcoparenzan Twitter: http://twitter.com/marco_parenzan