Protecting from transient failures in cloud microsoft azure deployments

1. Protecting from Transient Failures in Cloud
Microsoft Azure Deployments
Supervised By:
Dr. Mohammad Abdur Rouf (Professor)
Head of Department of Computer Science & Engineering
Dhaka University of Engineering and Technology, Gazipur
Ph.D. (KAIST) , M.Sc. Engg. (BUET), © B.Sc. Engg.
(KU)
Dhaka University of Engineering and Technology, Gazipur
Presented by
Md. Mostafijur Rahman
M.Sc. Engg. Student ID #: 132431 (p)
Department of Computer Science
and Engineering

2. Outline of the talk
• Introduction
• Related Work
• Cloud Azure Dashboard Structure
• Microsoft Azure Cloud Services 100+
• Virtual Machines & Storage Accounts
• Compute Networking Storage , Web Mobile, Containers, Databases, Analytics AI + Machine
,Learning Internet of Things, Integration Security, Identity Developer Tools, Management
Tools , Software as a Service (SaaS) and Blockchain .
• Cloud Compute Microsoft Azure
• Cloud Azure Virtual Networking
• Cloud Azure Storage and WEB Apps
• Cloud Azure Mobile, Containers and Database
• Cloud Azure Database and Analytics
• Cloud Azure INTERNET OF THINGS
• Cloud Azure AI + Machine Learning
• Cloud Azure Integration
• Cloud Azure Identity and Security
• Cloud Azure DEVOPS, Migration
• Microsoft Azure Cloud Message Routing
• Conclusions and Future Work
• References Useful Links
Dhaka University of Engineering and Technology, Gazipur

3. Introduction
• Microsoft Azure formerly known as Windows Azure is Microsoft's public cloud
computing platform. Users can pick and choose from these services to develop ander
scale new applications or run existing applications in the public cloud.
 In your browser, open the Azure portal.
 Click Create a resource > Compute > Cloud Service.
 In the DNS name input box, enter a URL prefix for the cloud service. ...
 Specify a new Resource group for the service. ...
 Choose the region where you want to deploy the application. ...
 Click Create.
• To overcome this failure, Direct Acyclic Graph that traverse the graph breath first
manner and find the deployment specific script error using AURA Tool.
• To monitor the graphical user Interface and try minimum fail script node re-executed.
• To wait for threshold time and retry fetching the resource before calling it quits.
• A fixed amount of retries within threshold time, To make consider it a permanent
failure.
Dhaka University of Engineering and Technology, Gazipur

4. Related Work
AURA application deployment with error-recovery enhancements
Dhaka University of Engineering and Technology, Gazipur

5. Related Work
AURA application deployment with error-recovery enhancements
Dhaka University of Engineering and Technology, Gazipur

6. Related Work
AURA for a Hadoop and Wordpress deployment:
Dhaka University of Engineering and Technology, Gazipur

7. Cloud Azure Dashboard Structure
Dhaka University of Engineering and Technology, Gazipur
Figure 1. AURA Architecture
Sc
Application
WEB UI Queue
REST API
Cloud
Connector
Scheduler
AURA Master
Application
Module (1) Module (2) Module (3)
AURA ExecutorAURA ExecutorAURA Executor
Cloud Provider

8. Microsoft Azure Cloud Services 100+
Dhaka University of Engineering and Technology, Gazipur
Application
WEB UI Queue
REST API
Cloud
Connector
Scheduler
AURA Master
Application
Module (1) Module (2) Module (3)
AURA ExecutorAURA ExecutorAURA Executor

9. Virtual Machines & Storage Accounts
Dhaka University of Engineering and Technology, Gazipur
We can create Multiple Virtual Machine.

10. Compute Networking Storage , Web Mobile, Containers, Databases,
Analytics AI + Machine ,Learning Internet of Things, Integration
Security, Identity Developer Tools, Management Tools , Software as
a Service (SaaS) and Blockchain .
Dhaka University of Engineering and Technology, Gazipur
3

11. Cloud Compute Microsoft Azure
Dhaka University of Engineering and Technology, Gazipur
Call Service
Success ?
YesNO
Call Successful
Next
Action
Figure : Cloud Compute Microsoft Azure
Transient
Failure ?
Yes
Retry ?
Delay Threshold Time
YesCall
failed
NO
Permanent
call fail
20<

12. Cloud Azure Virtual Networking
Dhaka University of Engineering and Technology, Gazipur
Start
Two Parameter Graph T
Failed Node n
failed ← {n}
healthy← ∅
While failed ≠ ∅
Have t ∈ depends (T, v) ?
Have
failed (t) ?
failed ← failed ∪ {t}
healthy ← healthy ∪ {t}
NO
Yes
Yes
Yes
v = POP(failed)
NO
Return Healthy
End
While
Again

13. Cloud Azure Storage and WEB Apps
Web server starts before the database server is successfully configure in right way.
Each Executor will run the necessary deployment scripts .
To monitor the deployment status through a real-time monitoring UI. [2]
Specifically, To view each script’s logs, a real-time view of the Deployment Graph, the
status of the respective script execution.
Dhaka University of Engineering and Technology, Gazipur

14. Cloud Azure Mobile, Containers and Database
Green edges represent completed scripts.
Blue edges represent running scripts.
Red edges represent failed executions .
Gray edges represent pending scripts.
Web Server stores the deployment script.
DB Server helps data manipulation activities of the Application. [2]
Dhaka University of Engineering and Technology, Gazipur
Figure 7. Cloud deployment graph with 1 Web Server and 1 Database Server
DBServer1
DBServer2
WEBServer1
DBServer3
WEBServer2
APPServer3
3
APPServer2
APPServer1 APPServer4
WEBServer3
WEBServer4

15. Cloud Azure Database and Analytics
Dhaka University of Engineering and Technology, Gazipur
To recovery from failure module deployment script using Retry Policy, to use of
No Bakeoff, Constant Bakeoff, Linear Bakeoff, Fibonacci Bakeoff, Quadratic
Bakeoff, Exponential Bakeoff and Polynomial Bakeoff etc.
# Retries
Constant
Backoff Time
Linear
Backoff
Time
Fibonacci
Backoff Time
Quadratic
Backoff Time
Exponential
Backoff Time
Polynomial
Backoff Time
1 1s 0s 0s 0s 1s 0s
3 3s 3s 2s 5s 7s 9s
5 5s
10s
7s 30s 31s 100s
10 10s 45s
88s
285s 1023s 2025s
20 20s 190s 10945s 2470s 1048575s 36100s
Table 1: Retries Backoff Approaches

16. Cloud Azure INTERNET OF THINGS
In our work, To use the AURA deployment tool to detect transient failure and re-
execute the fail module script.
The ability of AURA tool is minimum number of fail script re-execute or Retry
strategy. The retry policy delay depends on number of retries. From the Retry
strategies, To choose the exponential backoff and recover from the transient
failure in effective and optimal way .
I have tested several backoff strategies to use c programing . I have found
many results and compare among them . I have selected the exponential
backoff to protect the transient failure in effective and optimal way.
AURA (Error Recovery ) tool has been developed by using the python
programing language. I want to implement the message passing error node re-
execute or retry strategies using ASP.NET programing and database SQL
Server 2012 and snapshot implementation after certain time.
Dhaka University of Engineering and Technology, Gazipur

17. Cloud Azure AI + Machine Learning
Dhaka University of Engineering and Technology, Gazipur

18. Cloud Azure Integration
Dhaka University of Engineering and Technology, Gazipur

19. Cloud Azure Identity and Security
Dhaka University of Engineering and Technology, Gazipur

20. Cloud Azure DEVOPS, Migration
Dhaka University of Engineering and Technology, Gazipur

21. Microsoft Azure Cloud Dashboard
Dhaka University of Engineering and Technology, Gazipur

22. Microsoft Azure Cloud Message Routing
Dhaka University of Engineering and Technology, Gazipur

23. References
[1] WWW.portal.web.azure.com, I have studied the Microsoft Web Portal and
tried to understand .
[2] www.aura.com from GitHub , I have studied from here and make sure that
Hadoop and wordpress deployment to detect the transient fault Tolerance .
[3] www.ams.web.com from here , I have studied that how can I deploy the new
Application in Amazon Cloud Computing .
Dhaka University of Engineering and Technology, Gazipur

24. Section Questions and Answers
Thanks
Dhaka University of Engineering and Technology, Gazipur