1. Intelligent
Cloud Computing
Julie Kim
(kjulee114@gmail.com)
1

2. Cloud Computing
• The use of computing resources
(hardware and software) that are delivered
as a service over a network
http://upload.wikimedia.org/wikipedia/commons/thumb/b/b5/Cloud_computing.svg/400px-Cloud_computing.svg.png 2

3. “X” As A Service
• SaaS
– Software A Service
– Common delivery model for business
• PaaS
– Platform As A Service
– Providing computing platform and solution stack
• IaaS
– Infrastructure As A Service
– Providing physical or virtual related resources
3

4. Platform As A Service
• Elastic Computing
– Scale up/down
• Parallel control
• Resource
management
• Load balancing
• Failover
• ON DEMAND…
http://upload.wikimedia.org/wikipedia/commons/3/3c/Cloud_computing_layers.png 4

5. Elastic computing
Scale up or out Which node is busy?
Which network is
congestion?
How to detect
HOW TO congestion?
Traffic Congestion Problem
5

6. Traffic Congestion
• A condition on road network that occurs as
use increases
– Slower speeds
– Longer trip times
– Increased vehicular queuing
Longer waiting time Response Delay
System Overload Decrease QoS
6

7. Intelligent Transport System
• Applied various area
• Wireless communication
• Computational technologies
– Hardware memory management
– Process control
• How about apply it to Cloud system..?
7

8. Keyword: Intelligent
• Grid Load Balancing Using Intelligent
Agents
• Prediction-based Virtual Instance
Migration for Balanced Workload in the
Cloud Datacenters
8

9. ACM Future Generation Computer Systems 2005 Pages 135 - 149
GRID LOAD BALANCING
USING INTELLIGENT AGENTS
9

10. Agent
• Managing processor of local resource
• Scheduling incoming tasks
• Hierarchy of homogeneous agents
• Communication Layer
• Heterogeneous networks interface
• Coordination Layer
• How act on the request
according to its own knowledge
• Local Management Layer
• Performs functions
for local grid load balancing
10

11. Performance Prediction
• A KEY
– Resource scheduling
– Load balancing
• PACE
– A toolset for the performance prediction of
parallel and distributes systems
• Local/Global load balancing
– Resource scheduling
11

12. Load Balancing
• Local
– First-come-first-served algorithm
– Genetic algorithm
• Reorder tasks for optimal execution time
• Global
– Agent Capability Tables
• This ACT/Local ACT/Global ACT
– Data-pull/Data-push
12

13. RIT
PREDICTION-BASED VIRTUAL INSTANCE
MIGRATION FOR BALANCED WORKLOAD
IN THE CLOUD DATACENTERS
13

14. Load Balancer
• Xen Hypervisor based
– Monitoring the loads of the servers
– Detecting indications of overloading
– Migrating virtual instances
• Modeled as..
– A multidimensional
knapsack optimization
– Bin packing
http://www.websters-online-dictionary.org/images/wiki/wikipedia/commons/thumb/f/fd/Knapsack.svg/250px-
Knapsack.svg.png 14
http://www.astrokettle.com/b_y3r1x.gif

15. Reactive-Predictive Load Balancer
Polling
# of virtual
instances
CPU
Memory
I.O
Network
utilization
1) Which virtual machines
on the overloaded server
to migrate
2) The new destination server
1 to migrate to
2 15

16. Conclusion
• Key problem
– How to be Intelligent?
– How to control data congestion?
– Traditional approach
• Prediction performance of each virtual node
• Task migration
– Future work
• Allocate request before congestion
• Data flow monitoring and request scheduling
16

17. Q&A
17

18. THANKS
18

19. References
• http://en.wikipedia.org/wiki/Infrastructure_as_a_service
• http://en.wikipedia.org/wiki/Platform_as_a_service
• http://en.wikipedia.org/wiki/Intelligent_transportation_system
• Junwei Cao, Daniel P. Spooner, Stephen A. Jarvis, Grahan R. Nudd,
Grid load balancing using intelligent agents, ACM Future Generation
Computer Systems, 2005, Page 135-149
• Shibu Daniel, Minseok Kwon, Prediction-based Virtual Instance
Migration for Balanced Workload in the Cloud Datacenters, RIT,
2011
• Fei-Yue Wang, Parallel Control and Management for Intelligent
Transportation Systems: Concepts, Architectures, and Applications,
IEEE Intelligent Transportation Systems, 2010, Page 630-638
19