2024: Domino Containers - The Next Step. News from the Domino Container commu...
Kluczowe elementy infrastruktury...
1. Managing the Cloud with Oracle Enterprise Manager Michał Kuratczyk principal solution architect
2. The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remain at the sole discretion of Oracle.
3. Oracle Cloud Platform for PaaS Cloud Management Platform as a Service Infrastructure as a Service Oracle VM for x86 Operating Systems: Oracle Enterprise Linux Cloud Management Oracle Enterprise Manager Configuration Mgmt Lifecycle Management Application Performance Management Application Quality Management Database Grid: Oracle Database, RAC, ASM, Partitioning, IMDB Cache, Active Data Guard, Database Security Application Grid: WebLogic Server, Coherence, Tuxedo, JRockit Shared Services Integration: SOA Suite Security: Identity Mgmt Process Mgmt: BPM Suite User Interaction: WebCenter Oracle Enterprise Linux Oracle Solaris Oracle VM for SPARC (LDom) Solaris Containers Servers Storage Physical and Virtual Systems Management Ops Center Oracle Applications Third Party Applications ISV Applications
4.
5. Oracle Enterprise Manager Service Desk Connectors Event Connectors Plug-ins Bi-Directional Connectors to exchange alerts, events Rich Set of Plug-Ins to Monitor Non-Oracle Products Comprehensive Connectors to IT Service Management Systems
6. Oracle Cloud Management Capabilities Existing Capability Lifecycle Management Provisioning Dynamic Resource Management Patching Configuration and Compliance Compliance Dashboards Application Configuration Management Collection, Tracking, History Planned Capability Major Enhancement Application Performance Management Real User Monitoring SOA, Java, JVM Diagnostics, Tuning Application Quality Management Functional/Load Testing Data Masking Real Application Testing Foundation Capabilities Self-Service Application Policy-based Workload Management Capacity & Consolidation Planner Assembly Packaging Metering & Chargeback Cloud Setup ‘ Out-of-the-Box’ Cloud Solutions Key:
13. Cloud Architecture Cloud Management Layer Cloud Infrastructure Layer Chargeback & Capacity Planning Policy Manager (SLA Mgmt, DRS, DPM) Monitoring Provisioning Config. Mgmt. Self Service Provisioning Software Library APIs to integrate with external billing system Self service APIs Assembly Builder APIs to integrate with external CMDB Oracle Virtualization Plugin External Cloud Plugin e.g., Amazon Zone A Zone B Server Pool Tightly coupled cluster (HA, Live Migration) Server Pool Tightly coupled cluster (HA, Live Migration) Server Pool Loose grouping of individual machines (no HA or Live Migration) Storage Array Storage Array Storage Array Storage Array Storage Array (optional)
14.
15.
16.
17. Oracle Assembly Builder Package Multi-Tier Applications Oracle Application Grid Oracle SOA Suite Oracle BPM Suite Oracle WebCenter Oracle Identity Mgt Oracle Database Grid Deployment Introspection & Assembly Oracle VM Template Builder OVF Packaging Oracle VM Server Application A Application B Virtualized Software Appliances Oracle Enterprise Manager Assembly A Assembly B Coming Soon
This is a diagram of the Oracle Cloud Platform as we covered during the keynote. . . A key aspect of what delivers Cloud capabilities is Management. Our Enterprise Manager already has very comprehensive capabilities to manage the full “Cloud Platform” stack including middleware, database, OS and virtualization. The focus of this breakout session is Oracle’s management offerings and road map for cloud.
These seemingly opposing forces make the management of cloud environments particularly challenging. Agility is often associated with high cost but cloud computing can actually deliver both if you have the right management approach and solutions. Both business and IT want agility. They want to be able to drive business processes and change in a swift manner to deal with competitive pressures. However, many of the business policies or changes can not be easily implemented because their impact on IT resources is not well understood. Business users want to rapidly and inexpensively provision/de-provision/re-provision technology infrastructure and IT resources. However, these resources today can take weeks if not months to deploy. Even when these deployments are done rapidly, the sizing is not done appropriately and invariably too many or too few resources are provisioned and hence such endeavors turn out to be very costly. Flexibility and control similarly are at odds. To make the most of your IT investment, you need to find new ways to increase their utilization and this is what the cloud can offer in a private cloud setting however this becomes a major control issue as you start to manage resources which are shared in this way. Without proper management solutions, the cost of managing “the demand” would make a cloud environment economically unfeasible. While on one hand cloud solutions offer tremendous flexibility to end users because they can provision systems needed on demand, unmanaged proliferation of these on-demand servers can create a nightmare for IT. So IT really has to deliver a cloud solution that on one hand does not restrict the flexibility and on the other hand delivers control and governance on what end users are doing.
Oracle Enterprise Manager is Oracle’s central management solution for managing Oracle-based private cloud environments. This product provides what you need to address the challenges we described earlier. In this presentation, we will talk about various aspects of this product which will help you manage the cloud. First, Oracle Enterprise Manager provides robust capabilities for the complete IT lifecycle – from develop to test to deployment and operations. Ofcourse, it is the best solution to manage the Oracle stack but in addition it can manage non-oracle products via a set of plug-ins. It is integrated with service desks and other management frameworks using connectors that help EM exchange events, alerts, and other service ticket related data with 3 rd party products.
Oracle Enterprise Manager offers capabilities today that can help customers on the left side of the previous slide. It also has capabilities today to help customers who identified themselves on the right hand side of the previous slide. We will cover these areas. We will also cover some very exciting new capabilities that are upcoming. The new capabilities will enable you to deploy out-of-box cloud management solutions. It is important to note that unless the foundational capabilities are in place, you will not maximize the benefits of cloud computing. So it pays to be honest about your own IT management capabilities and set realistic objectives to ensure your path to the cloud offers the maximum benefit. Oracle Enterprise Manager offers many capabilities that can help customers build, test, deploy, and operate cloud solutions for their enterprise today. In addition, many of these capabilities are being significantly enhanced to further automate and simplify the planning, creation, deployment, and operations of cloud environments. Whether an enterprise decides to deploy a IaaS or a PaaS, Oracle Enterprise Manager will offer rich capabilities for both. In the next few slides, we will look at some more details on how Enterprise Manager enables cloud management today and what is in the product roadmap.
When rolling out cloud, several activities exist. Some are one time activities like cloud setup to others that must be maintained on an on-going basis such as monitoring and patching. What is more, different activities are performed by different roles in the company. Infrastructure admin sets up the infrastructure, app admin sets up application policies, line of business admins initiate service requests. You can get solutions from a different vendors but none will give you a comprehensive solution across all these areas. We have coverage across all these activities. There are parts where we enhancing in the future. We will go through those areas on this presentation. With this solution, you gain agility and cost efficiency. First of all, Oracle Enterprise Manager offers a robust solution for the complete lifecycle management of software deployment in cloud environments. Whether the infrastructure supporting the cloud is deployed in virtual environments or physical environments, Oracle Enterprise Manager can help simplify numerous aspects of these deployments. Setup Cloud infrastructure : First of all, when deploying a virtual environment, EM allows you to provision Oracle VM server software on bare metal machines. It simplifies the creation of virtual server pools as well as the configuration of these pools to be deployed in a highly available manner. Once this setup has been done, administrators can use Enterprise Manager to simplify the creation and registration of virtual machines so that they can be centrally monitored and managed. A rich set of options is available for the creation and provisioning of guest virtual machines – including a. Using Oracle VM templates b. Using ISO images c. PXE bootable guest virtual machines that boot over a network. For applications deployed in physical environments, Oracle Enterprise Manger automates the bare metal deployment of linux operating system and software on top of the linux stack in an efficient manner. Administrators can provision the complete stack on bare metal server to simplify and accelerate the deployment cycle. Build App and package as application : Second, Oracle makes it easier to create templates or application appliances that can be deployed into a cloud environment. Oracle VM templates and the template builder tools offer an easy way to create, package and distribute the complete application environment which can easily be imported and deployed into a cloud environment. Deployment time for applications can be reduced significantly. Once imported into a cloud environment, these applications can be used as gold images to clone them to create multiple instances of the application running in the cloud. Oracle has also simplified the licensing and distribution of the core components of these templates so that ISVs and other enterprises can easily create these templates and distribute/deploy them for their customers. Setup Cloud Policie s: Cloud administrators can set up policies using Enterprise Manager that dictate how the VM and its applications are placed and started within the server pool in the cloud. Different policies can dictate whether this placement on a server happens automatically based on algorithms that determine which server has the best resources available or based on user-defined policies, or even based on a preferred-server policy that specifies a named subset of servers that must be used to host a particular application and its virtual machine instance. Deploy : Oracle Enterprise Manager offers a very rich set of capabilities for deploying not just the infrastructure that supports the cloud but also applications that run in the cloud. Earlier we already talked about the facilities for deploying and setting up the cloud. Let’s look at the capabilities available for deploying into the cloud. First, Oracle Enterprise Manager can be used for automating the deployment of a wide variety of software packages including the Oracle database, middleware, and applications. It supports a variety of mechanisms for deploying including both cloning, fresh installs, and template based creations. The deployment tools support distributed multi-tier installs of database RAC environments, Oracle middleware environments, and SOA environments. Last but not least deployments of applications like EBS. A customizable framework for deployment procedures is available to adapt the out-of-box mechanisms to your private cloud or develop completely new procedures useful for any enterprise. Patch : Oracle Enterprise Manager’s capabilities for patching your software environment are unmatched. It provides comprehensive and innovative capabilities that span advising customers on what patches are available and should be applied, to planning how to obtain these patches and test these patches, to actually applying and deploying patches in an highly automated and scalable manner to large numbers of systems and finally verifying that these patches were deployed in compliance with IT procedures and processes. Patching automation is available for the underlying VM and operating systems as well as the database, middleware and applications that run in the cloud. Patching of HA environments can be done in a rolling manner as well to ensure high quality of service. Monitor : Once the applications are deployed to the cloud, it is critical to monitor its functions on an ongoing basis. EM offers rich features to monitor not only the cloud infrastructure – the hardware, the VM, and operating system but also the applications deployed in the cloud. Scale Up/Down: During the operations of these applications deployed to the cloud, unpredictable demand patterns may require automatic scaling up or scaling down of resources for a given application. Enterprise Managers simplifies the way users can automatically add or remove capacity to support these workloads. Some of the mechanisms include – live migration of a VM and its applications to machines where more resources are available, extending RAC clusters on demand, converting a single node database to a RAC database, automated configuration and scaling out of middleware clusters. Decommission : Finally, once an application, database or middleware server is not being used any longer or has been scaled back, EM can be used to uninstall the software from that node so that it can be used for other purposes.
Configuration management and compliance are critical components of any management environment but more so for the cloud because of the dynamic nature of cloud environments. Without a strong element of control, sprawl and frequent changes can cause all kinds of problems from performance to security. EM’s solution in this area starts with discovery of assets to standardized policies to detecting changes in real time. It is a comprehensive set of capabilities that help you control your cloud environment and guard against unauthorized change. Asset Discovery : Oracle Enterprise Manager offers a comprehensive set of configuration management capabilities – all integrated into one tool. It discovers and manages the complete inventory of assets running in the cloud – starting from the operating system, hardware, database, middleware, virtualization software and custom or packaged applications. That is the foundation of configuration management because it is key to accurately and precisely know what you are running in the cloud. Users can search this information and view relationships among the different elements to understand where in the cloud some specific applications are running and how they have been configured. Drift Analysis : Given that the cloud is a dynamic environment and a lot of the flexibility of provisioning new systems and applications is given to the end users, it is important that configuration changes are easily detected and analyzed to ensure that these changes are not the root cause of any service disruptions. Enterprise Manager enables users to very quickly perform configuration comparisons of the components that make up an application running in the cloud, do comparisons of the entire application stack – make comparisons to a baseline or to a gold standard so that changes can be quickly identified and remediated. In addition to analyzing configuration of software and applications running in the cloud, it is equally important to do the same for the infrastructure that supports the cloud deployment. Proactive Checks : While configuration comparisons and drift analysis offer powerful tools to analyze configuration changes, these are reactive measures to alleviate issues. In a dynamic environment like the cloud, where IT resources may be serving a much larger community, one needs to put in place more proactive measures to monitor how configuration changes are being made in the cloud environment. Oracle Enterprise Manager provides a powerful policy engine that can leverage Oracle delivered policies (based on best practices), and allow users to defined their own policies that can be used to automatically and proactively measure policy deviations from reference baselines and gold standards. When some such violations are detected, alerts and notifications can be generated to inform IT administrators of such changes and proactive action can be taken when needed. Oracle Enterprise Manager also provides a dashboard where the configuration compliance of the cloud infrastructure and the applications running in the cloud can be viewed. By using an integrated product like Enterprise Manager, administrators can drill down into specific violations (directly from the compliance dashboards) and remediate them. Detecting Configuration Changes : Last but not least, Oracle provides a unique capability to detect configuration changes (who, what, when) in real time. These detected changes can then be validated against authorized and approved changes via a service desk. Unauthorized changes can then be rolled back to get the cloud environment into a healthy and compliant state.
One of the most important aspect of cloud management is governing SLAs. The SLAs are not limited to uptime and backend performance but also around user experience. Oracle APM takes a comprehensive approach of covering the entire path right from the end user experience to the actual data on disk. We have instrumented the middleware, database, and storage layers to get deep diagnostic information about performance bottlenecks. We also have hooks to remediate those bottlenecks. In addition to providing agility for provisioning IT resources and applications rapidly, another benefit that cloud deployments offer is elasticity. Which basically means that there is practically unlimited amount of resources and these resources can be easily deployed when needed to deliver the right performance to the end user. Applications and resources can easily be scaled up and down when application performance suffers. However, one of the critical elements before you can create an elastic scale up/down infrastructure is the monitoring and performance management of the applications running in the cloud. Oracle offers a comprehensive integrated solution to monitor and manage performance of the cloud and the applications running in the cloud. First, to monitor performance of applications running in the cloud, Oracle offers its complete Application performance management solution that begins with monitoring real user experience. Oracle’s APM solution can not only monitor user experience of web applications deployed in the cloud, it can also monitor other enterprise applications running in the cloud – applications based on Oracle Forms (like Oracle E-business suite). Oracle provides out-of-the box accelerators that are pre-instrumented to monitor the user experience of these applications. From real user experience monitoring, Oracle Enterprise Manager can contextually provide end-to-end visibility of what is going on within the applications or the services that make up these applications all the way down to a specific resource views. Oracle Enterprise Manager can detect and diagnose performance problems in the middle-tier and the database and even recommend changes that can be deployed to remediate these problems. For complex performance issues that manifest across tiers, it can truly identify cross-tier performance issues and help remediate. Secondly, for applications running in the cloud, Oracle Enterprise Manager offers monitoring capabilities of the complete stack underneath these applications. It can monitor the performance of the virtual machines, the operating system and the underlying hardware. When there are alerts generated from a particular resource because of poor performance in a specific VM, that information can be used to determine the bottlenecks and if that specific hardware resource can not provide any additional capabilities, the VM and its application can be live-migrated to another more powerful resource to fix and alleviate the performance issue.
We provide our customers most comprehensive quality management solutions. - At the application tier, we can help users automate functional, regression and load testing. - For database and underlying infrastructure changes, we have a very unique solution in Real Application Testing. - We can also help protect your sensitive data – such as credit card and other such personal information – so that you can perform testing in a secure manner. The integration and completeness is once again our hall mark here. Unlike other vendors, we don’t provide individual pieces. Rather we give you a complete solution covering all tiers of your application stack.
Before we get into our upcoming capabilities for managing the cloud, lets take a moment and look at the environment which will enable your cloud computing. There are two broad layers. Infrastructure and management layers. It’s important to consider the management layer as an integral part of your architecture because cloud is a massively shared infrastrucutre. Traditionally you would build a picture of your infrastructure and then deal with the management of it. Oracle believes this approach will not work for cloud computing. We are investing heavily in both areas to deliver an integrated solution so when you setup your infrastructure, the management of it is in place and optimized. Whereas you were used to get these two layers from different vendors, Oracle will deliver both and hence will significantly reduce complexity and operational headaches. We recognize the importance of openness. We will also integrate with third parties such as external cmdb, external billing etc.
This is a one time activity. Once in place, everything from software and apps will have to be deployed on this infrastructure. So, it pays to ensure that you are fully enabling cloud operations such as elasticity and dynamicism. This has not been a traditional area of investment for Oracle. However, going forward, Oracle will be investing in this area and again the integrated approach for infrastructure, applications and management is what we can offer that others can’t. It enables lower costs and better service levels. As discussed earlier, there are a very rich set of capabilities already in Enterprise Manager to setup a cloud infrastructure. In future releases of Enterprise Manager, these capabilities will be enhanced to provide an even more automated experience to setup and operate the cloud. The cloud infrastructure requires many servers to share resources like storage where images can be stored and be used when starting virtual machines in the cloud. Setup and configuration of this shared storage will be automated. Whether an IT department decides to use a NAS filer or a iSCSI SAN, its setup and configuration will be simplified. As the usage of the cloud grows and its adoption requires more storage resources, that process will be automated as well so that the time to provision these resources is minimized and does not become a bottleneck. Working with its partners, Oracle recently announce the VM storage connect framework to create an integrated server and storage management capability in the cloud. The initiative defines a storage provisioning API endorsed by leading vendors like EMC, Hitahci, Fujitsu, netApp, Qlogic and others. This will help Oracle VM to leverage all resources and functionality in existing storage systems and provide an integrated virtualization and storage management experience. Similarly, the setup and configuration of the physical and virtual network will be automated as well.
Capacity planning and budgeting are different in a cloud world. Most IT departments procure hardware only after a particular project is approved, and that hardware is often dedicated to that project. In a cloud world, hardware is shared, and so a certain amount of capacity has to be on hand for users to obtain those resources on-demand. Most customers convert existing infras to cloud. When you consolidate for this purpose, how do you decide what needs to be done? You will need to apply business rules (e.g. avoid two departments on the same box) and technical rules (e.g. avoid mixing workloads on the same box). With EM, IT will get advice on how to consolidate. Then through in-context provisioning, EM will make it happen for all consolidation techniques like p2v and v2v. Consolidation Planner provides capabilities for the company's IT department to consolidate under-utilized servers in the company data centers, or to consolidate servers for migrating to company private cloud. Over the years, company data centers likely have more and more servers being added due to business requirements. While the excess servers occupy rack space, consume a lot of power for cooling, and require system maintenance such as security and patching, many of them are under-utilized. With Consolidation Planner, company IT department could identify the under-utilized servers and find a way to consolidate these servers to free up as many servers as possible, at the same time maintaining the service levels. When deploying a private cloud within enterprise, with Consolidation Planner, company IT department could identify the managed servers that are capable of migrating to the cloud, estimate the total demand of server resources for a purchase requisition of additional hardware and storage if necessary, and come up a way to group these servers to ensure some optimal consolidation with satisfactory performance and at the same time, complying with various business, compliance, and technical constraints. Customers can leverage the server hardware/software information collected by EM to optimize consolidation plans by maximizing the server density and minimizing resource contention while maintaining performance commitment and satisfying business constraints.
At Oracle, we have had to tackle the requirement for rapid deployment and redeployment of applications for some time. The success we had in solving the problem internally was a major force in bringing you a solution for your self-service needs. Two examples of this are: Several thousand developers need test environments on an on-going basis. Previously, they used to spend a lot of time to create their own enviornments. Now it takes them a couple of minutes and it works every time! OU needs to set up educational environments consisting of servers, applications and so on. Again on an on-going basis. Today, they can repurpose their resources on-demand. In a self-service environment, the user gets what they need while allowing IT to focus on what matters. IT staff are not forced to “herd” servers and storage. Instead they focus on making the flexible infrastructure available so business users can get on with their jobs. But a self-service environment has some key requirements. Automated assembly of services and metering, chargeback and cost justification. We will look at these requirements next.
A self service environment demands automated packaging and delivery. This is a key area of investment for Oracle. Oracle Assembly Builder is a tool for packaging multi-tier applications, including both middleware and database components and their “interconnections” in a way that is easily deployable, movable, etc. Once an application or service is packaged up, EM can consume it as a software image/configuration and deploy it automatically to many locations as needed. In order to ease deployment and management of Oracle products, we propose to ship a set of pre-configured virtual machine appliances that can be provisioned on-demand. These could either be a single virtual machine image (for example for single instance database) – referred to as appliances – or multi-tier applications involving several virtual machine images (virtual appliance assembly). For example, for eBusiness Suite, we can ship an assembly consisting of a database appliance, a mid-tier/application server appliance, and possibly a proxy/load balancer appliance. Users will then be able to provision a complete eBusiness suite environment as a single entity - with the proposed Cloud infrastructure automatically deploying all the required individual virtual appliances and knitting them together. We will not spend too much time here since it has been covered in Keynote #2: “Essential Building Blocks of Private PaaS” and also in the upcoming session on “Virtualization and Cloud Computing”
Assembly builder: A toll for Admins to build their appliances and assembles. Traditional packager software focuses on the LAMP stack. We go broader and deeper to cover business applications. We ship appliances for database, middleware and business apps.
Self service is about deploying apps faster and making technology more readily accessible to the end users who use it to conduct business. But without a set of policies and rules, there will be no accountability and chaos can ensue. Therefore, resource management policies become an important requirement. While other vendors focus on infrastructure metrics, Oracle is focused on business application and service metrics for these policies. So, if the quote-to-cash process is running slowly, you will know what needs to be done to restore normal operations. Some of this capability is delivered in Oracle VM 3.0, which integrates capabilities acquired from Virtual Iron. Specifically, we can set policies which govern the automated scheduling of resources and also power utilization. This component will be responsible for enforcing user-defined policies. These policies could be as simple as determining initial placement of VMs, reserving capacity to meet a future need (VM reservation) or as sophisticated as dynamically scaling application up or down to maintain a certain level of business service level. This could also include DRS and DPM capabilities but some of this could potentially be pushed down to the infrastructure level.
Metering and chargeback provides a level of control to ensure you can service your business users and that the value of your services is known to the business. Some organizations may want to use this information for cost justification and billing. This area is important and we are investing heavily in it. It’s important to note that while we intend to deliver an out-of-the-box solution in this area, EM has a rich set of metrics which it collects today. They can be used for cost justification purposes. A unique area in EM is it’s ability to monitor service performance from an end-user perspective and monitoring of services deployed on Oracle Applications. The Chargeback Application addresses the utilization and cost allocation problem introduced by consolidation and virtualization on IT resources. With the chargeback application in place, the IT departments will know how much resources are utilized and how much of the IT cost is consumed by each organization/client. It can help to reduce the IT cost since the consumers may request or utilize the IT resources only when it is necessary after being charged based on the usage. Within the Chargeback Application, the EM administrators can: - Allocate the cost of related IT resources to EM target types or targets. - Define and evaluate the charge plans based on the cost and related chargeback metrics. - Aggregate the utilization data on required consumer level and calculate the charges for the chargeback groups. - Provide the chargeback report for each chargeback group so IT department can charge the IT cost back.
Here are some resources for additional information. If you wish to conduct a QA, do it while this window is up.
