DCSF19 CMD and Conquer: Containerizing the Monolith

•

0 gefällt mir•245 views

Tony Lee & Nelson Wang, Splunk Modern microservice-oriented software architectures evangelize the principles of infrastructure-as-code and declarative directives to manage and run applications. At Splunk, we wanted to marry these ideals with the majestic monolith, Splunk Enterprise, to simplify the use of our product through containerization. Without rearchitecting the entire product from the ground-up, which can be a costly investment, we focused on incorporating a flexible configuration management layer on top of the core application. This has enabled us to make running Splunk in Docker act and behave as a true microservice, greatly reducing the friction of migrating towards more container-native software. We not only concentrated on making our open-source Docker image initiative user-friendly and production-ready, but we also wanted to seamlessly integrate it back into our internal engineering process. Join us for this session as we discuss migrating a traditional application into a microservice ecosystem, developing a containerization strategy for both external customer usage and internal development, as well as learning about our internal container platform at scale.

Technologie

Software Engineer, Splunk
Tony Lee
Senior Software Engineer, Splunk
Nelson Wang

https://mpora.com/mountaineering-expeditions/famous-explorers-history-introduction

Time Intensive Disruptive Expensive
$ monolith | microservice

APPLICATION REQUIREMENTS
SCHEDULER REQUIREMENTS
ACCESSIBILITY ADAPTABILITY AUTONOMY
FAULT TOLERANCY SCALABILITYSTATELESS

BASE PLATFORM LAYER
SPLUNK LAYER FORWARDER LAYER

BASE PLATFORM LAYER
As Splunk evolves and develops, the image should grow with it

• Add file/directory monitoring
• Open a TCP/UDP socket & listen for input
• Enable receiving of syslog data
• Setup HTTP event collection token
• Forward data to another service
• Setup administrator password
• Create user accounts for access control
• Install an enterprise license
• Connect to an existing license master
• Setup indexes
• Touch configuration files
• Install apps
• etc.
Usability

• Asynchronous dynamic provisioning performed by Ansible
• Eliminate reliance on any third-party service registrar/catalog
• Parallelized setup removed ordered dependencies and results in faster
time-to-value
Micro-Orchestration Layer
entrypoint.sh
Dockerfile

Why Ansible?
Domain-specific, developer-friendly language that enables
the dynamic configurability

• Intermittent service interruption is expected within configuration layer
• Health-checks and probes to assist in lifecycle management
Fault Tolerance

• Orchestration engine
administers the
pods/containers
• Application-context is
shared amongst cluster
members via
environment variables
Distribution of State
SPLUNK DEPLOYMENT
Container
Indexer 2
Container
Indexer 1
Container
Cluster Master
Container
Search Head

SPLUNK DEPLOYMENT
Container
Indexer 2
Container
Indexer 1
Container
Cluster Master
Container
Search Head

Dynamic scaling of
specific roles
How do I add a new
indexer?
Scalability
SPLUNK DEPLOYMENT
Container
Cluster Master
Container
Search Head 1
Container
Indexer 2
Container
Indexer 1
Container
Indexer 3

External Usage
• Customers have been waiting to
run Splunk on Docker!
• Adoption amongst many
members of the open-source
community
• Examples for both swarm + k8s
manifests in our GitHub repo

Internal Usage
Support
• Cheap, reproducible
environments
• Support any size
topology, any version
Open-source images are fed back into our internal deployment
provisioning service (orca) used across the company
Sales
• Rapid, reliable demo
instances on-demand
• Support for local
scenarios for the field
Dev/QA
• Disposability around
testing changes
• Accelerates iteration
cycles in CI/CD

How?
orca leverages Docker Enterprise and Universal Control Plane (UCP)
Node
Worker
Node
Worker
Node
Worker
Node
Worker
swarm mode cluster
Node
Worker
Node
Worker
Dev/QA/Sales Team
Using Swarm/K8s
Support Team
using Swarm/K8s
Ops Team
DOCKER ENTERPRISE
EDITION

Image CI/CD
• Support for multiple platforms
• Integrated security scanning
• Functional tests for various
configurations and topologies
• Version control, custom
dependencies for individual
teams

Pipeline
GitHub
IBM s390x Agent
$ build splunk-
debian
Linux Agent
$ build splunk-
debian
Linux Agent
$ push splunk-debian
DockerHub
Public/Open-source
Internal

The Future
• Deployment frameworks (helm,
operators)
• Find ways to make Splunk more
accessible and reduce time-to-
value
• Always consider the future of
the monolith!

Summary
• Find ways to bridge the gap while migrating monolithic
software to microservice architecture
• Plan for the future
• Dynamic self-orchestration made our software offering more
nimble.

Get Hands On!
Repositories
• https://github.com/splunk/docker-splunk
• https://github.com/splunk/splunk-ansible
Documentation
• https://splunk.github.io/docker-splunk
• https://splunk.github.io/splunk-ansible
#docker @ http://splunk-usergroups.slack.com/

Weitere ähnliche Inhalte

Was ist angesagt?

DCSF 19 Kubernetes and Container Storage Interface Update

Docker, Inc.

Two things are for certain – space is hard, and Docker is not just for web content! Space software development traditionally lags behind state of the art software process for good reason – our missions are long (7+ years), we run on highly constrained embedded hardware, and the software cannot fail. Docker, along with a devops mentality, has helped us create a scalable, parallelizable and rapidly deployable test infrastructure for DART, NASA’s mission to hit an asteroid at 6 km/s. During the presentation, we will walk through how our dev cycle has changed from a human based testing system to an automated one. We will outline how we are using Docker (and NASA Goddard’s Core Flight Executive) for both our embedded development environment and our scalable test environment. Next, we will discuss what deployment means to us (and how different it is from web deployment). Lastly, we will explore lessons learned on how our hardware-centric testing approach was adapted into a software-based approach: what worked, what didn’t, what we wish we could do someday. How can you help? We are new to Docker. We are excited to share our experiences and hear from the Docker community on our use cases, technological hurdles that we faced, our solutions to these problems, and how we can harness Docker to the fullest extent.

Automated hardware testing using docker for space

Docker, Inc.

DockerCon EU 2015: The Latest in Docker Engine

Docker, Inc.

Share the continuity of Société Générale's journey with Docker Enterprise from different points of view, from executives to devops, with CD platform as an enabler. Creating a Dockerfile that runs a container on a developer's laptop is pretty straightforward. But extending that to stacks of containers running on a dozen environments (development, integration, testing, staging, production, etc.) with different configuration and topologies can be a challenge. This talk will cover aspects of our journey to Docker Enterprise: What configuration should go in an image? Where to put different types of configuration? Images, environment variables, entrypoint, ...? How to store assets for building images and configuration for deployment in version control. We will discuss how Société Générale has implemented these, and what we plan next for Docker Enterprise deployment.

Configuration Management and Transforming Legacy Applications in the Enterpri...

Docker, Inc.

Mohammed Aboullaite, xHub Nowadays, containers are more than a cool new tool to play with - they've revolutionized the way we develop, architect and ship software and have become part of our day-to-day operations. On the other hand, Java has been around for more than 2 decades, dominating the entreprise world. Both advocate the "RUN anywhere" principal, but, is it that easy? No! Your perfect working local container will most probably fail on production because of MEMORY &/or CPU issues, since jvm apps assume they OWN the server they are running on. This session will look at the gotchas of running JVM apps in containers & how to avoid costly pitfalls. We will cover: _ what updates Java 10 brought to the table to improve container awareness and the issues related to prior versions, including how to address each one of them to avoid the mess. - tips and tricks to obtain smaller images & best practices while writing your DockerFiles - some plugins to helps non-containers experts integrate docker in their development process; and - the concept of "Distroless" Docker Images and how to benefit from it.

DCSF19 Docker Containers & Java: What I Wish I Had Been Told

Docker, Inc.

Your developers just walked into your cube and said: "Here's the new app, I built it with Docker, and it's ready to go live." What do you do next? In this session, we'll talk about what containers are and what they are not. And we'll step through a series of considerations that need to be examined when deploying containerized workloads - VMs or Container? Bare Metal or Cloud? What about capacity planning? Security? Disaster Recovery? How do I even get started?

Docker?!?! But I'm a SysAdmin

Docker, Inc.

Docker Meetup 08 03-2016

Docker

Containers are quickly becoming the default foundation for modern applications. As a public cloud provider, IBM has been an early champion of containers in the cloud and has built an enterprise ready container service as part of IBM Bluemix. IBM has a long heritage of supporting, contributing to, and building offerings on top of open technologies and IBM carries this commitment to the open development of container solutions by being an active/founding member of the Open Containers Initiative and Cloud Native Computing Foundation. In this session, we will explore the enduring commitment to open technology as well as the advantages of using a pure containers service where the user has access to total solution life cycle management through integration of lessons learned, cutting edge enhancements/development and end-to-end support on the user's underlying infrastructure. We will explore topics such as exploiting bare metal servers, applying overlay networking to containers, ensuring isolation and security in a truly multi-tenant container environment and managing a global service deployment.

Production Ready Containers from IBM and Docker

Docker, Inc.

In this session, we'll go into details about the latest developments around some of the components behind the core features of the Docker Platform. We'll cover the containerd runtime that was built to serve as an underlying daemon for Docker and Kubernetes, and BuildKit, a toolkit that builds on containerd to provide next-generation capabilities for building software with the help of containers. You will learn about the architecture and design choices of these projects, for example, the power of containerd's rich client library and BuildKit's frontend model that allows introducing new build languages or Dockerfile features. You can discover how you can use these projects directly and how they are being integrated into the Docker Platform.

Docker Platform Internals: Taking runtimes and image creation to the next lev...

Docker, Inc.

Slides from my DockerCon EU 2017 Talk. Find the abstract below: "In this talk, we'll discover how Docker comes to the rescue of the Ops Team, while rebuilding from scratch our monitoring infrastructure. We'll start by quickly describing the challenges, to focus on why and how using docker saved the project. From fixing dependencies and isolation issues, implementing rolling upgrades and new features hot addition, to building a completely modular, scalable and resilient infrastructure, we'll talk about why CI/CD workflows, docker tooling and Docker Swarm were the key to success."

Docker to the Rescue of an Ops Team

Rachid Zarouali

At Docker, we like to “eat our own dog food” or “drink our own champagne.” Whatever your favorite phrase, the importance of a software company using their own software is critical to relating to our customers. In this talk, we will discuss how the Docker Infrastructure and engineering teams have deployed and operationalized Docker Enterprise Edition (EE) for our staging and production environments, what we have learned in the process, and how it's making Docker EE better.

Docker on Docker

Docker, Inc.

Building Your Docker Swarm Tech Stack

Bret Fisher

In this talk, Scott Coulton will take you through Docker's cluster solution Swarm mode with his operations hat on. We will start from the beginning by describing what swarm mode is, what it does, and how it works behind the scenes. From there, we will look at very basic configurations of Swarm mode from the point of view of the operations team as well as a production-ready workflow including deployments of the cluster, logging and CD best practices. Attendees will be able to apply their learnings to their use cases.

Docker for Ops - Scott Coulton, Puppet

Docker, Inc.

The whole Docker ecosystem exists today because of every single developer who found ways of using Docker to improve how they build software; whether streamlining production deployments, speeding up continuous integration systems or standing up an application on your laptop to hack on. In this talk we want to take a step back and look at where Docker sits today from the software developers point of view - and then jump ahead and talk about where it might go in the future. In this talk, we’ll discuss: * Making Docker an everyday part of the developing software on the desktop, with Docker for Windows and Docker for Mac * Docker Compose, and the future of describing applications as code * How Docker provides the best tools for developing applications destined to run on any Kubernetes cluster This session should be of interest to anyone who writes software; from people who want to hack on a few personal projects, to polyglot open source programmers and to professional developers working in tightly controlled environments. Everyone deserves a better developer experience.

Docker for developers on mac and windows

Docker, Inc.

Enterprises often have hundreds or even thousands of applications spread across hundreds of development teams, business units and geographies. This presents challenges to IT teams as they architect an environment to run Docker apps on globally distributed hybrid cloud infrastructure, developed by distributed dev teams and consumed by customers around the world. Docker Datacenter provides the technology and framework to implement a global software supply chain. This session will dig into the design considerations, tools and best practices to address this type of environment with Docker Datacenter. And there will be data, demos and tools! Results from various performance tests will be presented in conjunction with recommendations for high-availability configurations, content cache use cases for faster developer workflow and scheduling strategies for improving application resilience.

Global Operations with Docker for the Enterprise - Nico Kabar, Docker

Docker, Inc.

One of the common challenges for organizations that are moving more workloads to containers is running them inside a data center where you will still need to access both containerized and non-containerized workloads. In many organizations, that means you need to provide external access to and from a container and a traditional VLAN service or network via Layer 2. In this session, we’ll explain how you can interact with traditional network assets without routing through Layer 7 by using MACVLAN and Transparent Networks that allow you to use multiple MAC addresses on the same interface. We will outline how the concepts are similar but the implementations are different by demonstrating the same setup across both Linux and Windows using MACVLAN and Transparent Networks.

DCSF 19 Data Center Networking with Containers

Docker, Inc.

Presented by Casper S. Jensen, Software Engineer, Uber At Uber, we've been introducing Docker to give service owners more control over their environments. However, everything at Uber is moving very fast so we have had to do it a way such that Docker fitted into the existing infrastructure and services could be migrated seamlessly to Docker without any service interruptions. In this talk we will talk about the challenges we faced while doing this, such as handling both non-Docker and Docker builds, image replication, integration with our deployment systems and other challenges when deploying Docker at scale.

DockerCon EU 2015: Placing a container on a train at 200mph

Docker, Inc.

The slides from Steve Hoffman and Rick Fast's presentation at DockerCon SF 2015 - Talk Description: In this talk we will discuss how we enabled decomposition of one of our 250+ system components into a continously deployed microservice cluster. This includes building a standardized Docker server composed of various local companion services along side the Docker daemon including: dynamic service discovery via Consul, a log relay to a centralized Elasticsearch cluster, and forwarding/batching of Dropwizard metrics to Graphite. Building on this we'll cover our Jenkins driven automated pipeline for building Docker images and rolling deployments via Ansible using static placement on existing infrastructure while prototyping dynamic placement using Docker + Apache Mesos.

DockerCon SF 2015: Enabling Microservices @Orbitz

Docker, Inc.

Presented by Udo Seidel, Chief Architect and Digital Evangelist, Amadeus In the recent past there were quite some discussions about security in the context of introducing or using Docker. It is true that there are some gaps to be closed but the whole story does not start from square one either. At Amadeus we are using Docker to build our future-oriented services and to introduce devops culture. Due to the nature of our business we have to deal with Security certifications like PCI-DSS, SSAE 16 and ISO 27001. This talks described the challenges we were facing in that context and how we mastered them. The story has technical and non-technical aspects.

DockerCon EU 2015: Docker and PCI-DSS - Lessons learned in a security sensiti...

Docker, Inc.

Docker SF Meetup January 2016

Patrick Chanezon

Was ist angesagt? (20)

DCSF 19 Kubernetes and Container Storage Interface Update

Automated hardware testing using docker for space

DockerCon EU 2015: The Latest in Docker Engine

Configuration Management and Transforming Legacy Applications in the Enterpri...

DCSF19 Docker Containers & Java: What I Wish I Had Been Told

Docker?!?! But I'm a SysAdmin

Docker Meetup 08 03-2016

Production Ready Containers from IBM and Docker

Docker Platform Internals: Taking runtimes and image creation to the next lev...

Docker to the Rescue of an Ops Team

Docker on Docker

Building Your Docker Swarm Tech Stack

Docker for Ops - Scott Coulton, Puppet

Docker for developers on mac and windows

Global Operations with Docker for the Enterprise - Nico Kabar, Docker

DCSF 19 Data Center Networking with Containers

DockerCon EU 2015: Placing a container on a train at 200mph

DockerCon SF 2015: Enabling Microservices @Orbitz

DockerCon EU 2015: Docker and PCI-DSS - Lessons learned in a security sensiti...

Docker SF Meetup January 2016

Ähnlich wie DCSF19 CMD and Conquer: Containerizing the Monolith

With more than 14,000 customers in 110+ countries, Splunk is the market leader in analyzing machine data to deliver operational intelligence for security, IT and the business. Our rapid growth as a company meant that our Infrastructure Engineering Team, responsible for all the common tooling, build and test systems and frameworks utilized by the Splunk engineers, was bogged down with a sprawl of virtual machines and physical servers that were becoming incredibly difficult to manage. And as our customer’s demand for data has grown, testing at the scale of petabytes/day has become our new normal. We needed a reliable and scalable “Test Lab” for functional and performance testing. With Docker Enterprise Edition, our engineers are able to create small test stacks on their laptop just as easily as creating multi-petabyte stacks in our Test Lab. Support for Windows, Role Based Access Control and having support for both the orchestration platform and the container engine were key in deciding to go with Docker over other solutions. In this talk, we will cover the architecture, tooling, and frameworks we built to manage our workloads, which have grown to run on over 600 bare-metal servers, with tens of thousands of containers being created every day. We will share the lessons learned from running at scale. Lastly, we will demonstrate how we use Splunk to monitor and manage Docker Enterprise Edition.

Using Docker EE to Scale Operational Intelligence at Splunk

Docker, Inc.

What's New in Docker - February 2017

Patrick Chanezon

CAPS: What's best for deploying and managing OpenStack? Chef vs. Ansible vs. ...

Animesh Singh

Presentation at the OpenStack Summit in Tokyo, Japan on October 29, 2015. http://sched.co/49vI This talk will cover the pros and cons of four different OpenStack deployment mechanisms. Puppet, Chef, Ansible, and Salt for OpenStack all claim to make it much easier to configure and maintain hundreds of OpenStack deployment resources. With the advent of large-scale, highly available OpenStack deployments spread across multiple global regions, the choice of which deployment methodology to use has become more and more relevant. Beyond the initial day-one deployment, when it comes to the day-two and beyond questions of updating and upgrading existing OpenStack deployments, it becomes all the more important choose the right tool. Come join the Bluebox and IBM team to discuss the pros and cons of these approaches. We look at each of these four tools in depth, explore their design and function, and determine which scores higher than others to address your particular deployment needs. Daniel Krook - Senior Software Engineer, Cloud and Open Source Technologies, IBM Paul Czarkowski - Cloud Engineer at Blue Box, an IBM company Daniel Krook - Senior Software Engineer, Cloud and Open Source Technologies, IBM

CAPS: What's best for deploying and managing OpenStack? Chef vs. Ansible vs. ...

Daniel Krook

Running applications on Kubernetes can provide a lot of benefits: more dev speed, lower ops costs, and a higher elasticity & resiliency in production. Kubernetes is the place to be for cloud native apps. But what to do if you’ve no shiny new cloud native apps but a whole bunch of JEE legacy systems? No chance to leverage the advantages of Kubernetes? Yes you can! We’re facing the challenge of migrating hundreds of JEE legacy applications of a German blue chip company onto a Kubernetes cluster within one year. The talk will be about the lessons we've learned - the best practices and pitfalls we've discovered along our way.

Patterns and Pains of Migrating Legacy Applications to Kubernetes

Josef Adersberger

Open Source Summit 2018, Vancouver (Canada): Talk by Josef Adersberger (@adersberger, CTO at QAware), Michael Frank (Software Architect at QAware) and Robert Bichler (IT Project Manager at Allianz Germany) Abstract: Running applications on Kubernetes can provide a lot of benefits: more dev speed, lower ops costs and a higher elasticity & resiliency in production. Kubernetes is the place to be for cloud-native apps. But what to do if you’ve no shiny new cloud-native apps but a whole bunch of JEE legacy systems? No chance to leverage the advantages of Kubernetes? Yes you can! We’re facing the challenge of migrating hundreds of JEE legacy applications of a German blue chip company onto a Kubernetes cluster within one year. The talk will be about the lessons we've learned - the best practices and pitfalls we've discovered along our way.

Patterns and Pains of Migrating Legacy Applications to Kubernetes

QAware GmbH

Webinar : Docker in Production

Newt Global Consulting LLC

Cloud Native Dünyada CI/CD

Mustafa AKIN

The DevOps model is rapidly transforming IT operations and development practices. But what are the precursors necessary to implement DevOps? To achieve an agile, virtualized, and highly automated IT environment, what technological requirements need to be in place? OpenStack has the potential to facilitate DevOps implementation and practices at several different layers in the data center. In this session we'll quickly discuss what DevOps is, then discuss many components that are logically required to move towards DevOps in your environment. Finally we'll explore in depth several ways OpenStack can provide these baseline components. Watch the DevNet 1104 replay from the Cisco Live On-Demand Library at: https://www.ciscolive.com/online/connect/sessionDetail.ww?SESSION_ID=92695&backBtn=true Check out more and register for Cisco DevNet: http://ow.ly/jCNV3030OfS

OpenStack Enabling DevOps

Cisco DevNet

What's new in Docker - InfraKit - Docker Meetup Berlin 2016

Patrick Chanezon

DockerCon 15 Keynote - Day 2

Docker, Inc.

Cont0519

Samuel Dratwa

Docker is the developer-friendly container technology that enables creation of your application stack: OS, JVM, app server, app, database and all your custom configuration. So you are a Java developer but how comfortable are you and your team taking Docker from development to production? Are you hearing developers say, “But it works on my machine!” when code breaks in production? And if you are, how many hours are then spent standing up an accurate test environment to research and fix the bug that caused the problem? This workshop/session explains how to package, deploy, and scale Java applications using Docker.

Devoxx 2016 - Docker Nuts and Bolts

Patrick Chanezon

Solum - OpenStack PaaS / ALM

devkulkarni

Docker containers add portability but can also introduce complexity into your environment. In this session learn about why monitoring your container environment is essential to maintaining service reliability, and how Splunk software can help you monitor different layers of infrastructure running in a Docker environment, including third-party tools, instances, and custom code. Learn how to use Splunk software to collect, search and correlate container data with other infrastructure data for better service context, root cause monitoring and reporting. Additionally, receive introduction to the product integrations between Splunk and Docker such as the Splunk Logging Driver, Splunk Forwarder, and Splunk Logging Libraries.

Take an Analytics-driven Approach to Container Performance with Splunk for Co...

Docker, Inc.

At National Instruments, we have developed an automation and provisioning framework called PIE (Programmable Infrastructure Environment) that we use daily on our devops team. Similar tools are available such as chef or puppet, but what makes PIE unique is its ability to work in multi-cloud deployments (Azure and AWS) along with multiple node OS types (linux and windows). It uses zookeeper to keep state and track dependencies across nodes and services. When building PIE we actively considered how to implement it in a Rugged way for a DevOps team. As noted in the deck on slide 68, we are Rugged by Design and Devops by Culture. We see these as intersecting domains that have the ability to impact each other. For more info see ruggeddevops.org

Coding Secure Infrastructure in the Cloud using the PIE framework

James Wickett

The migration to cloud-based data architectures continues at a rapid pace, including databases and data management. Oracle databases are part of this trend, and during this webinar you will learn how to automate the provisioning and management of Oracle databases so that you can deliver an “as-a-service” experience with 1-click simplicity. Experts will walk you through the process of: · Using Kubernetes to deliver a production-ready solution for your Oracle-based applications · Turbocharging your data infrastructure using cloud-native architecture · Improving the agility and efficiency of your BI and Data Operation teams, Developers, and Data Scientists · Defining the business impact and benefits of cloud-based Oracle solutions

Webinar: Emerging Trends in Data Architecture – What’s the Next Big Thing?

DATAVERSITY

Docker {at,with} SignalFx

Maxime Petazzoni

Docker at and with SignalFx

SignalFx

While GitOps is known as a paradigm for managing cloud native applications, not many know it fits within platform management as well. Automating the provisioning and management of Kubernetes clusters abstracts away the issue of inconsistency that you get with cluster sprawl, all while shortening provisioning time by consistent automation. But that’s not enough. A networking layer is a standard requirement when managing Kubernetes environments, yet traditional IT networking and security methods do not work. By default, Kubernetes environments allow any pod to connect to any other pod, creating security risks. Furthermore, legacy approaches to network security visibility do not allow for performance of threat detection, compliance monitoring, or incident investigations for Kubernetes workloads. Cilium is a zero-trust cloud-native networking layer providing the necessary security and observability of your Kubernetes environments. What if you were to add your network and security operations into your GitOps workflows? In our webinar with Isovalent, we walk through how to easily add Cilium as a robust Container Network Interface solution using GitOps, and explore some of the Observability and Security features it provides. You'll learn how: - GitOps helps you manage cloud native chaos - To save time creating secure, “user-ready” Kubernetes clusters - To apply Weave GitOps to Kubernetes platform management - To improve network security and network observability using Cilium

Robust Network Security and Observability with GitOps and Cilium

Weaveworks

Ähnlich wie DCSF19 CMD and Conquer: Containerizing the Monolith (20)

Using Docker EE to Scale Operational Intelligence at Splunk

What's New in Docker - February 2017

CAPS: What's best for deploying and managing OpenStack? Chef vs. Ansible vs. ...

Patterns and Pains of Migrating Legacy Applications to Kubernetes

Webinar : Docker in Production

Cloud Native Dünyada CI/CD

OpenStack Enabling DevOps

What's new in Docker - InfraKit - Docker Meetup Berlin 2016

DockerCon 15 Keynote - Day 2

Cont0519

Devoxx 2016 - Docker Nuts and Bolts

Solum - OpenStack PaaS / ALM

Take an Analytics-driven Approach to Container Performance with Splunk for Co...

Coding Secure Infrastructure in the Cloud using the PIE framework

Webinar: Emerging Trends in Data Architecture – What’s the Next Big Thing?

Docker {at,with} SignalFx

Docker at and with SignalFx

Robust Network Security and Observability with GitOps and Cilium

Mehr von Docker, Inc.

Raymond Arifianto, AccelByte and Mark Mandel, Google - We have been deploying containerized micro-services for our Game Backend Services for a while. Now we are tackling the challenge to scale up fleets of game dedicated servers in multiple regions, multiple data centers and multiple providers - some in bare metal, some in Cloud. So we leverage docker containerization to deploy Game Servers to achieve Portability, Fast Deployment and Predictability, enabling us to scale up to thousands of servers, on demand, without a sweat.

Containerize Your Game Server for the Best Multiplayer Experience

Docker, Inc.

Nicholas Dille, Haufe-Lexware + Docker Captain - Docker continues to be the standard tool for building container images. For more than a year Docker ships with BuildKit as an alternative image builder, providing advanced features for secret and cache management. These features help to make image builds faster and more secure. In this session, Docker Captain Nicholas Dille will teach you how to use Buildkit features to your advantage.

How to Improve Your Image Builds Using Advance Docker Build

Docker, Inc.

Lukonde Mwila, Entelect - As the cloud-native approach to development and deployment becomes more prevalent, it's an exciting time for software engineers to be equipped on how to dockerize multi-container applications and deploy them to the cloud. In this talk, Lukonde Mwila, Software Engineer at Entelect, will cover the following topics: - Docker Compose - Containerizing an Nginx Server - Containerizing an React App - Containerizing an Node.JS App - Containerizing anMongoDB App - Runing Multi-Container App Locally - Creating a CI/CD Pipeline - Adding a build stage to test containers and push images to Docker Hub - Deploying Multi-Container App to AWS Elastic Beanstalk Lukonde will start by giving an overview of how Docker Compose works and how it makes it very easy and straightforward to startup multiple Docker containers at the same time and automatically connect them together with some form of networking. After that, Lukonde will take a hands on approach to containerize an Nginx server, a React app, a NodeJS app and a MongoDB instance to demonstrate the power of Docker Compose. He'll demonstrate usage of two Docker files for an application, one production grade and the other for local development and running of tests. Lastly, he'll demonstrate creating a CI/CD pipeline in AWS to build and test our Docker images before pushing them to Docker Hub or AWS ECR, and finally deploying our multi-container application AWS Elastic Beanstalk.

Build & Deploy Multi-Container Applications to AWS

Docker, Inc.

Kevin Jones, NGNIX - NGINX is one of the most popular images on Docker Hub and has been at the forefront of the web since the early 2000's. In this talk we will discuss how and why NGINX's lightweight and powerful architecture makes it a very popular choice for securing containerized applications as a sidecar reverse proxy within containers. We will highlight important aspects of application security that NGINX can help with, such as TLS, HTTP, AuthN, AuthZ and traffic control.

Securing Your Containerized Applications with NGINX

Docker, Inc.

Kathleen Juell, Digital Ocean - Containers are an essential part of today's microservice ecosystem, as they allow developers and operators to maintain standards of reliability and reproducibility in fast-paced deployment scenarios. And while there are best practices that extend across stacks in containerized environments, there are also things that make each stack distinct, starting with the application image itself. This talk will dive into some of these particularities, both at the image and service level, while also covering general best practices for building and running Node applications with database backends using Docker and Compose.

How To Build and Run Node Apps with Docker and Compose

Docker, Inc.

Hands-on Helm

Docker, Inc.

Jeff Hajewski, Salesforce - There is a wealth of information on building deep learning models with PyTorch or TensorFlow. Anyone interested in building a deep learning model is only a quick search away from a number of clear and well written tutorials that will take them from zero knowledge to having a working image classifier. But what happens when you need to deploy these models in a production setting? At Salesforce, we use TensorFlow models to help us provide customers with insights into their data, and we do this as close to real-time as possible. Designing these systems in a scalable manner requires overcoming a number of design challenges, but the core component is Docker. Docker enables us to design highly scalable systems by allowing us to focus on service interactions, rather than how our services will interact with the hardware. Docker is also at the core of our test infrastructure, allowing developers and data scientists to build and test the system in an end to end manner on their local machines. While some of this may sound complex, the core message is simplicity - Docker allows us to focus on the aspects of the system that matter, greatly simplifying our lives.

Distributed Deep Learning with Docker at Salesforce

Docker, Inc.

James Fuller, webcomposite s.r.o. - Curl is the venerable (yet very modern) 'swiss army knife' command line tool and library for transferring data with URLs. Recently we (the Curl team) decided to build a release for Docker Hub. This talk will outline our current development workflow with respect to the docker image and provide insights on what it takes to build a docker image for mass public consumption. We are also keen to learn from users and other developers how we might improve and enhance the official curl docker image.

The First 10M Pulls: Building The Official Curl Image for Docker Hub

Docker, Inc.

Fabian Stäber, Instana - In recent years, we saw a great paradigm shift in software engineering away from static monolithic applications towards dynamic distributed horizontally scalable architectures. Docker is one of the key technologies enabling this development. This shift poses a lot of new challenges for application monitoring, ranging from practical issues (need for automation) to technical challenges (Docker networking) to organizational topics (blurring line between software engineers and operations) to fundamental questions (define what is an application). In this talk we show how Docker changed the way we do monitoring, how modern application monitoring systems work, and what future developments we expect.

Monitoring in a Microservices World

Docker, Inc.

Clemente Biondo, Engineering Ingegneria Informatica - When the COVID 19 pandemic started, Engineering Ingegneria Informatica Group (1.25 billion euros of revenues, 65 offices around the world, 12.000 employees) was forced to put their digital transformation to the test in order to maintain operational continuity. In this session, Clemente Biondo, the Tech Lead of the Information Systems Department, will share how his company is reacting to this unforeseeable scenario and how Docker-driven digital transformation had paved the path for work to continue remotely. Clemente will discuss learnings moving from colocated teams, manual approaches, email based-business processes, and a monolithic application to a mature DevOps culture characterized by a distributed autonomous workforce and a continuous deployment process that deploys backward-compatible Docker containerized microservices into hybrid multi cloud datacenters an average of twice a day with zero-downtime. He will detail how they use Docker to unify dev, test and production environments, and as an efficient and automated mechanism for deploying applications. Lastly, Clemente shares how, in our darkest hour, he and others are working to shine their brightest light.

COVID-19 in Italy: How Docker is Helping the Biggest Italian IT Company Conti...

Docker, Inc.

Chris Lauer, NOAA Space Weather Prediction Center - This is the story of how adopting a containerized workflow changed the way our small software team works at NOAA’s Space Weather Prediction Center. Our old architecture, a big ball of mud shared-database integration, just wasn’t cutting it - it was killing our agility. Over the past two years, our small team has adopted a microservice style architecture, using Docker with docker-compose and environment files as our deployment strategy for all new development. We’ve discovered the joys of using containers for identical dev, staging, and production environments. We work closely with scientists: much of the code we’re running has complicated and conflicting library dependencies. Docker captures these beautifully - we’ve even had some success teaching our scientists to use it! I’ll share what we’ve learned, some of the persistent challenges we face, and one place we really got it wrong. This talk builds off of a popular hallway track from DockerCon 2019.

Predicting Space Weather with Docker

Docker, Inc.

Brian Christner, 56k + Docker Captain - In this session, we will unlock the full potential of using Microsoft Visual Studio Code (VS Code) and Docker Desktop to turn you into a Docker Power User. When we expand and utilize the VS Code Docker plugin, we can take our projects and Docker skills to the next level. In addition to using VS Code, we streamline our Docker Desktop development workflow with less context switching and built-in shortcuts. You will learn how to bootstrap new projects, quickly write Dockerfiles utilizing templates, build, run, and interact with containers all from VS Code.

Become a Docker Power User With Microsoft Visual Studio Code

Docker, Inc.

How to Use Mirroring and Caching to Optimize your Container Registry

Docker, Inc.

Ashish Sharma, SS&C Eze - SS&C Eze provides various products in the stock market domain. We spent the last couple of years building Eclipse which is an investment suite born in cloud. The journey so far has been very interesting. The very first version of the product were a bunch of monolithic windows services and deployed using Octopus tool. We successfully managed to bring all the monolithic problem to the cloud and created a nightmare for ourselves. We then started applying microservices architecture principles and started breaking the monolithic into small services. Very soon we realized that we need a better packaging/deployment tool. Docker looked like a magical solution to our problem. Since its adoption, It has not only solved the deployment problem for us but has made a deep impact on different aspects of SDLC. It allowed us to use heterogeneous technology stacks, simplified development environment setup, simplified our testing strategy, improved our speed of delivery, and made our developers more productive. In this talk I would like to share our experience of using Docker and its positive impact on our SDLC.

Monolithic to Microservices + Docker = SDLC on Steroids!

Docker, Inc.

Ara Pulido, Datadog - Container technologies, although not new, have increased their popularity in the past few years, with container orchestrators allowing companies around the world to adopt these technologies to help them ship and scale microservices with precision and velocity. Kubernetes is currently the most popular container orchestration platform, and while many organizations are migrating their workloads to it, Kubernetes is still relatively immature. New corner cases, errors, and quirks are regularly discovered as users push the boundaries of size and scale. When Datadog adopted Kubernetes we discovered some of these boundaries the hard way, and we continuously challenge and modify our infrastructure decisions in order to fit our use case. Join me in this talk for our story on what we learned while we scaled our Kubernetes clusters, the contributions to Kubernetes we made along the way, and how you can apply those learnings when growing your Kubernetes clusters from a handful to hundreds or thousands of nodes.

Kubernetes at Datadog Scale

Docker, Inc.

Andy Clemenko, StackRox - One underutilized, and amazing, thing about the docker image scheme is labels. Labels are a built in way to document all aspects about the image itself. Think about all the information that the tags inside your clothing carry. If you care to look you can find out everything about the garment. All that information can be very valuable. Now think about how we can leverage labels to carry similar information. We can even use the labels to contain Docker Compose or even Kubernetes Yaml. We can even include labels into the CI/CD process making things more secure and smoother. Come find out some fun techniques on how to leverage labels to do some fun and amazing things.

Labels, Labels, Labels

Docker, Inc.

Patrick Deloulay, Micro Focus - Micro Focus started their digital transformation 3 years ago, moving the entire portfolio into hundreds of container images. Leveraging Docker Hub as our primary registry service, we will cover how we ended up building a simple but secure push/pull model to publish and deliver our premium assets to our customers and partners to both meet the high agility of our DevOps teams while greatly simplifying the deployment of our applications.

Using Docker Hub at Scale to Support Micro Focus' Delivery and Deployment Model

Docker, Inc.

Lukonde Mwila, Entelect As the cloud-native approach to development and deployment becomes more prevalent, it's an exciting time for software engineers to be equipped on how to dockerize multi-container applications and deploy them to the cloud. In this talk, Lukonde Mwila, Software Engineer at Entelect, will cover the following topics: - Docker Compose - Containerizing an Nginx Server - Containerizing an React App - Containerizing an Node.JS App - Containerizing anMongoDB App - Runing Multi-Container App Locally - Creating a CI/CD Pipeline - Adding a build stage to test containers and push images to Docker Hub - Deploying Multi-Container App to AWS Elastic Beanstalk Lukonde will start by giving an overview of how Docker Compose works and how it makes it very easy and straightforward to startup multiple Docker containers at the same time and automatically connect them together with some form of networking. After that, Lukonde will take a hands on approach to containerize an Nginx server, a React app, a NodeJS app and a MongoDB instance to demonstrate the power of Docker Compose. He'll demonstrate usage of two Docker files for an application, one production grade and the other for local development and running of tests. Lastly, he'll demonstrate creating a CI/CD pipeline in AWS to build and test our Docker images before pushing them to Docker Hub or AWS ECR, and finally deploying our multi-container application AWS Elastic Beanstalk.

Build & Deploy Multi-Container Applications to AWS

Docker, Inc.

Elton Stoneman, Docker Captain + Container Consultant and Trainer How do you provide a SaaS offering when your product is a 10-year old Fortran app, currently built to run on Windows 10? With Docker and Kubernetes of course - and you can do it in a week (... to prototype level at least). In this session I'll walk through the processes and practicalities of taking an older Windows app, making it run in containers with Kubernetes, and then building a simple API wrapper to host the whole stack as a cloud-based SaaS product. There's a lot of technology here from a real world case study, and I'll focus on: - running Windows apps in Docker containers - building a .NET Core API which can run in Linux or Windows containers - running the stack in Kubernetes with Docker Desktop locally and AKS in the cloud - configuring AKS workloads in Azure to burst out to Azure Container Instances And there's a core theme to this session: Docker and Kubernetes are complex technologies, but they're the key to modern development. If you invest time learning them, they make projects like this simple, portable, fast and fun.

From Fortran on the Desktop to Kubernetes in the Cloud: A Windows Migration S...

Docker, Inc.

This virtual meetup introduces the concepts and best practices of using Docker containers for software development for the Arm architecture across a variety of hardware systems. Using Docker Desktop on Windows or Mac, Amazon Web Services (AWS) A1 instances, and embedded Linux, we will demonstrate the latest Docker features to build, share, and run multi-architecture images with transparent support for Arm.

Developing with Docker for the Arm Architecture

Docker, Inc.

Mehr von Docker, Inc. (20)

Containerize Your Game Server for the Best Multiplayer Experience

How to Improve Your Image Builds Using Advance Docker Build

Build & Deploy Multi-Container Applications to AWS

Securing Your Containerized Applications with NGINX

How To Build and Run Node Apps with Docker and Compose

Hands-on Helm

Distributed Deep Learning with Docker at Salesforce

The First 10M Pulls: Building The Official Curl Image for Docker Hub

Monitoring in a Microservices World

COVID-19 in Italy: How Docker is Helping the Biggest Italian IT Company Conti...

Predicting Space Weather with Docker

Become a Docker Power User With Microsoft Visual Studio Code

How to Use Mirroring and Caching to Optimize your Container Registry

Monolithic to Microservices + Docker = SDLC on Steroids!

Kubernetes at Datadog Scale

Labels, Labels, Labels

Using Docker Hub at Scale to Support Micro Focus' Delivery and Deployment Model

Build & Deploy Multi-Container Applications to AWS

From Fortran on the Desktop to Kubernetes in the Cloud: A Windows Migration S...

Developing with Docker for the Arm Architecture

Kürzlich hochgeladen

Imagine a world where information flows as swiftly as thought itself, making decision-making as fluid as the data driving it. Every moment is critical, and the right tools can significantly boost your organization’s performance. The power of real-time data automation through FME can turn this vision into reality. Aimed at professionals eager to leverage real-time data for enhanced decision-making and efficiency, this webinar will cover the essentials of real-time data and its significance. We’ll explore: FME’s role in real-time event processing, from data intake and analysis to transformation and reporting An overview of leveraging streams vs. automations FME’s impact across various industries highlighted by real-life case studies Live demonstrations on setting up FME workflows for real-time data Practical advice on getting started, best practices, and tips for effective implementation Join us to enhance your skills in real-time data automation with FME, and take your operational capabilities to the next level.

From Event to Action: Accelerate Your Decision Making with Real-Time Automation

Safe Software

Building Digital Trust in a Digital Economy Veronica Tan, Director - Cyber Security Agency of Singapore Apidays Singapore 2024: Connecting Customers, Business and Technology (April 17 & 18, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

apidays

presentation ICT roal in 21st century education

jfdjdjcjdnsjd

A Domino Admins Adventures (Engage 2024)

Gabriella Davis

Three things you will take away from the session: • How to run an effective tenant-to-tenant migration • Best practices for before, during, and after migration • Tips for using migration as a springboard to prepare for Copilot in Microsoft 365 Main ideas: Migration Overview: The presentation covers the current reality of cross-tenant migrations, the triggers, phases, best practices, and benefits of a successful tenant migration Considerations: When considering a migration, it is important to consider the migration scope, performance, customization, flexibility, user-friendly interface, automation, monitoring, support, training, scalability, data integrity, data security, cost, and licensing structure Next Wave: The next wave of change includes the launch of Copilot, which requires businesses to be prepared for upcoming changes related to Copilot and the cloud, and to consolidate data and tighten governance ShareGate: ShareGate can help with pre-migration analysis, configurable migration tool, and automated, end-user driven collaborative governance

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

sammart93

Strategies for Landing an Oracle DBA Job as a Fresher

Remote DBA Services

As privacy and data protection regulations evolve rapidly, organizations operating in multiple jurisdictions face mounting challenges to ensure compliance and safeguard customer data. With state-specific privacy laws coming up in multiple states this year, it is essential to understand what their unique data protection regulations will require clearly. How will data privacy evolve in the US in 2024? How to stay compliant? Our panellists will guide you through the intricacies of these states' specific data privacy laws, clarifying complex legal frameworks and compliance requirements. This webinar will review: - The essential aspects of each state's privacy landscape and the latest updates - Common compliance challenges faced by organizations operating in multiple states and best practices to achieve regulatory adherence - Valuable insights into potential changes to existing regulations and prepare your organization for the evolving landscape

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

TrustArc

Webinar Recording: https://www.panagenda.com/webinars/why-teams-call-analytics-is-critical-to-your-entire-business Nothing is as frustrating and noticeable as being in an important call and being unable to see or hear the other person. Not surprising then, that issues with Teams calls are among the most common problems users call their helpdesk for. Having in depth insight into everything relevant going on at the user’s device, local network, ISP and Microsoft itself during the call is crucial for good Microsoft Teams Call quality support. To ensure a quick and adequate solution and to ensure your users get the most out of their Microsoft 365. But did you know that ‘bad calls’ are also an excellent indicator of other problems arising? Precisely because it is so noticeable!? Like the canary in the mine, bad calls can be early indicators of problems. Problems that might otherwise not have been noticed for a while but can have a big impact on productivity and satisfaction. Join this session by Christoph Adler to learn how true Microsoft Teams call quality analytics helped other organizations troubleshoot bad calls and identify and fix problems that impacted Teams calls or the use of Microsoft365 in general. See what it can do to keep your users happy and productive! In this session we will cover - Why CQD data alone is not enough to troubleshoot call problems - The importance of attributing call problems to the right call participant - What call quality analytics can do to help you quickly find, fix-, and prevent problems - Why having retrospective detailed insights matters - Real life examples of how others have used Microsoft Teams call quality monitoring to problem shoot problems with their ISP, network, device health and more.

Why Teams call analytics are critical to your entire business

panagenda

The 7 Things I Know About Cyber Security After 25 Years | April 2024

Rafal Los

Automating Google Workspace (GWS) & more with Apps Script

wesley chun

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

The Digital Insurer

MySQL Webinar, presented on the 25th of April, 2024. Summary: MySQL solutions enable the deployment of diverse Database Architectures tailored to specific needs, including High Availability, Disaster Recovery, and Read Scale-Out. With MySQL Shell's AdminAPI, administrators can seamlessly set up, manage, and monitor these solutions, ensuring efficiency and ease of use in their administration. MySQL Router, on the other hand, provides transparent routing from the application traffic to the backend servers in the architectures, requiring minimal configuration. Completely built in-house and supported by Oracle, these solutions have been adopted by enterprises of all sizes for their business-critical applications. In this presentation, we'll delve into various database architecture solutions to help you choose the right one based on your business requirements. Focusing on technical details and the latest features to maximize the potential of these solutions.

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Miguel Araújo

Data Cloud, More than a CDP by Matt Robison

Anna Loughnan Colquhoun

The value of a flexible API Management solution for Open Banking Steve Melan, Manager for IT Innovation and Architecture - State's and Saving's Bank of Luxembourg Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The value of a flexible API Management solution for O...

apidays

Top 10 Most Downloaded Games on Play Store in 2024

SynarionITSolutions

A Principled Technologies deployment guide Conclusion Deploying VMware Cloud Foundation 5.1 on next gen Dell PowerEdge servers brings together critical virtualization capabilities and high-performing hardware infrastructure. Relying on our hands-on experience, this deployment guide offers a comprehensive roadmap that can guide your organization through the seamless integration of advanced VMware cloud solutions with the performance and reliability of Dell PowerEdge servers. In addition to the deployment efficiency, the Cloud Foundation 5.1 and PowerEdge solution delivered strong performance while running a MySQL database workload. By leveraging VMware Cloud Foundation 5.1 and PowerEdge servers, you could help your organization embrace cloud computing with confidence, potentially unlocking a new level of agility, scalability, and efficiency in your data center operations.

Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...

Principled Technologies

In this session, we will delve into strategic approaches for optimizing knowledge management within Microsoft 365, amidst the evolving landscape of Copilot. From leveraging automatic metadata classification and permission governance with SharePoint Premium, to unlocking Viva Engage for the cultivation of knowledge and communities, you will gain actionable insights to bolster your organization's knowledge-sharing initiatives. In this session, we will also explore how to facilitate solutions to enable your employees to find answers and expertise within Microsoft 365. You will leave equipped with practical techniques and a deeper understanding of how there is more to effective knowledge management than just enabling Copilot, but building actual solutions to prepare the knowledge that Copilot and your employees can use.

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Drew Madelung

Effective data discovery is crucial for maintaining compliance and mitigating risks in today's rapidly evolving privacy landscape. However, traditional manual approaches often struggle to keep pace with the growing volume and complexity of data. Join us for an insightful webinar where industry leaders from TrustArc and Privya will share their expertise on leveraging AI-powered solutions to revolutionize data discovery. You'll learn how to: - Effortlessly maintain a comprehensive, up-to-date data inventory - Harness code scanning insights to gain complete visibility into data flows leveraging the advantages of code scanning over DB scanning - Simplify compliance by leveraging Privya's integration with TrustArc - Implement proven strategies to mitigate third-party risks Our panel of experts will discuss real-world case studies and share practical strategies for overcoming common data discovery challenges. They'll also explore the latest trends and innovations in AI-driven data management, and how these technologies can help organizations stay ahead of the curve in an ever-changing privacy landscape.

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Neo4j

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

The Digital Insurer

Kürzlich hochgeladen (20)

From Event to Action: Accelerate Your Decision Making with Real-Time Automation

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

presentation ICT roal in 21st century education

A Domino Admins Adventures (Engage 2024)

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

Strategies for Landing an Oracle DBA Job as a Fresher

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

Why Teams call analytics are critical to your entire business

The 7 Things I Know About Cyber Security After 25 Years | April 2024

Automating Google Workspace (GWS) & more with Apps Script

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Data Cloud, More than a CDP by Matt Robison

Apidays New York 2024 - The value of a flexible API Management solution for O...

Top 10 Most Downloaded Games on Play Store in 2024

Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

DCSF19 CMD and Conquer: Containerizing the Monolith

1. CMD and Conquer PACKAGING THE MONOLITH

2. Software Engineer, Splunk Tony Lee Senior Software Engineer, Splunk Nelson Wang

3. Why? What? How? Next? Agenda

6. https://mpora.com/mountaineering-expeditions/famous-explorers-history-introduction

7. Time Intensive Disruptive Expensive $ monolith | microservice

9. Our Journey

10. Taking the First Step

11.

12. APPLICATION REQUIREMENTS SCHEDULER REQUIREMENTS ACCESSIBILITY ADAPTABILITY AUTONOMY FAULT TOLERANCY SCALABILITYSTATELESS

13. BASE PLATFORM LAYER SPLUNK LAYER FORWARDER LAYER

14. BASE PLATFORM LAYER As Splunk evolves and develops, the image should grow with it

15. • Add file/directory monitoring • Open a TCP/UDP socket & listen for input • Enable receiving of syslog data • Setup HTTP event collection token • Forward data to another service • Setup administrator password • Create user accounts for access control • Install an enterprise license • Connect to an existing license master • Setup indexes • Touch configuration files • Install apps • etc. Usability

16. • Asynchronous dynamic provisioning performed by Ansible • Eliminate reliance on any third-party service registrar/catalog • Parallelized setup removed ordered dependencies and results in faster time-to-value Micro-Orchestration Layer entrypoint.sh Dockerfile

17. Why Ansible? Domain-specific, developer-friendly language that enables the dynamic configurability

18. APPLICATION REQUIREMENTS SCHEDULER REQUIREMENTS ACCESSIBILITY ADAPTABILITY AUTONOMY FAULT TOLERANCY SCALABILITYSTATELESS

19. • Intermittent service interruption is expected within configuration layer • Health-checks and probes to assist in lifecycle management Fault Tolerance

20. • Orchestration engine administers the pods/containers • Application-context is shared amongst cluster members via environment variables Distribution of State SPLUNK DEPLOYMENT Container Indexer 2 Container Indexer 1 Container Cluster Master Container Search Head

21. SPLUNK DEPLOYMENT Container Indexer 2 Container Indexer 1 Container Cluster Master Container Search Head

22. SPLUNK DEPLOYMENT Container Indexer 2 Container Indexer 1 Container Cluster Master Container Search Head

23. SPLUNK DEPLOYMENT Container Indexer 2 Container Indexer 1 Container Cluster Master Container Search Head

24. SPLUNK DEPLOYMENT Container Indexer 2 Container Indexer 1 Container Cluster Master Container Search Head

25. SPLUNK DEPLOYMENT Container Indexer 2 Container Indexer 1 Container Cluster Master Container Search Head

26. Dynamic scaling of specific roles How do I add a new indexer? Scalability SPLUNK DEPLOYMENT Container Cluster Master Container Search Head 1 Container Indexer 2 Container Indexer 1 Container Indexer 3

27.

28. Our Results

29. External Usage • Customers have been waiting to run Splunk on Docker! • Adoption amongst many members of the open-source community • Examples for both swarm + k8s manifests in our GitHub repo

30.

31. Internal Usage Support • Cheap, reproducible environments • Support any size topology, any version Open-source images are fed back into our internal deployment provisioning service (orca) used across the company Sales • Rapid, reliable demo instances on-demand • Support for local scenarios for the field Dev/QA • Disposability around testing changes • Accelerates iteration cycles in CI/CD

32. How? orca leverages Docker Enterprise and Universal Control Plane (UCP) Node Worker Node Worker Node Worker Node Worker swarm mode cluster Node Worker Node Worker Dev/QA/Sales Team Using Swarm/K8s Support Team using Swarm/K8s Ops Team DOCKER ENTERPRISE EDITION

33. ORCA

34.

35. Image CI/CD • Support for multiple platforms • Integrated security scanning • Functional tests for various configurations and topologies • Version control, custom dependencies for individual teams

36. Pipeline GitHub IBM s390x Agent $ build splunk- debian Linux Agent $ build splunk- debian Linux Agent $ push splunk-debian DockerHub Public/Open-source Internal

37. The Future • Deployment frameworks (helm, operators) • Find ways to make Splunk more accessible and reduce time-to- value • Always consider the future of the monolith!

38. Summary • Find ways to bridge the gap while migrating monolithic software to microservice architecture • Plan for the future • Dynamic self-orchestration made our software offering more nimble.

39. Get Hands On! Repositories • https://github.com/splunk/docker-splunk • https://github.com/splunk/splunk-ansible Documentation • https://splunk.github.io/docker-splunk • https://splunk.github.io/splunk-ansible #docker @ http://splunk-usergroups.slack.com/

40. Thank you! Questions?

DCSF19 CMD and Conquer: Containerizing the Monolith

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

Ähnlich wie DCSF19 CMD and Conquer: Containerizing the Monolith

Ähnlich wie DCSF19 CMD and Conquer: Containerizing the Monolith (20)

Mehr von Docker, Inc.

Mehr von Docker, Inc. (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

DCSF19 CMD and Conquer: Containerizing the Monolith