SlideShare ist ein Scribd-Unternehmen logo
1 von 40
Downloaden Sie, um offline zu lesen
1 Confidential and Proprietary. © 2020 Anaconda
Elevating your Python & R, AI & ML Strategy
Anaconda Team Edition, Constructor, Conda-Pack, Docker
December 2, 2020
2 Confidential and Proprietary. © 2020 Anaconda
Agenda
● The conda package & environment management system
● Anaconda Team Edition: an enterprise AI / ML package repository
○ The importance of curated CVEs for security
● Managing conda environments for collaboration & distribution
● Tools for distributing conda environments:
○ Constructor & Conda-Pack
● Docker, conda, & OpenShift: a brief look
3 Confidential and Proprietary. © 2020 Anaconda
A brief look at Conda
4 Confidential and Proprietary. © 2020 Anaconda
The conda package format
● Cross-platform
○ Windows, Mac, Linux (x86/ARM/PPC), z/OS
● Cross-language
○ Python, R, Rust, Go…
● Rich metadata
○ License information facilitates governance
○ Dependency graph ensures package compatibility and environment correctness
● Binary package format
○ Packages are precompiled
○ Dynamic linking reduces vendoring (improving governance) and ensures cross-compatibility
5 Confidential and Proprietary. © 2020 Anaconda
Anaconda Team Edition
6 Confidential and Proprietary. © 2020 Anaconda
Team Edition - CVE Curation Process
The National Institute of
Standards and
Technology(NIST) National
Vulnerability Database
(NVD)
CVE Data Source.
Associating NVD CVE data
with packages in the
Anaconda Repository
Automated Matching.
Anaconda staff review NVD
CVE data for accuracy and
then categorize, refine and
improve the reported
information. In some cases,
CVEs are patched
Human Curation.
Accurate CVE metadata
allows organizations to
filter out OSS packages
that don’t meet their
security requirements
Refined CVE Metadata.
Goal: high-quality, accurate, and dependable CVE information
Performed by Anaconda Distribution Team
7 Confidential and Proprietary. © 2020 Anaconda
Team Edition - CVE Curation Example
8 Confidential and Proprietary. © 2020 Anaconda
Environment Management
Distributing packages ready to use
9 Confidential and Proprietary. © 2020 Anaconda
Why standardize environments?
● Reduces support burden
○ Encourages use of mature, stable, widely adopted packages
● Encourages collaboration
○ Everyone is using a common package set
○ Common tool choices make it easier for people to help each other
● Ensures portability and deployability
○ Cross-platform (Windows -> Linux) more feasible
○ Potentially tighter requirements for production than development
● All that said: allowing customization is important
10 Confidential and Proprietary. © 2020 Anaconda
Environment types
● Standard Python 3.x
● Python 2.x (for legacy applications only?)
● R (with/without Python?)
● GPU-enabled
11 Confidential and Proprietary. © 2020 Anaconda
Environment destinations
● Desktops
● Edge nodes
● JupyterHub
● Anaconda Enterprise
● Third-party platforms (Domino, Cloudera DSW)
● Clusters: Spark, Dask, HPC/GPU
● Containerized applications: Docker, Kubernetes, OpenShift
● ???
12 Confidential and Proprietary. © 2020 Anaconda
Specification rendering
● Layer 1: Global environment specifications
○ Minimal version pinning (e.g., Python / Scikit-Learn / NumPy / Pandas / Tensorflow / CUDA)
○ Objective: general major version decisionmaking
○ No platform-specific exceptions, except for package omissions on certain platforms
● Layer 2: Precise pinning of top-level specifications
○ Find a common set of precise version pins for Layer 1 specs only
○ Objective: cross platform compatibility
○ Platform-specific exceptions included as needed
● Layer 3: Fully realized specifications
○ All packages & dependencies identified and versioned down to the build
13 Confidential and Proprietary. © 2020 Anaconda
Specification rendering: Example
Minimal pinning
python 3.6
scikit-learn 0.22
numpy 1.18
pandas 1.0
tensorflow >1.10,<2
notebook
Full top-level pinning
python 3.6.10
scikit-learn 0.22.1
numpy 1.18.1
pandas 1.0.3
tensorflow 1.13.2
notebook 6.0.3
Final specification ready for rendering
absl-py-0.9.0-py36_0 appnope-0.1.0-py36hf537a9a_0 astor-0.8.0-py36_0 attrs-19.3.0-py_0 backcall-0.1.0-py36_0 blas-1.0-mkl bleach-3.1.4-py_0 c-ares-1.15.0-h1de35cc_1001
ca-certificates-2020.1.1-0 certifi-2020.4.5.1-py36_0 dbus-1.13.14-h517e14e_0 decorator-4.4.2-py_0 defusedxml-0.6.0-py_0 entrypoints-0.3-py36_0 expat-2.2.6-h0a44026_0
gast-0.3.3-py_0 gettext-0.19.8.1-hb0f4f8b_2 glib-2.63.1-h70d4741_1 grpcio-1.16.1-py36h044775b_1 h5py-2.10.0-py36h3134771_0 hdf5-1.10.4-hfa1e0ec_0 icu-58.2-h0a44026_3
importlib-metadata-1.6.0-py36_0 importlib_metadata-1.6.0-0 intel-openmp-2019.4-233 ipykernel-5.1.4-py36h39e3cac_0 ipython-7.13.0-py36h5ca1d4c_0
ipython_genutils-0.2.0-py36_0 ipywidgets-7.5.1-py_0 jedi-0.17.0-py36_0 jinja2-2.11.2-py_0 joblib-0.15.1-py_0 jpeg-9b-he5867d9_2 jsonschema-3.2.0-py36_0
jupyter-1.0.0-py36_7 jupyter_client-6.1.3-py_0 jupyter_console-6.1.0-py_0 jupyter_core-4.6.3-py36_0 keras-applications-1.0.8-py_0 keras-preprocessing-1.1.0-py_1
libcxx-10.0.0-1 libedit-3.1.20181209-hb402a30_0 libffi-3.3-h0a44026_1 libgfortran-3.0.1-h93005f0_2 libiconv-1.16-h1de35cc_0 libpng-1.6.37-ha441bb4_0
libprotobuf-3.12.3-hab81aa3_0 libsodium-1.0.16-h3efe00b_0 llvm-openmp-10.0.0-h28b9765_0 markdown-3.1.1-py36_0 markupsafe-1.1.1-py36h1de35cc_0
mistune-0.8.4-py36h1de35cc_0 mkl-2019.4-233 mkl-service-2.3.0-py36hfbe908c_0 mkl_fft-1.0.15-py36h5e564d8_0 mkl_random-1.1.1-py36h959d312_0 nbconvert-5.6.1-py36_0
nbformat-5.0.6-py_0 ncurses-6.2-h0a44026_1 notebook-6.0.3-py36_0 numpy-1.18.1-py36h7241aed_0 numpy-base-1.18.1-py36h3304bdc_1 openssl-1.1.1g-h1de35cc_0
pandas-1.0.3-py36h6c726b0_0 pandoc-2.2.3.2-0 pandocfilters-1.4.2-py36_1 parso-0.7.0-py_0 pcre-8.43-h0a44026_0 pexpect-4.8.0-py36_0 pickleshare-0.7.5-py36_0
pip-20.0.2-py36_3 prometheus_client-0.7.1-py_0 prompt-toolkit-3.0.5-py_0 prompt_toolkit-3.0.5-0 protobuf-3.12.3-py36hb1e8313_0 ptyprocess-0.6.0-py36_0
pygments-2.6.1-py_0 pyqt-5.9.2-py36h655552a_2 pyrsistent-0.16.0-py36h1de35cc_0 python-3.6.10-hf48f09d_2 python-dateutil-2.8.1-py_0 pytz-2020.1-py_0
pyzmq-18.1.1-py36h0a44026_0 qt-5.9.7-h468cd18_1 qtconsole-4.7.4-py_0 qtpy-1.9.0-py_0 readline-8.0-h1de35cc_0 scikit-learn-0.22.1-py36h27c97d8_0
scipy-1.4.1-py36h9fa6033_0 send2trash-1.5.0-py36_0 setuptools-47.1.1-py36_0 sip-4.19.8-py36h0a44026_0 six-1.15.0-py_0 sqlite-3.31.1-h5c1f38d_1 tensorboard-1.13.1-py36_0
tensorflow-1.13.2-hfddd6c2_0 tensorflow-base-1.13.2-py36_0 tensorflow-estimator-1.13.0-py36h24bf2e0_0 termcolor-1.1.0-py36_1 terminado-0.8.3-py36_0 testpath-0.4.4-py_0
tk-8.6.8-ha441bb4_0 tornado-6.0.4-py36h1de35cc_1 traitlets-4.3.3-py36_0 wcwidth-0.1.9-py_0 webencodings-0.5.1-py36_1 werkzeug-1.0.1-py_0 wheel-0.34.2-py36_0
widgetsnbextension-3.5.1-py36_0 xz-5.2.5-h1de35cc_0 zeromq-4.3.1-h0a44026_3 zipp-3.1.0-py_0 zlib-1.2.11-h1de35cc_3
14 Confidential and Proprietary. © 2020 Anaconda
Environment rendering
The primary output of the specification rendering process is an environment
specification file—a simple text file of precise conda package specifications
Additional rendering outputs:
● Conda metapackages
● Constructor installers
● conda-pack redistributables
● Hadoop parcels
● Docker images
Leverage automation processes (e.g., Jenkins) for automatic building
15 Confidential and Proprietary. © 2020 Anaconda
Versioning and archiving
● All rendered environments are versioned and archived
○ Ensures reproducibility of legacy models
● New projects should, by default, be pointed to the “latest” environment
○ Symbolic link: “environment-latest” -> “environment-2020.06.01”
● It should be easy to connect to recent historical environments
○ Ensures stability of longer-term model development
○ Exceptions made for environments pulled for vulnerability remediation
● For production, move off of “latest” to the corresponding version
○ Or to a fully specified custom environment
● A regular update cadence gives users predictability
16 Confidential and Proprietary. © 2020 Anaconda
Distributing Conda Environments
Constructor, Conda-Pack
17 Confidential and Proprietary. © 2020 Anaconda
The conda package manager is GREAT at creating highly customized Python & R
environments
● Dependency metadata ensures I get all the packages I need—even the ones I
didn’t know I needed
● I can pin the package versions I care about as precisely as I want, and let
conda give me the latest compatible versions of everything else
Every data scientist can tailor their environment to precisely serve their needs
Motivation
18 Confidential and Proprietary. © 2020 Anaconda
But now that I have the perfect environment, how do I…
● Share it with my team members or even my entire department
● Distribute it to 100 different machines (e.g., Spark / Dask)
● Safely archive it so I can recover it, months or years later
What tools are at my disposal?
Motivation
19 Confidential and Proprietary. © 2020 Anaconda
conda list --export > environment.txt
conda create -n env_name --file environment.txt
conda env export > env.yml
conda env create -f env.yml
Commands like these often do the job—until they don’t…
● What if the target machines don’t have conda installed?
● What if the recipient is a conda novice?
● What if the packages are no longer available in my repository?
● What if I’m building environments for air-gapped computers?
Environment specs?
20 Confidential and Proprietary. © 2020 Anaconda
Constructor and Conda-Pack provide two freely available, open source tools to
bundle conda environments into sharable, transportable, archivable assets
● Constructor: user-friendly, custom installers similar to the Anaconda and
Miniconda installers distributed by Anaconda
● Conda-Pack: simple, compact archives of environments for lower-level or
automated approaches to distribution and management
Addressing the challenge: two tools
21 Confidential and Proprietary. © 2020 Anaconda
Constructor
22 Confidential and Proprietary. © 2020 Anaconda
● https://github.com/conda/constructor
● Builds custom installers for a valid conda environment
● Gives users the same installer experience they are already accustomed to
○ GUI installers for Mac and Windows
○ Shell installers for Linux and Mac
● Provides lots of customization options
○ Custom package sets
○ Conda configuration settings
○ Logos and branding
Conda Constructor
23 Confidential and Proprietary. © 2020 Anaconda
How it works
● Reads the construct.yaml file
● Calls conda in “dry run” mode to fully resolve environment specifications
● Downloads the necessary conda packages
● Combines the conda packages and install scripting into an OS-dependent
executable installer format
○ Linux/Mac: POSIX-shell based installer
○ Windows: NSIS-based GUI installer
○ Mac: macOS standard GUI installer
24 Confidential and Proprietary. © 2020 Anaconda
The results
25 Confidential and Proprietary. © 2020 Anaconda
● condarc: preinstall a custom configuration for conda upon install
○ channel_alias: point conda to an internal repository
○ default_channels : what does “defaults” mean?
○ ssl_verify: silence those pesky SSL issues
● channels_remap: maps build channels to install channels
○ Build an installer against one repository (e.g., Anaconda) for use in an internal environment
connected to another repository (e.g., Team Edition, Artifactory, Nexus)
○ The package metadata is modified so that the installed packages appear to have come from
the internal repository originally
● exclude: exclude certain packages from installation
○ readline: if you want to build a GPL-free installer
○ anaconda: removing the metapackage makes for more flexible customization by the user
Advanced options
26 Confidential and Proprietary. © 2020 Anaconda
name: Sortaconda
version: 2020.10.01
installer_type: all
channels_remap:
- src: https://repo.anaconda.com/pkgs/main/
dst: https://repo.company.com/api/repo
- src: https://repo.anaconda.com/pkgs/msys2/ # [win]
dst: https://repo.company.com/api/repo/msys2/ # [win]
specs:
- python=3.6.10
- conda=4.8.4
- anaconda=2020.02
exclude:
- anaconda
condarc:
channel_alias: https://repo.company.com/api/re po
The construct.yaml file
27 Confidential and Proprietary. © 2020 Anaconda
Conda-Pack
28 Confidential and Proprietary. © 2020 Anaconda
● https://github.com/conda/conda-pack
● Creates a simple, standard-format archive (.tar.gz, .zip, etc.)
● ...but… conda environments are not relocatable
○ Moving a conda environment to a different directory can render it inoperable
○ Conda employs special relocation logic that “adjusts” packages as they are installed so they
operate correctly at the install location
● conda-pack solves this in one of two ways
○ Normal mode: it includes a script called conda-unpack that can be run after unpacking that
reproduces conda’s relocation logic
○ Fixed destination mode: the archive is be “pre-adjusted” for the destination. It must be installed
in that directory, but no post-install script is required
● new development: Cloudera parcel support
Conda-Pack
29 Confidential and Proprietary. © 2020 Anaconda
● As simple as: conda-pack -n <env>
○ Produces a file <env>.tar.gz
● Common options:
conda-pack -n <env> # or -p <path>
--format <format> # tar, zip, tar.gz, …
--output <filename> # <env>.<format>
--dest-prefix <path> # for known destinations
--exclude <pattern> # excludes files
--include <pattern> # re-include files
Calling convention
30 Confidential and Proprietary. © 2020 Anaconda
● File format nearly identical to standard conda-pack
● As simple as: conda-pack -n <env> --format parcel
● All parcel-specific options
conda-pack -n <environment> --format parcel
--parcel-name <name> # env name
--parcel-version <version> # YYYY.MM.DD
--parcel-distro <distro> # el7
--parcel-root <root> # /opt/cloudera/parcels
● In pre-release: conda install ctools/label/dev::conda-pack
Parcel support
31 Confidential and Proprietary. © 2020 Anaconda
Packing examples
32 Confidential and Proprietary. © 2020 Anaconda
● Deliver archive to destination machine
● Create the target directory
● Unpack the archive into the destination directory
● Activate: source <path>/bin/activate
With a standard conda-pack archive (no --dest-prefix):
● Finish relocation: <path>/bin/conda-unpack
That’s it! Environment is now fully usable in its new location
Unpacking a conda-pack archive
33 Confidential and Proprietary. © 2020 Anaconda
Unpacking example
34 Confidential and Proprietary. © 2020 Anaconda
Conda, Docker, & OpenShift
A brief look
35 Confidential and Proprietary. © 2020 Anaconda
Building Docker containers for OpenShift
● Ensuring the application runs as any UID
○ Group writable (GID 0)
○ Use nss_wrapper for username setting if necessary
● Deliver / build the conda environment within the container
● Bake activation into the entrypoint
Motivation
36 Confidential and Proprietary. © 2020 Anaconda
Wrapping up
37 Confidential and Proprietary. © 2020 Anaconda
● Start getting to know conda if you haven’t already
● Check out constructor & conda-pack
○ https://github.com/conda/constructor
○ https://github.com/conda/conda-pack
● Grab my simple Docker demo
○ https://github.com/mcg1969/webinar-docker
● Connect with me on LinkedIn!
○ https://www.linkedin.com/in/mcgrant/
Thank you!
Next steps
38 Confidential and Proprietary. © 2020 Anaconda
Q & A
Thank You!
Michael Grant
mgrant@anaconda.com
About Anaconda
About Anaconda With more than 20 million users, Anaconda is
the world’s most popular data science platform and the
foundation of modern machine learning. We pioneered the use
of Python for data science, champion its vibrant community, and
continue to steward open-source projects that make tomorrow’s
innovations possible. Our enterprise-grade solutions enable
corporate, research, and academic institutions around the world
to harness the power of open-source for competitive advantage,
groundbreaking research, and a better world.
Visit https://www.anaconda.com to learn more.
40

Weitere ähnliche Inhalte

Was ist angesagt?

Becoming the Docker Champion: Bringing Docker Back to Work
Becoming the Docker Champion: Bringing Docker Back to WorkBecoming the Docker Champion: Bringing Docker Back to Work
Becoming the Docker Champion: Bringing Docker Back to WorkDocker, Inc.
 
Docker ee an architecture and operations overview
Docker ee an architecture and operations overviewDocker ee an architecture and operations overview
Docker ee an architecture and operations overviewDocker, Inc.
 
Cloud Native Development
Cloud Native DevelopmentCloud Native Development
Cloud Native DevelopmentManuel Garcia
 
Docker Federal Summit 2017 General Session
Docker Federal Summit 2017 General SessionDocker Federal Summit 2017 General Session
Docker Federal Summit 2017 General SessionDocker, Inc.
 
Using the SDACK Architecture on Security Event Inspection by Yu-Lun Chen and ...
Using the SDACK Architecture on Security Event Inspection by Yu-Lun Chen and ...Using the SDACK Architecture on Security Event Inspection by Yu-Lun Chen and ...
Using the SDACK Architecture on Security Event Inspection by Yu-Lun Chen and ...Docker, Inc.
 
Don’t have a Meltdown! Practical Steps for Defending Your Apps
Don’t have a Meltdown! Practical Steps for Defending Your AppsDon’t have a Meltdown! Practical Steps for Defending Your Apps
Don’t have a Meltdown! Practical Steps for Defending Your AppsDocker, Inc.
 
Data protection in a kubernetes-native world
Data protection in a kubernetes-native worldData protection in a kubernetes-native world
Data protection in a kubernetes-native worldLibbySchulze
 
Docker EE Deep Dive
Docker EE Deep DiveDocker EE Deep Dive
Docker EE Deep DiveDocker, Inc.
 
Running database infrastructure on containers
Running database infrastructure on containersRunning database infrastructure on containers
Running database infrastructure on containersMariaDB plc
 
5 Kubernetes Security Tools You Should Use
5 Kubernetes Security Tools You Should Use5 Kubernetes Security Tools You Should Use
5 Kubernetes Security Tools You Should UseDevOps.com
 
Image Scanning Best Practices for Containers and Kubernetes
Image Scanning Best Practices for Containers and KubernetesImage Scanning Best Practices for Containers and Kubernetes
Image Scanning Best Practices for Containers and KubernetesDevOps.com
 
Kubernetes for Beginners
Kubernetes for BeginnersKubernetes for Beginners
Kubernetes for BeginnersDigitalOcean
 
Intro to GKE and app deployment with Kubernetes
Intro to GKE and app deployment with KubernetesIntro to GKE and app deployment with Kubernetes
Intro to GKE and app deployment with KubernetesGDG Cloud Bengaluru
 
Running a Cost-Effective DynamoDB-Compatible Database on Managed Kubernetes S...
Running a Cost-Effective DynamoDB-Compatible Database on Managed Kubernetes S...Running a Cost-Effective DynamoDB-Compatible Database on Managed Kubernetes S...
Running a Cost-Effective DynamoDB-Compatible Database on Managed Kubernetes S...DevOps.com
 
Whats new in brigade 2
Whats new in brigade 2Whats new in brigade 2
Whats new in brigade 2LibbySchulze
 
AnsibleFest 2020 - Automate cybersecurity solutions in a cloud native scenario
AnsibleFest 2020 - Automate cybersecurity solutions in a cloud native scenarioAnsibleFest 2020 - Automate cybersecurity solutions in a cloud native scenario
AnsibleFest 2020 - Automate cybersecurity solutions in a cloud native scenarioRoberto Carratala
 
DCEU 18: Docker Container Networking
DCEU 18: Docker Container NetworkingDCEU 18: Docker Container Networking
DCEU 18: Docker Container NetworkingDocker, Inc.
 
Intro to Docker Containers and the Oracle Platform – Database, WebLogic &Clo...
 Intro to Docker Containers and the Oracle Platform – Database, WebLogic &Clo... Intro to Docker Containers and the Oracle Platform – Database, WebLogic &Clo...
Intro to Docker Containers and the Oracle Platform – Database, WebLogic &Clo...Lucas Jellema
 
Kubescape single pane of glass
Kubescape   single pane of glassKubescape   single pane of glass
Kubescape single pane of glassLibbySchulze1
 
Introduction to KubeSphere and its open source ecosystem
Introduction to KubeSphere and its open source ecosystemIntroduction to KubeSphere and its open source ecosystem
Introduction to KubeSphere and its open source ecosystemKubeSphere
 

Was ist angesagt? (20)

Becoming the Docker Champion: Bringing Docker Back to Work
Becoming the Docker Champion: Bringing Docker Back to WorkBecoming the Docker Champion: Bringing Docker Back to Work
Becoming the Docker Champion: Bringing Docker Back to Work
 
Docker ee an architecture and operations overview
Docker ee an architecture and operations overviewDocker ee an architecture and operations overview
Docker ee an architecture and operations overview
 
Cloud Native Development
Cloud Native DevelopmentCloud Native Development
Cloud Native Development
 
Docker Federal Summit 2017 General Session
Docker Federal Summit 2017 General SessionDocker Federal Summit 2017 General Session
Docker Federal Summit 2017 General Session
 
Using the SDACK Architecture on Security Event Inspection by Yu-Lun Chen and ...
Using the SDACK Architecture on Security Event Inspection by Yu-Lun Chen and ...Using the SDACK Architecture on Security Event Inspection by Yu-Lun Chen and ...
Using the SDACK Architecture on Security Event Inspection by Yu-Lun Chen and ...
 
Don’t have a Meltdown! Practical Steps for Defending Your Apps
Don’t have a Meltdown! Practical Steps for Defending Your AppsDon’t have a Meltdown! Practical Steps for Defending Your Apps
Don’t have a Meltdown! Practical Steps for Defending Your Apps
 
Data protection in a kubernetes-native world
Data protection in a kubernetes-native worldData protection in a kubernetes-native world
Data protection in a kubernetes-native world
 
Docker EE Deep Dive
Docker EE Deep DiveDocker EE Deep Dive
Docker EE Deep Dive
 
Running database infrastructure on containers
Running database infrastructure on containersRunning database infrastructure on containers
Running database infrastructure on containers
 
5 Kubernetes Security Tools You Should Use
5 Kubernetes Security Tools You Should Use5 Kubernetes Security Tools You Should Use
5 Kubernetes Security Tools You Should Use
 
Image Scanning Best Practices for Containers and Kubernetes
Image Scanning Best Practices for Containers and KubernetesImage Scanning Best Practices for Containers and Kubernetes
Image Scanning Best Practices for Containers and Kubernetes
 
Kubernetes for Beginners
Kubernetes for BeginnersKubernetes for Beginners
Kubernetes for Beginners
 
Intro to GKE and app deployment with Kubernetes
Intro to GKE and app deployment with KubernetesIntro to GKE and app deployment with Kubernetes
Intro to GKE and app deployment with Kubernetes
 
Running a Cost-Effective DynamoDB-Compatible Database on Managed Kubernetes S...
Running a Cost-Effective DynamoDB-Compatible Database on Managed Kubernetes S...Running a Cost-Effective DynamoDB-Compatible Database on Managed Kubernetes S...
Running a Cost-Effective DynamoDB-Compatible Database on Managed Kubernetes S...
 
Whats new in brigade 2
Whats new in brigade 2Whats new in brigade 2
Whats new in brigade 2
 
AnsibleFest 2020 - Automate cybersecurity solutions in a cloud native scenario
AnsibleFest 2020 - Automate cybersecurity solutions in a cloud native scenarioAnsibleFest 2020 - Automate cybersecurity solutions in a cloud native scenario
AnsibleFest 2020 - Automate cybersecurity solutions in a cloud native scenario
 
DCEU 18: Docker Container Networking
DCEU 18: Docker Container NetworkingDCEU 18: Docker Container Networking
DCEU 18: Docker Container Networking
 
Intro to Docker Containers and the Oracle Platform – Database, WebLogic &Clo...
 Intro to Docker Containers and the Oracle Platform – Database, WebLogic &Clo... Intro to Docker Containers and the Oracle Platform – Database, WebLogic &Clo...
Intro to Docker Containers and the Oracle Platform – Database, WebLogic &Clo...
 
Kubescape single pane of glass
Kubescape   single pane of glassKubescape   single pane of glass
Kubescape single pane of glass
 
Introduction to KubeSphere and its open source ecosystem
Introduction to KubeSphere and its open source ecosystemIntroduction to KubeSphere and its open source ecosystem
Introduction to KubeSphere and its open source ecosystem
 

Ähnlich wie Elevate Your Enterprise Python and R AI, ML Software Strategy with Anaconda Team Edition

Best practices for optimizing Red Hat platforms for large scale datacenter de...
Best practices for optimizing Red Hat platforms for large scale datacenter de...Best practices for optimizing Red Hat platforms for large scale datacenter de...
Best practices for optimizing Red Hat platforms for large scale datacenter de...Jeremy Eder
 
gVisor, Kata Containers, Firecracker, Docker: Who is Who in the Container Space?
gVisor, Kata Containers, Firecracker, Docker: Who is Who in the Container Space?gVisor, Kata Containers, Firecracker, Docker: Who is Who in the Container Space?
gVisor, Kata Containers, Firecracker, Docker: Who is Who in the Container Space?ArangoDB Database
 
Yocto and IoT - a retrospective
Yocto and IoT - a retrospectiveYocto and IoT - a retrospective
Yocto and IoT - a retrospectiveOpen-RnD
 
BlackStor - World's fastest & most reliable Cloud Native Software Defined Sto...
BlackStor - World's fastest & most reliable Cloud Native Software Defined Sto...BlackStor - World's fastest & most reliable Cloud Native Software Defined Sto...
BlackStor - World's fastest & most reliable Cloud Native Software Defined Sto...Michal Němec
 
Using Docker Platform to Provide Services
Using Docker Platform to Provide ServicesUsing Docker Platform to Provide Services
Using Docker Platform to Provide ServicesGLC Networks
 
Extending OpenShift Origin: Build Your Own Cartridge with Bill DeCoste of Red...
Extending OpenShift Origin: Build Your Own Cartridge with Bill DeCoste of Red...Extending OpenShift Origin: Build Your Own Cartridge with Bill DeCoste of Red...
Extending OpenShift Origin: Build Your Own Cartridge with Bill DeCoste of Red...OpenShift Origin
 
Building android for the Cloud: Android as a Server (AnDevConBoston 2014)
Building android for the Cloud: Android as a Server (AnDevConBoston 2014)Building android for the Cloud: Android as a Server (AnDevConBoston 2014)
Building android for the Cloud: Android as a Server (AnDevConBoston 2014)Ron Munitz
 
Build and deploy scientific Python Applications
Build and deploy scientific Python Applications  Build and deploy scientific Python Applications
Build and deploy scientific Python Applications Ramakrishna Reddy
 
IIT-RTC 2017 Qt WebRTC Tutorial (Qt Janus Client)
IIT-RTC 2017 Qt WebRTC Tutorial (Qt Janus Client)IIT-RTC 2017 Qt WebRTC Tutorial (Qt Janus Client)
IIT-RTC 2017 Qt WebRTC Tutorial (Qt Janus Client)Alexandre Gouaillard
 
Docker and-containers-for-development-and-deployment-scale12x
Docker and-containers-for-development-and-deployment-scale12xDocker and-containers-for-development-and-deployment-scale12x
Docker and-containers-for-development-and-deployment-scale12xrkr10
 
Delivering a bleeding edge community-led openstack distribution: RDO
Delivering a bleeding edge community-led openstack distribution: RDO Delivering a bleeding edge community-led openstack distribution: RDO
Delivering a bleeding edge community-led openstack distribution: RDO Chandan Kumar
 
2022.03.23 Conda and Conda environments.pptx
2022.03.23 Conda and Conda environments.pptx2022.03.23 Conda and Conda environments.pptx
2022.03.23 Conda and Conda environments.pptxPhilip Ashton
 
DRBD + OpenStack (Openstack Live Prague 2016)
DRBD + OpenStack (Openstack Live Prague 2016)DRBD + OpenStack (Openstack Live Prague 2016)
DRBD + OpenStack (Openstack Live Prague 2016)Jaroslav Jacjuk
 
Up and Running with Freebsd
Up and Running with FreebsdUp and Running with Freebsd
Up and Running with FreebsdGLC Networks
 
Introduction to Docker (as presented at December 2013 Global Hackathon)
Introduction to Docker (as presented at December 2013 Global Hackathon)Introduction to Docker (as presented at December 2013 Global Hackathon)
Introduction to Docker (as presented at December 2013 Global Hackathon)Jérôme Petazzoni
 
PURL and vers: The Mostly Universal Package URL and Version Ranges Identifier...
PURL and vers: The Mostly Universal Package URL and Version Ranges Identifier...PURL and vers: The Mostly Universal Package URL and Version Ranges Identifier...
PURL and vers: The Mostly Universal Package URL and Version Ranges Identifier...Michael Herzog
 

Ähnlich wie Elevate Your Enterprise Python and R AI, ML Software Strategy with Anaconda Team Edition (20)

Conda environment system & how to use it on CSUC machines
Conda environment system & how to use it on CSUC machinesConda environment system & how to use it on CSUC machines
Conda environment system & how to use it on CSUC machines
 
anaconda.pptx
anaconda.pptxanaconda.pptx
anaconda.pptx
 
Best practices for optimizing Red Hat platforms for large scale datacenter de...
Best practices for optimizing Red Hat platforms for large scale datacenter de...Best practices for optimizing Red Hat platforms for large scale datacenter de...
Best practices for optimizing Red Hat platforms for large scale datacenter de...
 
gVisor, Kata Containers, Firecracker, Docker: Who is Who in the Container Space?
gVisor, Kata Containers, Firecracker, Docker: Who is Who in the Container Space?gVisor, Kata Containers, Firecracker, Docker: Who is Who in the Container Space?
gVisor, Kata Containers, Firecracker, Docker: Who is Who in the Container Space?
 
Yocto and IoT - a retrospective
Yocto and IoT - a retrospectiveYocto and IoT - a retrospective
Yocto and IoT - a retrospective
 
BlackStor - World's fastest & most reliable Cloud Native Software Defined Sto...
BlackStor - World's fastest & most reliable Cloud Native Software Defined Sto...BlackStor - World's fastest & most reliable Cloud Native Software Defined Sto...
BlackStor - World's fastest & most reliable Cloud Native Software Defined Sto...
 
Using Docker Platform to Provide Services
Using Docker Platform to Provide ServicesUsing Docker Platform to Provide Services
Using Docker Platform to Provide Services
 
Extending OpenShift Origin: Build Your Own Cartridge with Bill DeCoste of Red...
Extending OpenShift Origin: Build Your Own Cartridge with Bill DeCoste of Red...Extending OpenShift Origin: Build Your Own Cartridge with Bill DeCoste of Red...
Extending OpenShift Origin: Build Your Own Cartridge with Bill DeCoste of Red...
 
Building android for the Cloud: Android as a Server (AnDevConBoston 2014)
Building android for the Cloud: Android as a Server (AnDevConBoston 2014)Building android for the Cloud: Android as a Server (AnDevConBoston 2014)
Building android for the Cloud: Android as a Server (AnDevConBoston 2014)
 
Build and deploy scientific Python Applications
Build and deploy scientific Python Applications  Build and deploy scientific Python Applications
Build and deploy scientific Python Applications
 
25532813.pptx
25532813.pptx25532813.pptx
25532813.pptx
 
IIT-RTC 2017 Qt WebRTC Tutorial (Qt Janus Client)
IIT-RTC 2017 Qt WebRTC Tutorial (Qt Janus Client)IIT-RTC 2017 Qt WebRTC Tutorial (Qt Janus Client)
IIT-RTC 2017 Qt WebRTC Tutorial (Qt Janus Client)
 
Docker and-containers-for-development-and-deployment-scale12x
Docker and-containers-for-development-and-deployment-scale12xDocker and-containers-for-development-and-deployment-scale12x
Docker and-containers-for-development-and-deployment-scale12x
 
Delivering a bleeding edge community-led openstack distribution: RDO
Delivering a bleeding edge community-led openstack distribution: RDO Delivering a bleeding edge community-led openstack distribution: RDO
Delivering a bleeding edge community-led openstack distribution: RDO
 
2022.03.23 Conda and Conda environments.pptx
2022.03.23 Conda and Conda environments.pptx2022.03.23 Conda and Conda environments.pptx
2022.03.23 Conda and Conda environments.pptx
 
DRBD + OpenStack (Openstack Live Prague 2016)
DRBD + OpenStack (Openstack Live Prague 2016)DRBD + OpenStack (Openstack Live Prague 2016)
DRBD + OpenStack (Openstack Live Prague 2016)
 
From Zero to Hero - Nexinto
From Zero to Hero - NexintoFrom Zero to Hero - Nexinto
From Zero to Hero - Nexinto
 
Up and Running with Freebsd
Up and Running with FreebsdUp and Running with Freebsd
Up and Running with Freebsd
 
Introduction to Docker (as presented at December 2013 Global Hackathon)
Introduction to Docker (as presented at December 2013 Global Hackathon)Introduction to Docker (as presented at December 2013 Global Hackathon)
Introduction to Docker (as presented at December 2013 Global Hackathon)
 
PURL and vers: The Mostly Universal Package URL and Version Ranges Identifier...
PURL and vers: The Mostly Universal Package URL and Version Ranges Identifier...PURL and vers: The Mostly Universal Package URL and Version Ranges Identifier...
PURL and vers: The Mostly Universal Package URL and Version Ranges Identifier...
 

Mehr von DevOps.com

Modernizing on IBM Z Made Easier With Open Source Software
Modernizing on IBM Z Made Easier With Open Source SoftwareModernizing on IBM Z Made Easier With Open Source Software
Modernizing on IBM Z Made Easier With Open Source SoftwareDevOps.com
 
Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...DevOps.com
 
Next Generation Vulnerability Assessment Using Datadog and Snyk
Next Generation Vulnerability Assessment Using Datadog and SnykNext Generation Vulnerability Assessment Using Datadog and Snyk
Next Generation Vulnerability Assessment Using Datadog and SnykDevOps.com
 
Vulnerability Discovery in the Cloud
Vulnerability Discovery in the CloudVulnerability Discovery in the Cloud
Vulnerability Discovery in the CloudDevOps.com
 
2021 Open Source Governance: Top Ten Trends and Predictions
2021 Open Source Governance: Top Ten Trends and Predictions2021 Open Source Governance: Top Ten Trends and Predictions
2021 Open Source Governance: Top Ten Trends and PredictionsDevOps.com
 
A New Year’s Ransomware Resolution
A New Year’s Ransomware ResolutionA New Year’s Ransomware Resolution
A New Year’s Ransomware ResolutionDevOps.com
 
Getting Started with Runtime Security on Azure Kubernetes Service (AKS)
Getting Started with Runtime Security on Azure Kubernetes Service (AKS)Getting Started with Runtime Security on Azure Kubernetes Service (AKS)
Getting Started with Runtime Security on Azure Kubernetes Service (AKS)DevOps.com
 
Don't Panic! Effective Incident Response
Don't Panic! Effective Incident ResponseDon't Panic! Effective Incident Response
Don't Panic! Effective Incident ResponseDevOps.com
 
Creating a Culture of Chaos: Chaos Engineering Is Not Just Tools, It's Culture
Creating a Culture of Chaos: Chaos Engineering Is Not Just Tools, It's CultureCreating a Culture of Chaos: Chaos Engineering Is Not Just Tools, It's Culture
Creating a Culture of Chaos: Chaos Engineering Is Not Just Tools, It's CultureDevOps.com
 
Role Based Access Controls (RBAC) for SSH and Kubernetes Access with Teleport
Role Based Access Controls (RBAC) for SSH and Kubernetes Access with TeleportRole Based Access Controls (RBAC) for SSH and Kubernetes Access with Teleport
Role Based Access Controls (RBAC) for SSH and Kubernetes Access with TeleportDevOps.com
 
Monitoring Serverless Applications with Datadog
Monitoring Serverless Applications with DatadogMonitoring Serverless Applications with Datadog
Monitoring Serverless Applications with DatadogDevOps.com
 
Deliver your App Anywhere … Publicly or Privately
Deliver your App Anywhere … Publicly or PrivatelyDeliver your App Anywhere … Publicly or Privately
Deliver your App Anywhere … Publicly or PrivatelyDevOps.com
 
Securing medical apps in the age of covid final
Securing medical apps in the age of covid finalSecuring medical apps in the age of covid final
Securing medical apps in the age of covid finalDevOps.com
 
How to Build a Healthy On-Call Culture
How to Build a Healthy On-Call CultureHow to Build a Healthy On-Call Culture
How to Build a Healthy On-Call CultureDevOps.com
 
The Evolving Role of the Developer in 2021
The Evolving Role of the Developer in 2021The Evolving Role of the Developer in 2021
The Evolving Role of the Developer in 2021DevOps.com
 
Service Mesh: Two Big Words But Do You Need It?
Service Mesh: Two Big Words But Do You Need It?Service Mesh: Two Big Words But Do You Need It?
Service Mesh: Two Big Words But Do You Need It?DevOps.com
 
Secure Data Sharing in OpenShift Environments
Secure Data Sharing in OpenShift EnvironmentsSecure Data Sharing in OpenShift Environments
Secure Data Sharing in OpenShift EnvironmentsDevOps.com
 
How to Govern Identities and Access in Cloud Infrastructure: AppsFlyer Case S...
How to Govern Identities and Access in Cloud Infrastructure: AppsFlyer Case S...How to Govern Identities and Access in Cloud Infrastructure: AppsFlyer Case S...
How to Govern Identities and Access in Cloud Infrastructure: AppsFlyer Case S...DevOps.com
 
Hotels, Hookups and Video Conferencing: A Top 10 Countdown to 2020's Worst Da...
Hotels, Hookups and Video Conferencing: A Top 10 Countdown to 2020's Worst Da...Hotels, Hookups and Video Conferencing: A Top 10 Countdown to 2020's Worst Da...
Hotels, Hookups and Video Conferencing: A Top 10 Countdown to 2020's Worst Da...DevOps.com
 
How IBM's Massive POWER9 UNIX Servers Benefit from InfluxDB and Grafana Techn...
How IBM's Massive POWER9 UNIX Servers Benefit from InfluxDB and Grafana Techn...How IBM's Massive POWER9 UNIX Servers Benefit from InfluxDB and Grafana Techn...
How IBM's Massive POWER9 UNIX Servers Benefit from InfluxDB and Grafana Techn...DevOps.com
 

Mehr von DevOps.com (20)

Modernizing on IBM Z Made Easier With Open Source Software
Modernizing on IBM Z Made Easier With Open Source SoftwareModernizing on IBM Z Made Easier With Open Source Software
Modernizing on IBM Z Made Easier With Open Source Software
 
Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
Comparing Microsoft SQL Server 2019 Performance Across Various Kubernetes Pla...
 
Next Generation Vulnerability Assessment Using Datadog and Snyk
Next Generation Vulnerability Assessment Using Datadog and SnykNext Generation Vulnerability Assessment Using Datadog and Snyk
Next Generation Vulnerability Assessment Using Datadog and Snyk
 
Vulnerability Discovery in the Cloud
Vulnerability Discovery in the CloudVulnerability Discovery in the Cloud
Vulnerability Discovery in the Cloud
 
2021 Open Source Governance: Top Ten Trends and Predictions
2021 Open Source Governance: Top Ten Trends and Predictions2021 Open Source Governance: Top Ten Trends and Predictions
2021 Open Source Governance: Top Ten Trends and Predictions
 
A New Year’s Ransomware Resolution
A New Year’s Ransomware ResolutionA New Year’s Ransomware Resolution
A New Year’s Ransomware Resolution
 
Getting Started with Runtime Security on Azure Kubernetes Service (AKS)
Getting Started with Runtime Security on Azure Kubernetes Service (AKS)Getting Started with Runtime Security on Azure Kubernetes Service (AKS)
Getting Started with Runtime Security on Azure Kubernetes Service (AKS)
 
Don't Panic! Effective Incident Response
Don't Panic! Effective Incident ResponseDon't Panic! Effective Incident Response
Don't Panic! Effective Incident Response
 
Creating a Culture of Chaos: Chaos Engineering Is Not Just Tools, It's Culture
Creating a Culture of Chaos: Chaos Engineering Is Not Just Tools, It's CultureCreating a Culture of Chaos: Chaos Engineering Is Not Just Tools, It's Culture
Creating a Culture of Chaos: Chaos Engineering Is Not Just Tools, It's Culture
 
Role Based Access Controls (RBAC) for SSH and Kubernetes Access with Teleport
Role Based Access Controls (RBAC) for SSH and Kubernetes Access with TeleportRole Based Access Controls (RBAC) for SSH and Kubernetes Access with Teleport
Role Based Access Controls (RBAC) for SSH and Kubernetes Access with Teleport
 
Monitoring Serverless Applications with Datadog
Monitoring Serverless Applications with DatadogMonitoring Serverless Applications with Datadog
Monitoring Serverless Applications with Datadog
 
Deliver your App Anywhere … Publicly or Privately
Deliver your App Anywhere … Publicly or PrivatelyDeliver your App Anywhere … Publicly or Privately
Deliver your App Anywhere … Publicly or Privately
 
Securing medical apps in the age of covid final
Securing medical apps in the age of covid finalSecuring medical apps in the age of covid final
Securing medical apps in the age of covid final
 
How to Build a Healthy On-Call Culture
How to Build a Healthy On-Call CultureHow to Build a Healthy On-Call Culture
How to Build a Healthy On-Call Culture
 
The Evolving Role of the Developer in 2021
The Evolving Role of the Developer in 2021The Evolving Role of the Developer in 2021
The Evolving Role of the Developer in 2021
 
Service Mesh: Two Big Words But Do You Need It?
Service Mesh: Two Big Words But Do You Need It?Service Mesh: Two Big Words But Do You Need It?
Service Mesh: Two Big Words But Do You Need It?
 
Secure Data Sharing in OpenShift Environments
Secure Data Sharing in OpenShift EnvironmentsSecure Data Sharing in OpenShift Environments
Secure Data Sharing in OpenShift Environments
 
How to Govern Identities and Access in Cloud Infrastructure: AppsFlyer Case S...
How to Govern Identities and Access in Cloud Infrastructure: AppsFlyer Case S...How to Govern Identities and Access in Cloud Infrastructure: AppsFlyer Case S...
How to Govern Identities and Access in Cloud Infrastructure: AppsFlyer Case S...
 
Hotels, Hookups and Video Conferencing: A Top 10 Countdown to 2020's Worst Da...
Hotels, Hookups and Video Conferencing: A Top 10 Countdown to 2020's Worst Da...Hotels, Hookups and Video Conferencing: A Top 10 Countdown to 2020's Worst Da...
Hotels, Hookups and Video Conferencing: A Top 10 Countdown to 2020's Worst Da...
 
How IBM's Massive POWER9 UNIX Servers Benefit from InfluxDB and Grafana Techn...
How IBM's Massive POWER9 UNIX Servers Benefit from InfluxDB and Grafana Techn...How IBM's Massive POWER9 UNIX Servers Benefit from InfluxDB and Grafana Techn...
How IBM's Massive POWER9 UNIX Servers Benefit from InfluxDB and Grafana Techn...
 

Kürzlich hochgeladen

Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentEmixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentPim van der Noll
 
Accelerating Enterprise Software Engineering with Platformless
Accelerating Enterprise Software Engineering with PlatformlessAccelerating Enterprise Software Engineering with Platformless
Accelerating Enterprise Software Engineering with PlatformlessWSO2
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesKari Kakkonen
 
All These Sophisticated Attacks, Can We Really Detect Them - PDF
All These Sophisticated Attacks, Can We Really Detect Them - PDFAll These Sophisticated Attacks, Can We Really Detect Them - PDF
All These Sophisticated Attacks, Can We Really Detect Them - PDFMichael Gough
 
QMMS Lesson 2 - Using MS Excel Formula.pdf
QMMS Lesson 2 - Using MS Excel Formula.pdfQMMS Lesson 2 - Using MS Excel Formula.pdf
QMMS Lesson 2 - Using MS Excel Formula.pdfROWELL MARQUINA
 
WomenInAutomation2024: AI and Automation for eveyone
WomenInAutomation2024: AI and Automation for eveyoneWomenInAutomation2024: AI and Automation for eveyone
WomenInAutomation2024: AI and Automation for eveyoneUiPathCommunity
 
Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Hiroshi SHIBATA
 
JET Technology Labs White Paper for Virtualized Security and Encryption Techn...
JET Technology Labs White Paper for Virtualized Security and Encryption Techn...JET Technology Labs White Paper for Virtualized Security and Encryption Techn...
JET Technology Labs White Paper for Virtualized Security and Encryption Techn...amber724300
 
Deliver Latency Free Customer Experience
Deliver Latency Free Customer ExperienceDeliver Latency Free Customer Experience
Deliver Latency Free Customer ExperienceOpsTree solutions
 
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesMuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesManik S Magar
 
Digital Tools & AI in Career Development
Digital Tools & AI in Career DevelopmentDigital Tools & AI in Career Development
Digital Tools & AI in Career DevelopmentMahmoud Rabie
 
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...BookNet Canada
 
Arti Languages Pre Seed Pitchdeck 2024.pdf
Arti Languages Pre Seed Pitchdeck 2024.pdfArti Languages Pre Seed Pitchdeck 2024.pdf
Arti Languages Pre Seed Pitchdeck 2024.pdfwill854175
 
React JS; all concepts. Contains React Features, JSX, functional & Class comp...
React JS; all concepts. Contains React Features, JSX, functional & Class comp...React JS; all concepts. Contains React Features, JSX, functional & Class comp...
React JS; all concepts. Contains React Features, JSX, functional & Class comp...Karmanjay Verma
 
Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Farhan Tariq
 
A PowerPoint Presentation on Vikram Lander pptx
A PowerPoint Presentation on Vikram Lander pptxA PowerPoint Presentation on Vikram Lander pptx
A PowerPoint Presentation on Vikram Lander pptxatharvdev2010
 
Generative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfGenerative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfIngrid Airi González
 
Transport in Open Pits______SM_MI10415MI
Transport in Open Pits______SM_MI10415MITransport in Open Pits______SM_MI10415MI
Transport in Open Pits______SM_MI10415MIRomil Mishra
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesThousandEyes
 
Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024TopCSSGallery
 

Kürzlich hochgeladen (20)

Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentEmixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
 
Accelerating Enterprise Software Engineering with Platformless
Accelerating Enterprise Software Engineering with PlatformlessAccelerating Enterprise Software Engineering with Platformless
Accelerating Enterprise Software Engineering with Platformless
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examples
 
All These Sophisticated Attacks, Can We Really Detect Them - PDF
All These Sophisticated Attacks, Can We Really Detect Them - PDFAll These Sophisticated Attacks, Can We Really Detect Them - PDF
All These Sophisticated Attacks, Can We Really Detect Them - PDF
 
QMMS Lesson 2 - Using MS Excel Formula.pdf
QMMS Lesson 2 - Using MS Excel Formula.pdfQMMS Lesson 2 - Using MS Excel Formula.pdf
QMMS Lesson 2 - Using MS Excel Formula.pdf
 
WomenInAutomation2024: AI and Automation for eveyone
WomenInAutomation2024: AI and Automation for eveyoneWomenInAutomation2024: AI and Automation for eveyone
WomenInAutomation2024: AI and Automation for eveyone
 
Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024
 
JET Technology Labs White Paper for Virtualized Security and Encryption Techn...
JET Technology Labs White Paper for Virtualized Security and Encryption Techn...JET Technology Labs White Paper for Virtualized Security and Encryption Techn...
JET Technology Labs White Paper for Virtualized Security and Encryption Techn...
 
Deliver Latency Free Customer Experience
Deliver Latency Free Customer ExperienceDeliver Latency Free Customer Experience
Deliver Latency Free Customer Experience
 
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesMuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
 
Digital Tools & AI in Career Development
Digital Tools & AI in Career DevelopmentDigital Tools & AI in Career Development
Digital Tools & AI in Career Development
 
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
 
Arti Languages Pre Seed Pitchdeck 2024.pdf
Arti Languages Pre Seed Pitchdeck 2024.pdfArti Languages Pre Seed Pitchdeck 2024.pdf
Arti Languages Pre Seed Pitchdeck 2024.pdf
 
React JS; all concepts. Contains React Features, JSX, functional & Class comp...
React JS; all concepts. Contains React Features, JSX, functional & Class comp...React JS; all concepts. Contains React Features, JSX, functional & Class comp...
React JS; all concepts. Contains React Features, JSX, functional & Class comp...
 
Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...
 
A PowerPoint Presentation on Vikram Lander pptx
A PowerPoint Presentation on Vikram Lander pptxA PowerPoint Presentation on Vikram Lander pptx
A PowerPoint Presentation on Vikram Lander pptx
 
Generative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfGenerative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdf
 
Transport in Open Pits______SM_MI10415MI
Transport in Open Pits______SM_MI10415MITransport in Open Pits______SM_MI10415MI
Transport in Open Pits______SM_MI10415MI
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
 
Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024
 

Elevate Your Enterprise Python and R AI, ML Software Strategy with Anaconda Team Edition

  • 1. 1 Confidential and Proprietary. © 2020 Anaconda Elevating your Python & R, AI & ML Strategy Anaconda Team Edition, Constructor, Conda-Pack, Docker December 2, 2020
  • 2. 2 Confidential and Proprietary. © 2020 Anaconda Agenda ● The conda package & environment management system ● Anaconda Team Edition: an enterprise AI / ML package repository ○ The importance of curated CVEs for security ● Managing conda environments for collaboration & distribution ● Tools for distributing conda environments: ○ Constructor & Conda-Pack ● Docker, conda, & OpenShift: a brief look
  • 3. 3 Confidential and Proprietary. © 2020 Anaconda A brief look at Conda
  • 4. 4 Confidential and Proprietary. © 2020 Anaconda The conda package format ● Cross-platform ○ Windows, Mac, Linux (x86/ARM/PPC), z/OS ● Cross-language ○ Python, R, Rust, Go… ● Rich metadata ○ License information facilitates governance ○ Dependency graph ensures package compatibility and environment correctness ● Binary package format ○ Packages are precompiled ○ Dynamic linking reduces vendoring (improving governance) and ensures cross-compatibility
  • 5. 5 Confidential and Proprietary. © 2020 Anaconda Anaconda Team Edition
  • 6. 6 Confidential and Proprietary. © 2020 Anaconda Team Edition - CVE Curation Process The National Institute of Standards and Technology(NIST) National Vulnerability Database (NVD) CVE Data Source. Associating NVD CVE data with packages in the Anaconda Repository Automated Matching. Anaconda staff review NVD CVE data for accuracy and then categorize, refine and improve the reported information. In some cases, CVEs are patched Human Curation. Accurate CVE metadata allows organizations to filter out OSS packages that don’t meet their security requirements Refined CVE Metadata. Goal: high-quality, accurate, and dependable CVE information Performed by Anaconda Distribution Team
  • 7. 7 Confidential and Proprietary. © 2020 Anaconda Team Edition - CVE Curation Example
  • 8. 8 Confidential and Proprietary. © 2020 Anaconda Environment Management Distributing packages ready to use
  • 9. 9 Confidential and Proprietary. © 2020 Anaconda Why standardize environments? ● Reduces support burden ○ Encourages use of mature, stable, widely adopted packages ● Encourages collaboration ○ Everyone is using a common package set ○ Common tool choices make it easier for people to help each other ● Ensures portability and deployability ○ Cross-platform (Windows -> Linux) more feasible ○ Potentially tighter requirements for production than development ● All that said: allowing customization is important
  • 10. 10 Confidential and Proprietary. © 2020 Anaconda Environment types ● Standard Python 3.x ● Python 2.x (for legacy applications only?) ● R (with/without Python?) ● GPU-enabled
  • 11. 11 Confidential and Proprietary. © 2020 Anaconda Environment destinations ● Desktops ● Edge nodes ● JupyterHub ● Anaconda Enterprise ● Third-party platforms (Domino, Cloudera DSW) ● Clusters: Spark, Dask, HPC/GPU ● Containerized applications: Docker, Kubernetes, OpenShift ● ???
  • 12. 12 Confidential and Proprietary. © 2020 Anaconda Specification rendering ● Layer 1: Global environment specifications ○ Minimal version pinning (e.g., Python / Scikit-Learn / NumPy / Pandas / Tensorflow / CUDA) ○ Objective: general major version decisionmaking ○ No platform-specific exceptions, except for package omissions on certain platforms ● Layer 2: Precise pinning of top-level specifications ○ Find a common set of precise version pins for Layer 1 specs only ○ Objective: cross platform compatibility ○ Platform-specific exceptions included as needed ● Layer 3: Fully realized specifications ○ All packages & dependencies identified and versioned down to the build
  • 13. 13 Confidential and Proprietary. © 2020 Anaconda Specification rendering: Example Minimal pinning python 3.6 scikit-learn 0.22 numpy 1.18 pandas 1.0 tensorflow >1.10,<2 notebook Full top-level pinning python 3.6.10 scikit-learn 0.22.1 numpy 1.18.1 pandas 1.0.3 tensorflow 1.13.2 notebook 6.0.3 Final specification ready for rendering absl-py-0.9.0-py36_0 appnope-0.1.0-py36hf537a9a_0 astor-0.8.0-py36_0 attrs-19.3.0-py_0 backcall-0.1.0-py36_0 blas-1.0-mkl bleach-3.1.4-py_0 c-ares-1.15.0-h1de35cc_1001 ca-certificates-2020.1.1-0 certifi-2020.4.5.1-py36_0 dbus-1.13.14-h517e14e_0 decorator-4.4.2-py_0 defusedxml-0.6.0-py_0 entrypoints-0.3-py36_0 expat-2.2.6-h0a44026_0 gast-0.3.3-py_0 gettext-0.19.8.1-hb0f4f8b_2 glib-2.63.1-h70d4741_1 grpcio-1.16.1-py36h044775b_1 h5py-2.10.0-py36h3134771_0 hdf5-1.10.4-hfa1e0ec_0 icu-58.2-h0a44026_3 importlib-metadata-1.6.0-py36_0 importlib_metadata-1.6.0-0 intel-openmp-2019.4-233 ipykernel-5.1.4-py36h39e3cac_0 ipython-7.13.0-py36h5ca1d4c_0 ipython_genutils-0.2.0-py36_0 ipywidgets-7.5.1-py_0 jedi-0.17.0-py36_0 jinja2-2.11.2-py_0 joblib-0.15.1-py_0 jpeg-9b-he5867d9_2 jsonschema-3.2.0-py36_0 jupyter-1.0.0-py36_7 jupyter_client-6.1.3-py_0 jupyter_console-6.1.0-py_0 jupyter_core-4.6.3-py36_0 keras-applications-1.0.8-py_0 keras-preprocessing-1.1.0-py_1 libcxx-10.0.0-1 libedit-3.1.20181209-hb402a30_0 libffi-3.3-h0a44026_1 libgfortran-3.0.1-h93005f0_2 libiconv-1.16-h1de35cc_0 libpng-1.6.37-ha441bb4_0 libprotobuf-3.12.3-hab81aa3_0 libsodium-1.0.16-h3efe00b_0 llvm-openmp-10.0.0-h28b9765_0 markdown-3.1.1-py36_0 markupsafe-1.1.1-py36h1de35cc_0 mistune-0.8.4-py36h1de35cc_0 mkl-2019.4-233 mkl-service-2.3.0-py36hfbe908c_0 mkl_fft-1.0.15-py36h5e564d8_0 mkl_random-1.1.1-py36h959d312_0 nbconvert-5.6.1-py36_0 nbformat-5.0.6-py_0 ncurses-6.2-h0a44026_1 notebook-6.0.3-py36_0 numpy-1.18.1-py36h7241aed_0 numpy-base-1.18.1-py36h3304bdc_1 openssl-1.1.1g-h1de35cc_0 pandas-1.0.3-py36h6c726b0_0 pandoc-2.2.3.2-0 pandocfilters-1.4.2-py36_1 parso-0.7.0-py_0 pcre-8.43-h0a44026_0 pexpect-4.8.0-py36_0 pickleshare-0.7.5-py36_0 pip-20.0.2-py36_3 prometheus_client-0.7.1-py_0 prompt-toolkit-3.0.5-py_0 prompt_toolkit-3.0.5-0 protobuf-3.12.3-py36hb1e8313_0 ptyprocess-0.6.0-py36_0 pygments-2.6.1-py_0 pyqt-5.9.2-py36h655552a_2 pyrsistent-0.16.0-py36h1de35cc_0 python-3.6.10-hf48f09d_2 python-dateutil-2.8.1-py_0 pytz-2020.1-py_0 pyzmq-18.1.1-py36h0a44026_0 qt-5.9.7-h468cd18_1 qtconsole-4.7.4-py_0 qtpy-1.9.0-py_0 readline-8.0-h1de35cc_0 scikit-learn-0.22.1-py36h27c97d8_0 scipy-1.4.1-py36h9fa6033_0 send2trash-1.5.0-py36_0 setuptools-47.1.1-py36_0 sip-4.19.8-py36h0a44026_0 six-1.15.0-py_0 sqlite-3.31.1-h5c1f38d_1 tensorboard-1.13.1-py36_0 tensorflow-1.13.2-hfddd6c2_0 tensorflow-base-1.13.2-py36_0 tensorflow-estimator-1.13.0-py36h24bf2e0_0 termcolor-1.1.0-py36_1 terminado-0.8.3-py36_0 testpath-0.4.4-py_0 tk-8.6.8-ha441bb4_0 tornado-6.0.4-py36h1de35cc_1 traitlets-4.3.3-py36_0 wcwidth-0.1.9-py_0 webencodings-0.5.1-py36_1 werkzeug-1.0.1-py_0 wheel-0.34.2-py36_0 widgetsnbextension-3.5.1-py36_0 xz-5.2.5-h1de35cc_0 zeromq-4.3.1-h0a44026_3 zipp-3.1.0-py_0 zlib-1.2.11-h1de35cc_3
  • 14. 14 Confidential and Proprietary. © 2020 Anaconda Environment rendering The primary output of the specification rendering process is an environment specification file—a simple text file of precise conda package specifications Additional rendering outputs: ● Conda metapackages ● Constructor installers ● conda-pack redistributables ● Hadoop parcels ● Docker images Leverage automation processes (e.g., Jenkins) for automatic building
  • 15. 15 Confidential and Proprietary. © 2020 Anaconda Versioning and archiving ● All rendered environments are versioned and archived ○ Ensures reproducibility of legacy models ● New projects should, by default, be pointed to the “latest” environment ○ Symbolic link: “environment-latest” -> “environment-2020.06.01” ● It should be easy to connect to recent historical environments ○ Ensures stability of longer-term model development ○ Exceptions made for environments pulled for vulnerability remediation ● For production, move off of “latest” to the corresponding version ○ Or to a fully specified custom environment ● A regular update cadence gives users predictability
  • 16. 16 Confidential and Proprietary. © 2020 Anaconda Distributing Conda Environments Constructor, Conda-Pack
  • 17. 17 Confidential and Proprietary. © 2020 Anaconda The conda package manager is GREAT at creating highly customized Python & R environments ● Dependency metadata ensures I get all the packages I need—even the ones I didn’t know I needed ● I can pin the package versions I care about as precisely as I want, and let conda give me the latest compatible versions of everything else Every data scientist can tailor their environment to precisely serve their needs Motivation
  • 18. 18 Confidential and Proprietary. © 2020 Anaconda But now that I have the perfect environment, how do I… ● Share it with my team members or even my entire department ● Distribute it to 100 different machines (e.g., Spark / Dask) ● Safely archive it so I can recover it, months or years later What tools are at my disposal? Motivation
  • 19. 19 Confidential and Proprietary. © 2020 Anaconda conda list --export > environment.txt conda create -n env_name --file environment.txt conda env export > env.yml conda env create -f env.yml Commands like these often do the job—until they don’t… ● What if the target machines don’t have conda installed? ● What if the recipient is a conda novice? ● What if the packages are no longer available in my repository? ● What if I’m building environments for air-gapped computers? Environment specs?
  • 20. 20 Confidential and Proprietary. © 2020 Anaconda Constructor and Conda-Pack provide two freely available, open source tools to bundle conda environments into sharable, transportable, archivable assets ● Constructor: user-friendly, custom installers similar to the Anaconda and Miniconda installers distributed by Anaconda ● Conda-Pack: simple, compact archives of environments for lower-level or automated approaches to distribution and management Addressing the challenge: two tools
  • 21. 21 Confidential and Proprietary. © 2020 Anaconda Constructor
  • 22. 22 Confidential and Proprietary. © 2020 Anaconda ● https://github.com/conda/constructor ● Builds custom installers for a valid conda environment ● Gives users the same installer experience they are already accustomed to ○ GUI installers for Mac and Windows ○ Shell installers for Linux and Mac ● Provides lots of customization options ○ Custom package sets ○ Conda configuration settings ○ Logos and branding Conda Constructor
  • 23. 23 Confidential and Proprietary. © 2020 Anaconda How it works ● Reads the construct.yaml file ● Calls conda in “dry run” mode to fully resolve environment specifications ● Downloads the necessary conda packages ● Combines the conda packages and install scripting into an OS-dependent executable installer format ○ Linux/Mac: POSIX-shell based installer ○ Windows: NSIS-based GUI installer ○ Mac: macOS standard GUI installer
  • 24. 24 Confidential and Proprietary. © 2020 Anaconda The results
  • 25. 25 Confidential and Proprietary. © 2020 Anaconda ● condarc: preinstall a custom configuration for conda upon install ○ channel_alias: point conda to an internal repository ○ default_channels : what does “defaults” mean? ○ ssl_verify: silence those pesky SSL issues ● channels_remap: maps build channels to install channels ○ Build an installer against one repository (e.g., Anaconda) for use in an internal environment connected to another repository (e.g., Team Edition, Artifactory, Nexus) ○ The package metadata is modified so that the installed packages appear to have come from the internal repository originally ● exclude: exclude certain packages from installation ○ readline: if you want to build a GPL-free installer ○ anaconda: removing the metapackage makes for more flexible customization by the user Advanced options
  • 26. 26 Confidential and Proprietary. © 2020 Anaconda name: Sortaconda version: 2020.10.01 installer_type: all channels_remap: - src: https://repo.anaconda.com/pkgs/main/ dst: https://repo.company.com/api/repo - src: https://repo.anaconda.com/pkgs/msys2/ # [win] dst: https://repo.company.com/api/repo/msys2/ # [win] specs: - python=3.6.10 - conda=4.8.4 - anaconda=2020.02 exclude: - anaconda condarc: channel_alias: https://repo.company.com/api/re po The construct.yaml file
  • 27. 27 Confidential and Proprietary. © 2020 Anaconda Conda-Pack
  • 28. 28 Confidential and Proprietary. © 2020 Anaconda ● https://github.com/conda/conda-pack ● Creates a simple, standard-format archive (.tar.gz, .zip, etc.) ● ...but… conda environments are not relocatable ○ Moving a conda environment to a different directory can render it inoperable ○ Conda employs special relocation logic that “adjusts” packages as they are installed so they operate correctly at the install location ● conda-pack solves this in one of two ways ○ Normal mode: it includes a script called conda-unpack that can be run after unpacking that reproduces conda’s relocation logic ○ Fixed destination mode: the archive is be “pre-adjusted” for the destination. It must be installed in that directory, but no post-install script is required ● new development: Cloudera parcel support Conda-Pack
  • 29. 29 Confidential and Proprietary. © 2020 Anaconda ● As simple as: conda-pack -n <env> ○ Produces a file <env>.tar.gz ● Common options: conda-pack -n <env> # or -p <path> --format <format> # tar, zip, tar.gz, … --output <filename> # <env>.<format> --dest-prefix <path> # for known destinations --exclude <pattern> # excludes files --include <pattern> # re-include files Calling convention
  • 30. 30 Confidential and Proprietary. © 2020 Anaconda ● File format nearly identical to standard conda-pack ● As simple as: conda-pack -n <env> --format parcel ● All parcel-specific options conda-pack -n <environment> --format parcel --parcel-name <name> # env name --parcel-version <version> # YYYY.MM.DD --parcel-distro <distro> # el7 --parcel-root <root> # /opt/cloudera/parcels ● In pre-release: conda install ctools/label/dev::conda-pack Parcel support
  • 31. 31 Confidential and Proprietary. © 2020 Anaconda Packing examples
  • 32. 32 Confidential and Proprietary. © 2020 Anaconda ● Deliver archive to destination machine ● Create the target directory ● Unpack the archive into the destination directory ● Activate: source <path>/bin/activate With a standard conda-pack archive (no --dest-prefix): ● Finish relocation: <path>/bin/conda-unpack That’s it! Environment is now fully usable in its new location Unpacking a conda-pack archive
  • 33. 33 Confidential and Proprietary. © 2020 Anaconda Unpacking example
  • 34. 34 Confidential and Proprietary. © 2020 Anaconda Conda, Docker, & OpenShift A brief look
  • 35. 35 Confidential and Proprietary. © 2020 Anaconda Building Docker containers for OpenShift ● Ensuring the application runs as any UID ○ Group writable (GID 0) ○ Use nss_wrapper for username setting if necessary ● Deliver / build the conda environment within the container ● Bake activation into the entrypoint Motivation
  • 36. 36 Confidential and Proprietary. © 2020 Anaconda Wrapping up
  • 37. 37 Confidential and Proprietary. © 2020 Anaconda ● Start getting to know conda if you haven’t already ● Check out constructor & conda-pack ○ https://github.com/conda/constructor ○ https://github.com/conda/conda-pack ● Grab my simple Docker demo ○ https://github.com/mcg1969/webinar-docker ● Connect with me on LinkedIn! ○ https://www.linkedin.com/in/mcgrant/ Thank you! Next steps
  • 38. 38 Confidential and Proprietary. © 2020 Anaconda Q & A
  • 40. About Anaconda About Anaconda With more than 20 million users, Anaconda is the world’s most popular data science platform and the foundation of modern machine learning. We pioneered the use of Python for data science, champion its vibrant community, and continue to steward open-source projects that make tomorrow’s innovations possible. Our enterprise-grade solutions enable corporate, research, and academic institutions around the world to harness the power of open-source for competitive advantage, groundbreaking research, and a better world. Visit https://www.anaconda.com to learn more. 40