Cloud Computing Was Built for Web Developers—What Does v2 Look Like for Deep Learning with Daniel Kobran

•

1 like•541 views

What we call the public cloud was developed primarily to manage and deploy web servers. The target audience for these products is Dev Ops. While this is a massive and exciting market, the world of Data Science and Deep Learning is very different — and possibly even bigger. Unfortunately, the tools available today are not designed for this new audience and the cloud needs to evolve. This talk would cover what the next 10 years of cloud computing will look like.

Data & Analytics

1 / 22
Paperspace
DO NOT DISTRIBUTE
Paperspace
www.paperspace.com
Serverless AI for the future of intelligence.

2 / 22
Deep Learning platform built for developers.
Infrastructure automation and software layer to build
intelligent applications.
Introduction

3 / 22
A new generation of AI
developers require a rethinking
of tooling and workflows.

4 / 22
Developers spend 75% of their time
managing infrastructure.
Why this matters

5 / 22
The cloud was built for a different use-
case (web servers) and a different
audience (DevOps).
So what’s the underlying problem?

6 / 22
Traditional Web Services Deep Learning
The DevOps ecosystem is rich
storage, CDN, deploy, monitor, VPC,
load balance, IPsec, CI/CD, DNS ...
data, notebooks, train, visualize,
collaborate, version, hyperparameters ...
?
+ 100s more
?
?
?
?
?
??

7 / 22
The key to solving this problem
is finding the right layer of
abstraction.

8 / 22
• BI
• Prediction
• Optimization
• Recommender systems
• Any heuristic
• GPUs
• Datastore
• Algorithms (CNNs, RNNs, ...)
• Frameworks (Pytorch,
TensorFlow, etc)
Put Uber/Facebook-grade
AI platform in the hands of every developer
InfrastructureBusiness Objective
There is a huge disconnect between modern business
objectives and the DL tools that can fulfill them.
Closing the Gap

9 / 22
Paperspace abstracts powerful
infrastructure behind a simple
software layer making cloud
ML as easy as modern web
services.

10 / 22
A complete platform for modern deep learning
Ingest → Train →
Analyze → Deploy
+
Manage, collaborate, share
• Fully-managed GPU infrastructure
• Unified dev experience
• 1 click Jupyter Notebooks/Lab
• API & language integrations
• ACL/team controls

11 / 22
GRAI° Model building AI orchestration fabric
• Job queuing / management
• Cloud agnostic
• Accelerator architecture native
(GPU, FPGA, ASIC, TPU, etc)
• Unified compute
• Extensible
• Built on best practices
(containers, kubernetes, and data
policies)
Bare-metal
Frameworks Tooling
TensorFlow
VPS Private cloud (VPC) Public Cloud
GRAI° AI orchestration fabric
PytorchKeras PythonJupyter
Data
Quilt
Job queuing Uniﬁed compute Container
deployment
Data
management
Encryption /
key managment

12 / 22
> import paperspace as ps
# Run job on GPU cluster
> ps({‘Type’: ‘TPU’, ‘container’: ‘TensorFlow’ ... })
Connecting modern ML and the cloud
by converting infrastructure into
code.
Raw compute is not sufficient.
Gradient Toolstack
GRAI Framework
Cloud Orchestration & Automation
Cloud Infra
Network . Storage . Compute
Cloudscale with a single line of code

14 / 22
Trends:
1. Chip renaissance
2. Evolution of ML/AI in practice
3. Consolidation around best practices
Remarks from the trenches

15 / 22
Chip renaissance
• Graphcore
• Cerebras
• Nervana
• Wave
• Google TPU
...
The big question today is whether
accelerator architectures will follow
commodity CPU x86 or lead to a
golden era for high-end, use-specific
hardware.

16 / 22
Consumable API → Refit the Model → Model as core IP
The evolution of ML/AI in practice
2016 2018
• Clarifai
• AWS Rekognition
• Google Cloud Vision
• MS cognitive services
• Paperspace
• Algorithmia
• FloydHub
• ClusterOne

17 / 22
• Containerization
• Jupyter
• Job runner architecture
• Pipeline
• etc.
Consolidation
around best
practices

Thank you.
Paperspace
20 Jay St. Suite 312
Brooklyn, NY 11201
hello@paperspace.com
www.paperspace.com
(718) 619 4325

What's hot

The explosion of data volume in the years to come challenge the idea of a centralized cloud infrastructure which handles all business needs. Edge computing comes to rescue by pushing the needs of computation and data analysis at the edge of the network, thus avoiding data exchange when makes sense. One of the areas where data exchange could impose a big overhead is scoring ML models especially where data to score are files like images eg. in a computer vision application. Another concern in some applications, is that of keeping data as private as possible and this is where keeping things local makes sense. In this talk we will discuss current needs and recent advances in model serving, like newly introduced formats for pushing models at the edge nodes eg. mobile phones and how a unified model serving architecture could cover current and future needs for both data scientists and data engineers. This architecture is based among others, on training models in a distributed fashion with TensorFlow and leveraging Spark for cleaning data before training (eg. using TensorFlow connector). Finally we will describe a microservice based approach for scoring models back at the cloud infrastructure side (where bandwidth can be high) eg. using TensorFlow serving and updating models remotely with a pull model approach for edge devices. We will talk also about implementing the proposed architecture and how that might look on a modern deployment environment eg. Kubernetes.

ML at the Edge: Building Your Production Pipeline with Apache Spark and Tens...

Databricks

Hadoop Summit EU 2013: Parallel Linear Regression, IterativeReduce, and YARN

Josh Patterson

In recent years, MLOps has emerged to bring DevOps processes to the machine learning (ML) development process, aiming at more automation in the execution of repetitive tasks and at smoother interoperability between tools. Among the different stages in the ML lifecycle, model monitoring involves the supervision of model performance over time, involving the combination of techniques in four categories: outlier detection, data drift detection, explainability and adversarial attacks. Most existing model monitoring tools follow a scheduled batch processing approach or analyse model performance using isolated subsets of the inference data. However, for the continuous monitoring of models, stream processing platforms show several advantages, including support for continuous data analytics, scalable processing of large amounts of data and first-class support for window-based aggregations useful for concept drift detection. In this talk, we present an open-source platform for serving and monitoring models at scale based on Kubeflow’s model serving framework, KFServing, the Hopsworks Online Feature Store for enriching feature vectors with transformer in KFServing, and Spark and Spark Streaming as general purpose frameworks for monitoring models in production. We also show how Spark Streaming can use the Hopsworks Feature Store to implement continuous data drift detection, where the Feature Store provides statistics on the distribution of feature values in training, and Spark Streaming computes the statistics on live traffic to the model, alerting if the live traffic differs significantly from the training data. We will include a live demonstration of the platform in action.

KFServing, Model Monitoring with Apache Spark and a Feature Store

Databricks

MLOps in action

Pieter de Bruin

ONNX and MLflow

amesar0

During the past 10 years, big-data storage layers mainly focus on analytical use cases. When it comes to analytical cases, users usually offload data onto Hadoop cluster and perform queries on HDFS files. People struggle dealing with modifications on append only storage and maintain fragile ETL pipelines. On the other hand, although Spark SQL has been proven effective parallel query processing engine, some tricks common in traditional databases are not available due to characteristics of storage underneath. TiSpark sits directly on top of a distributed database (TiDB)’s storage engine, expand Spark SQL’s planning with its own extensions and utilizes unique features of database storage engine to achieve functions not possible for Spark SQL on HDFS. With TiSpark, users are able to perform queries directly on changing / fresh data in real time. The takeaways from this two are twofold: — How to integrate Spark SQL with a distributed database engine and the benefit of it — How to leverage Spark SQL’s experimental methods to extend its capacity.

When Apache Spark Meets TiDB with Xiaoyu Ma

Databricks

Monitoring AI applications with AI The best performing offline algorithm can lose in production. The most accurate model does not always improve business metrics. Environment misconfiguration or upstream data pipeline inconsistency can silently kill the model performance. Neither prodops, data science or engineering teams are skilled to detect, monitor and debug such types of incidents. Was it possible for Microsoft to test Tay chatbot in advance and then monitor and adjust it continuously in production to prevent its unexpected behaviour? Real mission critical AI systems require advanced monitoring and testing ecosystem which enables continuous and reliable delivery of machine learning models and data pipelines into production. Common production incidents include: Data drifts, new data, wrong features Vulnerability issues, malicious users Concept drifts Model Degradation Biased Training set / training issue Performance issue In this demo based talk we discuss a solution, tooling and architecture that allows machine learning engineer to be involved in delivery phase and take ownership over deployment and monitoring of machine learning pipelines. It allows data scientists to safely deploy early results as end-to-end AI applications in a self serve mode without assistance from engineering and operations teams. It shifts experimentation and even training phases from offline datasets to live production and closes a feedback loop between research and production. Technical part of the talk will cover the following topics: Automatic Data Profiling Anomaly Detection Clustering of inputs and outputs of the model A/B Testing Service Mesh, Envoy Proxy, trafic shadowing Stateless and stateful models Monitoring of regression, classification and prediction models

Monitoring AI with AI

Stepan Pushkarev

This talk describes migrating a large random forest classifier from scikit-learn to Spark's MLlib. We cut training time from 2 days to 2 hours, reduced failed runs, and track experiments better with MLflow. Kount provides certainty in digital interactions like online credit card transactions. One of our scores uses a random forest classifier with 250 trees and 100,000 nodes per tree. We used scikit-learn to train using 60 million samples that each contained over 150 features. The in-memory requirements exceeded 750 GB, took 2 days, and were not robust to disruption in our database or training execution. To migrate workflow to Spark, we built a 6-node cluster with HDFS. This provides 1.35 TB of RAM and 484 cores. Using MLlib and parallelization, the training time for our random forests are now less than 2 hours. Training data stays in our production environment, which used to require a deploy cycle to move locally-developed code onto our training server. The new implementation uses Jupyter notebooks for remote development with server-side execution. MLflow tracks all input parameters, code, and git revision number, while the performance and model itself are retained as experiment artifacts. The new workflow is robust to service disruption. Our training pipeline begins by pulling from a Vertica database. Originally, this single connection took over 8 hours to complete with any problem causing a restart. Using sqoop and multiple connections, we pull the data in 45 minutes. The old technique used volatile storage and required the data for each experiment. Now, we pull the data from Vertica one time and then reload much faster from HDFS. While a significant undertaking, moving to the Spark ecosystem converted an ad hoc and hands-on training process into a fully repeatable pipeline that meets regulatory and business goals for traceability and speed. Speaker: Josh Johnston

Moving a Fraud-Fighting Random Forest from scikit-learn to Spark with MLlib, ...

Databricks

Machine learning is being deployed in a growing number of applications which demand real-time, accurate, and robust predictions under heavy serving loads. However, most machine learning frameworks and systems only address model training and not deployment. Clipper is an open-source, general-purpose model-serving system that addresses these challenges. Interposing between applications that consume predictions and the machine-learning models that produce predictions, Clipper simplifies the model deployment process by adopting a modular serving architecture and isolating models in their own containers, allowing them to be evaluated using the same runtime environment as that used during training. Clipper’s modular architecture provides simple mechanisms for scaling out models to meet increased throughput demands and performing fine-grained physical resource allocation for each model. Further, by abstracting models behind a uniform serving interface, Clipper allows developers to compose many machine-learning models within a single application to support increasingly common techniques such as ensemble methods, multi-armed bandit algorithms, and prediction cascades. In this talk I will provide an overview of the Clipper serving system and discuss how to get started using Clipper to serve Apache Spark and TensorFlow models on Kubernetes. I will then discuss some recent work on statistical performance monitoring for machine learning models.

Deploying and Monitoring Heterogeneous Machine Learning Applications with Cli...

Databricks

Speaker: Pierre Richemond, Data Science Institute of Imperial College Title: Cutting edge generative models: Applications and implications Abstract: This talk will examine recent developments in deep learning content generation at scale. Whether it be images or text, the latest methods have now reached a level of quality making it hard to discriminate between human- and AI-generated content. We will review recent examples of such generative models, and put their significance in a broader context, in light of such powerful tools’ potential for dual use. Bio: Pierre is currently researching his PhD in deep reinforcement learning at the Data Science Institute of Imperial College. He also teaches Deep Learning at the Graduate School, and helps to run the Deep Learning Network and organises thematic reading groups. His background is in mathematics - he has studied electrical engineering at ENST, probability theory and stochastic processes at Universite Paris VI - Ecole Polytechnique, and business management at HEC.

TensorFlow London: Cutting edge generative models

Seldon

Magdalena Stenius: MLOPS Will Change Machine Learning

Lviv Startup Club

"GOJEK, the Southeast Asian super-app, has seen an explosive growth in both users and data over the past three years. Today the technology startup uses big data powered machine learning to inform decision-making in its ride-hailing, lifestyle, logistics, food delivery, and payment products. From selecting the right driver to dispatch, to dynamically setting prices, to serving food recommendations, to forecasting real-world events. Hundreds of millions of orders per month, across 18 products, are all driven by machine learning. Building production grade machine learning systems at GOJEK wasn't always easy. Data processing and machine learning pipelines were brittle, long running, and had low reproducibility. Models and experiments were difficult to track, which led to downstream problems in production during serving and model evaluation. In this talk we will cover these and other challenges that we faced while trying to scale end-to-end machine learning systems at GOJEK. We will then introduce MLflow and explore the key features that make it useful as part of an ML platform. Finally, we will show how introducing MLflow into the ML life cycle has helped to solve many of the problems we faced while scaling machine learning at GOJEK. "

Scaling Ride-Hailing with Machine Learning on MLflow

Databricks

Productionizing Machine Learning with Apache Spark, MLflow and ONNX from the ...

Databricks

Advanced python

Novita Sari

Deep Learning for Natural Language Processing Using Apache Spark and TensorFl...

Databricks

Recommendations for Building Machine Learning Software: Building a real system that uses machine learning can be a difficult both in terms of the algorithmic and engineering challenges involved. In this talk, I will focus on the engineering side and discuss some of the practical lessons we’ve learned from years of developing the machine learning systems that power Netflix. I will go over what it takes to get machine learning working in a real-life feedback loop with our users and how that imposes different requirements and a different focus than doing machine learning only within a lab environment. This involves lessons around challenges such as where to place algorithmic components, how to handle distribution and parallelism, what kinds of modularity are useful, how to support both production experimentation, and how to test machine learning systems.

Justin Basilico, Research/ Engineering Manager at Netflix at MLconf SF - 11/1...

MLconf

A long time ago, there was Caffe and Theano, then came Torch and CNTK and Tensorflow, Keras and MXNet and Pytorch and Caffe2….a sea of Deep learning tools but none for Spark developers to dip into. Finally, there was BigDL, a deep learning library for Apache Spark. While BigDL is integrated into Spark and extends its capabilities to address the challenges of Big Data developers, will a library alone be enough to simplify and accelerate the deployment of ML/DL workloads on production clusters? From high level pipeline API support to feature transformers to pre-defined models and reference use cases, a rich repository of easy to use tools are now available with the ‘Analytics Zoo’. We’ll unpack the production challenges and opportunities with ML/DL on Spark and what the Zoo can do

Analytics Zoo: Building Analytics and AI Pipeline for Apache Spark and BigDL ...

Databricks

Building flexible machine learning libraries adapted for Netflix’s use cases is paramount in our continued efforts to better model our users’ behaviors and provide them great personalized video recommendations. This talk introduces one such spark-based stratification library developed at Netflix to aid “Training Set Stratification” in offline machine learning workflows. Originally created to implement user selection algorithms in our data snapshotting infrastructure, the library has evolved to cater to general-purpose stratification use cases in ML pipelines. We will talk about how using the stratification library’s DSL (domain specific language) and its underlying Spark based implementation, one can easily express complex sampling rules and dynamically carve out matching portions of a Spark dataframe. For example, arbitrary rules governing the distributions of user attributes (and combinations there of) such as origin country, video play frequency, tenure etc can be easily enforced when constructing a ML training data set. The demo section of the talk will showcase example usages of the stratification library in a Jupyter notebook.

Apache Spark-Based Stratification Library for Machine Learning Use Cases at N...

Databricks

My talk at Data Science Labs conference in Odessa. Training a model in Apache Spark while having it automatically available for real-time serving is an essential feature for end-to-end solutions. There is an option to export the model into PMML and then import it into a separated scoring engine. The idea of interoperability is great but it has multiple challenges, such as code duplication, limited extensibility, inconsistency, extra moving parts. In this talk we discussed an alternative solution that does not introduce custom model formats and new standards, not based on export/import workflow and shares Apache Spark API.

Spark ML Pipeline serving

Stepan Pushkarev

ML development brings many new complexities beyond the traditional software development lifecycle. Unlike in traditional software development, ML developers want to try multiple algorithms, tools and parameters to get the best results, and they need to track this information to reproduce work. In addition, developers need to use many distinct systems to productionize models. To address these problems, many companies are building custom “ML platforms” that automate this lifecycle, but these platforms are limited to each company’s internal infrastructure. In this talk, we will present MLflow, a new open source project from Databricks that aims to design an open ML platform where organizations can use any ML library and development tool of their choice to reliably build and share ML applications. MLflow introduces simple abstractions to package reproducible projects, track results, and encapsulate models that can be used with many existing tools, accelerating the ML lifecycle for organizations of any size.

MLflow: Infrastructure for a Complete Machine Learning Life Cycle

Databricks

What's hot (20)

ML at the Edge: Building Your Production Pipeline with Apache Spark and Tens...

Hadoop Summit EU 2013: Parallel Linear Regression, IterativeReduce, and YARN

KFServing, Model Monitoring with Apache Spark and a Feature Store

MLOps in action

ONNX and MLflow

When Apache Spark Meets TiDB with Xiaoyu Ma

Monitoring AI with AI

Moving a Fraud-Fighting Random Forest from scikit-learn to Spark with MLlib, ...

Deploying and Monitoring Heterogeneous Machine Learning Applications with Cli...

TensorFlow London: Cutting edge generative models

Magdalena Stenius: MLOPS Will Change Machine Learning

Scaling Ride-Hailing with Machine Learning on MLflow

Productionizing Machine Learning with Apache Spark, MLflow and ONNX from the ...

Advanced python

Deep Learning for Natural Language Processing Using Apache Spark and TensorFl...

Justin Basilico, Research/ Engineering Manager at Netflix at MLconf SF - 11/1...

Analytics Zoo: Building Analytics and AI Pipeline for Apache Spark and BigDL ...

Apache Spark-Based Stratification Library for Machine Learning Use Cases at N...

Spark ML Pipeline serving

MLflow: Infrastructure for a Complete Machine Learning Life Cycle

Similar to Cloud Computing Was Built for Web Developers—What Does v2 Look Like for Deep Learning with Daniel Kobran

infrastructure management at digital ages

Bernard Paques

Backend.AI Technical Introduction (19.09 / 2019 Autumn)

Lablup Inc.

Introduction to HPC & Supercomputing in AI

Tyrone Systems

Watch this talk here: https://www.confluent.io/online-talks/scaling-security-on-100s-of-millions-of-mobile-devices-using-kafka-and-scylla-on-demand Join mobile cybersecurity leader Lookout as they talk through their data ingestion journey. Lookout enables enterprises to protect their data by evaluating threats and risks at post-perimeter endpoint devices and providing access to corporate data after conditional security scans. Their continuous assessment of device health creates a massive amount of telemetry data, forcing new approaches to data ingestion. Learn how Lookout changed its approach in order to grow from 1.5 million devices to 100 million devices and beyond, by implementing Confluent Platform and switching to Scylla.

Scaling Security on 100s of Millions of Mobile Devices Using Apache Kafka® an...

confluent

High Performance Computing Pitch Deck

Nicholas Vossburg

Slide DevSecOps Microservices

Hendri Karisma

AWS vs Azure vs Google (GCP) - Slides

TobyWilman

Webinar Session - https://youtu.be/_5MfGMf8PG4 In this webinar, we share how the Container Attached Storage pattern makes performance tuning more tractable, by giving each workload its own storage system, thereby decreasing the variables needed to understand and tune performance. We then introduce MayaStor, a breakthrough in the use of containers and Kubernetes as a data plane. MayaStor is the first containerized data engine available that delivers near the theoretical maximum performance of underlying systems. MayaStor performance scales with the underlying hardware and has been shown, for example, to deliver in excess of 10 million IOPS in a particular environment.

Webinar: OpenEBS - Still Free and now FASTEST Kubernetes storage

MayaData Inc

Innovation with ai at scale on the edge vt sept 2019 v0

Ganesan Narayanasamy

.NET Cloud-Native Bootcamp- Los Angeles

VMware Tanzu

Drupal has been a consistent leader in the Gartner Magic Quadrant for Web Content Management. However, enterprises leveraging Drupal have traditionally relied on PaaS providers for their hosting, scaling and lifecycle management. And that usually leads to enterprise applications being locked-in with a particular cloud or vendor. As container and container orchestration technologies disrupt the cloud and platform landscape, there’s a clear way to avoid this state of affairs. In this webinar, we discuss why it's important to build a cloud-native Drupal platform, and exactly how to do that. Join the webinar to understand how you can avoid vendor lock-in, and create a secure platform to manage, operate and scale your Drupal applications in a multi-cloud portable manner. Key Takeaways: - Why you need a cloud-native Drupal platform and how to build one - How to craft an idiomatic development workflow - Understanding infrastructure and cloud engineering - under the hood - Demystifying the art and science of Docker and Kubernetes: deep dive into scaling the LAMP stack - Exploring cost optimization and cloud governance - Understand portability of applications - A hands-on demo of how the platform works

[Srijan Wednesday Webinars] How to Build a Cloud Native Platform for Enterpri...

Srijan Technologies

Cloud computing infrastructure

Dr. Anita Goel

sudoers: Benchmarking Hadoop with ALOJA

Nicolas Poggi

Slides built to upskill and enable internal team and/or partners on foundational infra skills to work in a containerized world. Topics covered - Container / Containerization - Docker - k8s / container orchestration - Microservices - Service Mesh / Serverless - Cloud Native (apps & infra) - Relationship between Kubernetes and Runtime Fabric Audiences: MuleSoft internal technical team, partners, Runtime Fabric users.

Introduction to containers, k8s, Microservices & Cloud Native

Terry Wang

The New Stack Container Summit Talk

The New Stack

Google’s TensorFlow is one of the most popular deep learning (DL) frameworks. In distributed TensorFlow, gradient updates are a critical step governing the total model training time. These updates incur a massive volume of data transfer over the network. In this talk, we first present a thorough analysis of the communication patterns in distributed TensorFlow. Then we propose a unified way of achieving high performance through enhancing the gRPC runtime with Remote Direct Memory Access (RDMA) technology on InfiniBand and RoCE. Through our proposed RDMA-gRPC design, TensorFlow only needs to run over the gRPC channel and gets the optimal performance. Our design includes advanced features such as message pipelining, message coalescing, zero-copy transmission, etc. The performance evaluations show that our proposed design can significantly speed up gRPC throughput by up to 1.5x compared to the default gRPC design. By integrating our RDMA-gRPC with TensorFlow, we are able to achieve up to 35% performance improvement for TensorFlow training with CNN models. Speakers Dhabaleswar K (DK) Panda, Professor and University Distinguished Scholar, The Ohio State University Xiaoyi Lu, Research Scientist, The Ohio State University

Accelerating TensorFlow with RDMA for high-performance deep learning

DataWorks Summit

Algorithmia is a startup with a mission to make state of the art machine learning discoverable by everyone&emdash;they offer the largest algorithm marketplace in the world, with over 2500 algorithms supporting tens of thousands of application developers. Algorithma is the first company to make deep learning, one of the most conceptually difficult areas of computing, accessible to any company via microservices. In this session, you learn how this startup has selected and optimized Amazon EC2 instances for various algorithms (including the latest generation of GPU optimized instances), to create a flexible and scalable platform. They also share their architecture and best practices for getting any computationally-intensive application started quickly.

AWS re:Invent 2016: Bringing Deep Learning to the Cloud with Amazon EC2 (CMP314)

Amazon Web Services

Public Cloud Workshop

Amer Ather

Hpc lunch and learn

John D Almon

High Performance Computing (HPC) is expected to be the single largest workload on Windows Azure. This session discusses how Windows HPC Server 2008 R2 SP2 enables our customers to easily run their HPC applications on Windows Azure. It covers different usage scenarios (“bursting” to Windows Azure vs. running everything in Windows Azure),differences between running HPC applications on-premise vs. in Azure,best practices,limitations,etc. Real-world customers and their scenarios are highlighted. The key points are illustrated with live demos of HPC applications running in Windows Azure. This session is a must for everyone who wants to know about HPC and Windows Azure.

Taking High Performance Computing to the Cloud: Windows HPC and

Saptak Sen

Similar to Cloud Computing Was Built for Web Developers—What Does v2 Look Like for Deep Learning with Daniel Kobran (20)

infrastructure management at digital ages

Backend.AI Technical Introduction (19.09 / 2019 Autumn)

Introduction to HPC & Supercomputing in AI

Scaling Security on 100s of Millions of Mobile Devices Using Apache Kafka® an...

High Performance Computing Pitch Deck

Slide DevSecOps Microservices

AWS vs Azure vs Google (GCP) - Slides

Webinar: OpenEBS - Still Free and now FASTEST Kubernetes storage

Innovation with ai at scale on the edge vt sept 2019 v0

.NET Cloud-Native Bootcamp- Los Angeles

[Srijan Wednesday Webinars] How to Build a Cloud Native Platform for Enterpri...

Cloud computing infrastructure

sudoers: Benchmarking Hadoop with ALOJA

Introduction to containers, k8s, Microservices & Cloud Native

The New Stack Container Summit Talk

Accelerating TensorFlow with RDMA for high-performance deep learning

AWS re:Invent 2016: Bringing Deep Learning to the Cloud with Amazon EC2 (CMP314)

Public Cloud Workshop

Hpc lunch and learn

Taking High Performance Computing to the Cloud: Windows HPC and

More from Databricks

DW Migration Webinar-March 2022.pptx

Databricks

The world of data architecture began with applications. Next came data warehouses. Then text was organized into a data warehouse. Then one day the world discovered a whole new kind of data that was being generated by organizations. The world found that machines generated data that could be transformed into valuable insights. This was the origin of what is today called the data lakehouse. The evolution of data architecture continues today. Come listen to industry experts describe this transformation of ordinary data into a data architecture that is invaluable to business. Simply put, organizations that take data architecture seriously are going to be at the forefront of business tomorrow. This is an educational event. Several of the authors of the book Building the Data Lakehouse will be presenting at this symposium.

Data Lakehouse Symposium | Day 1 | Part 1

Databricks

Data Lakehouse Symposium | Day 1 | Part 2

Databricks

Data Lakehouse Symposium | Day 2

Databricks

Data Lakehouse Symposium | Day 4

Databricks

In this session, learn how to quickly supplement your on-premises Hadoop environment with a simple, open, and collaborative cloud architecture that enables you to generate greater value with scaled application of analytics and AI on all your data. You will also learn five critical steps for a successful migration to the Databricks Lakehouse Platform along with the resources available to help you begin to re-skill your data teams.

5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop

Databricks

Bad data leads to bad decisions and broken customer experiences. Organizations depend on complete and accurate data to power their business, maintain efficiency, and uphold customer trust. With thousands of datasets and pipelines running, how do we ensure that all data meets quality standards, and that expectations are clear between producers and consumers? Investing in shared, flexible components and practices for monitoring data health is crucial for a complex data organization to rapidly and effectively scale. At Zillow, we built a centralized platform to meet our data quality needs across stakeholders. The platform is accessible to engineers, scientists, and analysts, and seamlessly integrates with existing data pipelines and data discovery tools. In this presentation, we will provide an overview of our platform’s capabilities, including: Giving producers and consumers the ability to define and view data quality expectations using a self-service onboarding portal Performing data quality validations using libraries built to work with spark Dynamically generating pipelines that can be abstracted away from users Flagging data that doesn’t meet quality standards at the earliest stage and giving producers the opportunity to resolve issues before use by downstream consumers Exposing data quality metrics alongside each dataset to provide producers and consumers with a comprehensive picture of health over time

Democratizing Data Quality Through a Centralized Platform

Databricks

Data scientists face numerous challenges throughout the data science workflow that hinder productivity. As organizations continue to become more data-driven, a collaborative environment is more critical than ever — one that provides easier access and visibility into the data, reports and dashboards built against the data, reproducibility, and insights uncovered within the data.. Join us to hear how Databricks’ open and collaborative platform simplifies data science by enabling you to run all types of analytics workloads, from data preparation to exploratory analysis and predictive analytics, at scale — all on one unified platform.

Learn to Use Databricks for Data Science

Databricks

Application performance monitoring (APM) has become the cornerstone of software engineering allowing engineering teams to quickly identify and remedy production issues. However, as the world moves to intelligent software applications that are built using machine learning, traditional APM quickly becomes insufficient to identify and remedy production issues encountered in these modern software applications. As a lead software engineer at NewRelic, my team built high-performance monitoring systems including Insights, Mobile, and SixthSense. As I transitioned to building ML Monitoring software, I found the architectural principles and design choices underlying APM to not be a good fit for this brand new world. In fact, blindly following APM designs led us down paths that would have been better left unexplored. In this talk, I draw upon my (and my team’s) experience building an ML Monitoring system from the ground up and deploying it on customer workloads running large-scale ML training with Spark as well as real-time inference systems. I will highlight how the key principles and architectural choices of APM don’t apply to ML monitoring. You’ll learn why, understand what ML Monitoring can successfully borrow from APM, and hear what is required to build a scalable, robust ML Monitoring architecture.

Why APM Is Not the Same As ML Monitoring

Databricks

Autonomy and ownership are core to working at Stitch Fix, particularly on the Algorithms team. We enable data scientists to deploy and operate their models independently, with minimal need for handoffs or gatekeeping. By writing a simple function and calling out to an intuitive API, data scientists can harness a suite of platform-provided tooling meant to make ML operations easy. In this talk, we will dive into the abstractions the Data Platform team has built to enable this. We will go over the interface data scientists use to specify a model and what that hooks into, including online deployment, batch execution on Spark, and metrics tracking and visualization.

The Function, the Context, and the Data—Enabling ML Ops at Stitch Fix

Databricks

In this talk, I will dive into the stage level scheduling feature added to Apache Spark 3.1. Stage level scheduling extends upon Project Hydrogen by improving big data ETL and AI integration and also enables multiple other use cases. It is beneficial any time the user wants to change container resources between stages in a single Apache Spark application, whether those resources are CPU, Memory or GPUs. One of the most popular use cases is enabling end-to-end scalable Deep Learning and AI to efficiently use GPU resources. In this type of use case, users read from a distributed file system, do data manipulation and filtering to get the data into a format that the Deep Learning algorithm needs for training or inference and then sends the data into a Deep Learning algorithm. Using stage level scheduling combined with accelerator aware scheduling enables users to seamlessly go from ETL to Deep Learning running on the GPU by adjusting the container requirements for different stages in Spark within the same application. This makes writing these applications easier and can help with hardware utilization and costs. There are other ETL use cases where users want to change CPU and memory resources between stages, for instance there is data skew or perhaps the data size is much larger in certain stages of the application. In this talk, I will go over the feature details, cluster requirements, the API and use cases. I will demo how the stage level scheduling API can be used by Horovod to seamlessly go from data preparation to training using the Tensorflow Keras API using GPUs. The talk will also touch on other new Apache Spark 3.1 functionality, such as pluggable caching, which can be used to enable faster dataframe access when operating from GPUs.

Stage Level Scheduling Improving Big Data and AI Integration

Databricks

In this talk, I would like to introduce an open-source tool built by our team that simplifies the data conversion from Apache Spark to deep learning frameworks. Imagine you have a large dataset, say 20 GBs, and you want to use it to train a TensorFlow model. Before feeding the data to the model, you need to clean and preprocess your data using Spark. Now you have your dataset in a Spark DataFrame. When it comes to the training part, you may have the problem: How can I convert my Spark DataFrame to some format recognized by my TensorFlow model? The existing data conversion process can be tedious. For example, to convert an Apache Spark DataFrame to a TensorFlow Dataset file format, you need to either save the Apache Spark DataFrame on a distributed filesystem in parquet format and load the converted data with third-party tools such as Petastorm, or save it directly in TFRecord files with spark-tensorflow-connector and load it back using TFRecordDataset. Both approaches take more than 20 lines of code to manage the intermediate data files, rely on different parsing syntax, and require extra attention for handling vector columns in the Spark DataFrames. In short, all these engineering frictions greatly reduced the data scientists’ productivity. The Databricks Machine Learning team contributed a new Spark Dataset Converter API to Petastorm to simplify these tedious data conversion process steps. With the new API, it takes a few lines of code to convert a Spark DataFrame to a TensorFlow Dataset or a PyTorch DataLoader with default parameters. In the talk, I will use an example to show how to use the Spark Dataset Converter to train a Tensorflow model and how simple it is to go from single-node training to distributed training on Databricks.

Simplify Data Conversion from Spark to TensorFlow and PyTorch

Databricks

There is no doubt Kubernetes has emerged as the next generation of cloud native infrastructure to support a wide variety of distributed workloads. Apache Spark has evolved to run both Machine Learning and large scale analytics workloads. There is growing interest in running Apache Spark natively on Kubernetes. By combining the flexibility of Kubernetes and scalable data processing with Apache Spark, you can run any data and machine pipelines on this infrastructure while effectively utilizing resources at disposal. In this talk, Rajesh Thallam and Sougata Biswas will share how to effectively run your Apache Spark applications on Google Kubernetes Engine (GKE) and Google Cloud Dataproc, orchestrate the data and machine learning pipelines with managed Apache Airflow on GKE (Google Cloud Composer). Following topics will be covered: – Understanding key traits of Apache Spark on Kubernetes- Things to know when running Apache Spark on Kubernetes such as autoscaling- Demonstrate running analytics pipelines on Apache Spark orchestrated with Apache Airflow on Kubernetes cluster.

Scaling your Data Pipelines with Apache Spark on Kubernetes

Databricks

Pipelines have become ubiquitous, as the need for stringing multiple functions to compose applications has gained adoption and popularity. Common pipeline abstractions such as “fit” and “transform” are even shared across divergent platforms such as Python Scikit-Learn and Apache Spark. Scaling pipelines at the level of simple functions is desirable for many AI applications, however is not directly supported by Ray’s parallelism primitives. In this talk, Raghu will describe a pipeline abstraction that takes advantage of Ray’s compute model to efficiently scale arbitrarily complex pipeline workflows. He will demonstrate how this abstraction cleanly unifies pipeline workflows across multiple platforms such as Scikit-Learn and Spark, and achieves nearly optimal scale-out parallelism on pipelined computations. Attendees will learn how pipelined workflows can be mapped to Ray’s compute model and how they can both unify and accelerate their pipelines with Ray.

Scaling and Unifying SciKit Learn and Apache Spark Pipelines

Databricks

In this talk about zipline, we will introduce a new type of windowing construct called a sawtooth window. We will describe various properties about sawtooth windows that we utilize to achieve online-offline consistency, while still maintaining high-throughput, low-read latency and tunable write latency for serving machine learning features.We will also talk about a simple deployment strategy for correcting feature drift – due operations that are not “abelian groups”, that operate over change data.

Sawtooth Windows for Feature Aggregations

Databricks

We want to present multiple anti patterns utilizing Redis in unconventional ways to get the maximum out of Apache Spark.All examples presented are tried and tested in production at Scale at Adobe. The most common integration is spark-redis which interfaces with Redis as a Dataframe backing Store or as an upstream for Structured Streaming. We deviate from the common use cases to explore where Redis can plug gaps while scaling out high throughput applications in Spark. Niche 1 : Long Running Spark Batch Job – Dispatch New Jobs by polling a Redis Queue · Why? o Custom queries on top a table; We load the data once and query N times · Why not Structured Streaming · Working Solution using Redis Niche 2 : Distributed Counters · Problems with Spark Accumulators · Utilize Redis Hashes as distributed counters · Precautions for retries and speculative execution · Pipelining to improve performance

Redis + Apache Spark = Swiss Army Knife Meets Kitchen Sink

Databricks

In the era of microservices, decentralized ML architectures and complex data pipelines, data quality has become a bigger challenge than ever. When data is involved in complex business processes and decisions, bad data can, and will, affect the bottom line. As a result, ensuring data quality across the entire ML pipeline is both costly, and cumbersome while data monitoring is often fragmented and performed ad hoc. To address these challenges, we built whylogs, an open source standard for data logging. It is a lightweight data profiling library that enables end-to-end data profiling across the entire software stack. The library implements a language and platform agnostic approach to data quality and data monitoring. It can work with different modes of data operations, including streaming, batch and IoT data. In this talk, we will provide an overview of the whylogs architecture, including its lightweight statistical data collection approach and various integrations. We will demonstrate how the whylogs integration with Apache Spark achieves large scale data profiling, and we will show how users can apply this integration into existing data and ML pipelines.

Re-imagine Data Monitoring with whylogs and Spark

Databricks

Machine learning (ML) models are typically part of prediction queries that consist of a data processing part (e.g., for joining, filtering, cleaning, featurization) and an ML part invoking one or more trained models. In this presentation, we identify significant and unexplored opportunities for optimization. To the best of our knowledge, this is the first effort to look at prediction queries holistically, optimizing across both the ML and SQL components. We will present Raven, an end-to-end optimizer for prediction queries. Raven relies on a unified intermediate representation that captures both data processing and ML operators in a single graph structure. This allows us to introduce optimization rules that (i) reduce unnecessary computations by passing information between the data processing and ML operators (ii) leverage operator transformations (e.g., turning a decision tree to a SQL expression or an equivalent neural network) to map operators to the right execution engine, and (iii) integrate compiler techniques to take advantage of the most efficient hardware backend (e.g., CPU, GPU) for each operator. We have implemented Raven as an extension to Spark’s Catalyst optimizer to enable the optimization of SparkSQL prediction queries. Our implementation also allows the optimization of prediction queries in SQL Server. As we will show, Raven is capable of improving prediction query performance on Apache Spark and SQL Server by up to 13.1x and 330x, respectively. For complex models, where GPU acceleration is beneficial, Raven provides up to 8x speedup compared to state-of-the-art systems. As part of the presentation, we will also give a demo showcasing Raven in action.

Raven: End-to-end Optimization of ML Prediction Queries

Databricks

Semantic segmentation is the classification of every pixel in an image/video. The segmentation partitions a digital image into multiple objects to simplify/change the representation of the image into something that is more meaningful and easier to analyze [1][2]. The technique has a wide variety of applications ranging from perception in autonomous driving scenarios to cancer cell segmentation for medical diagnosis. Exponential growth in the datasets that require such segmentation is driven by improvements in the accuracy and quality of the sensors generating the data extending to 3D point cloud data. This growth is further compounded by exponential advances in cloud technologies enabling the storage and compute available for such applications. The need for semantically segmented datasets is a key requirement to improve the accuracy of inference engines that are built upon them. Streamlining the accuracy and efficiency of these systems directly affects the value of the business outcome for organizations that are developing such functionalities as a part of their AI strategy. This presentation details workflows for labeling, preprocessing, modeling, and evaluating performance/accuracy. Scientists and engineers leverage domain-specific features/tools that support the entire workflow from labeling the ground truth, handling data from a wide variety of sources/formats, developing models and finally deploying these models. Users can scale their deployments optimally on GPU-based cloud infrastructure to build accelerated training and inference pipelines while working with big datasets. These environments are optimized for engineers to develop such functionality with ease and then scale against large datasets with Spark-based clusters on the cloud.

Processing Large Datasets for ADAS Applications using Apache Spark

Databricks

At Adobe Experience Platform, we ingest TBs of data every day and manage PBs of data for our customers as part of the Unified Profile Offering. At the heart of this is a bunch of complex ingestion of a mix of normalized and denormalized data with various linkage scenarios power by a central Identity Linking Graph. This helps power various marketing scenarios that are activated in multiple platforms and channels like email, advertisements etc. We will go over how we built a cost effective and scalable data pipeline using Apache Spark and Delta Lake and share our experiences. What are we storing? Multi Source – Multi Channel Problem Data Representation and Nested Schema Evolution Performance Trade Offs with Various formats Go over anti-patterns used (String FTW) Data Manipulation using UDFs Writer Worries and How to Wipe them Away Staging Tables FTW Datalake Replication Lag Tracking Performance Time!

Massive Data Processing in Adobe Using Delta Lake

Databricks

More from Databricks (20)

DW Migration Webinar-March 2022.pptx

Data Lakehouse Symposium | Day 1 | Part 1

Data Lakehouse Symposium | Day 1 | Part 2

Data Lakehouse Symposium | Day 2

Data Lakehouse Symposium | Day 4

5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop

Democratizing Data Quality Through a Centralized Platform

Learn to Use Databricks for Data Science

Why APM Is Not the Same As ML Monitoring

The Function, the Context, and the Data—Enabling ML Ops at Stitch Fix

Stage Level Scheduling Improving Big Data and AI Integration

Simplify Data Conversion from Spark to TensorFlow and PyTorch

Scaling your Data Pipelines with Apache Spark on Kubernetes

Scaling and Unifying SciKit Learn and Apache Spark Pipelines

Sawtooth Windows for Feature Aggregations

Redis + Apache Spark = Swiss Army Knife Meets Kitchen Sink

Re-imagine Data Monitoring with whylogs and Spark

Raven: End-to-end Optimization of ML Prediction Queries

Processing Large Datasets for ADAS Applications using Apache Spark

Massive Data Processing in Adobe Using Delta Lake

Recently uploaded

(NEHA) Call Girls Katra Call Now: 8617697112 Katra Escorts Booking Contact Details WhatsApp Chat: +91-8617697112 Katra Escort Service includes providing maximum physical satisfaction to their clients as well as engaging conversation that keeps your time enjoyable and entertaining. Plus, they look fabulously elegant, making an impression. Independent Escorts Katra understands the value of confidentiality and discretion; they will go the extra mile to meet your needs. Simply contact them via text messaging or through their online profiles; they'd be more than delighted to accommodate any request or arrange a romantic date or fun-filled night together. We provide:

(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7

Call Girls in Nagpur High Profile Call Girls

(Vivek)Call Us, 8448380779,Call girls in Delhi NCr – We Offer best in class call girls. escort Service At Affordable Price At low Rate with Space Night 8000 We Are One Of The Oldest Escort and Call girls Agencies in Delhi. You Will Find That Our Female Escorts Are Full Of Fun, Sexy And They Would Love Enjoy Your Company. We Have A Fantastic Selection Of Escort Ladies Available For In-Calls As Well As Out-Calls. Our Escorts Are Not Only Beautiful But All Have Great Personalities Making Them The Perfect Companion For Any Occasion. In-Call:- You Can Come At Our Place in Delhi Our place Which Is Very Clean Hygienic 100% safe Accommodation. Out-Call:- You have To Come Pick The Girl From My Place We Are Also Provide Door Step Services (Delhi Ncr, Noida, Gurgaon, Faridabad, Ghaziabad Note:- Pic Collectors Time Passers Bargainers Stay Away As We Respect The Value For Your Money Time And Expect The Same From You Hygienic:- Full Ac room And Clean Rooms Available In Hotel 24 * 7 Hourly In Delhi NCR More Details, With WhatsApp Number, +91-8448380779

BDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort Service

Delhi Call girls

Call me @ 9892124323 Cheap Rate Call Girls in Vashi with Real Photo 100% Secure

Pooja Nehwal

BigBuy dropshipping via API with DroFx.pptx

olyaivanovalion

Ashok Vihar Call Girls in Delhi (–9953330565) Escort Service In Delhi NCR PROVIDE 100% REAL GIRLS ALL ARE GIRLS LOOKING MODELS AND RAM MODELS ALL GIRLS” INDIAN , RUSSIAN ,KASMARI ,PUNJABI HOT GIRLS AND MATURED HOUSE WIFE BOOKING ONLY DECENT GUYS AND GENTLEMAN NO FAKE PERSON FREE HOME SERVICE IN CALL FULL AC ROOM SERVICE IN SOUTH DELHI Ultimate Destination for finding a High Profile Independent Escorts in Delhi.Gurgaon.Noida..!.Like You Feel 100% Real Girl Friend Experience. We are High Class Delhi Escort Agency offering quality services with discretion. We only offer services to gentlemen people. We have lots of girls working with us like students, Russian, models, house wife, and much More We Provide Short Time and Full Night Service Call ☎☎+91–9953330565 ❤꧂ • In Call and Out Call Service in Delhi NCR • 3* 5* 7* Hotels Service in Delhi NCR • 24 Hours Available in Delhi NCR • Indian, Russian, Punjabi, Kashmiri Escorts • Real Models, College Girls, House Wife, Also Available • Short Time and Full Time Service Available • Hygienic Full AC Neat and Clean Rooms Avail. In Hotel 24 hours • Daily New Escorts Staff Available • Minimum to Maximum Range Available. Location;- Delhi, Gurgaon, NCR, Noida, and All Over in Delhi Hotel and Home Services HOTEL SERVICE AVAILABLE :-REDDISSON BLU,ITC WELCOM DWARKA,HOTEL-JW MERRIOTT,HOLIDAY INN MAHIPALPUR AIROCTY,CROWNE PLAZA OKHALA,EROSH NEHRU PLACE,SURYAA KALKAJI,CROWEN PLAZA ROHINI,SHERATON PAHARGANJ,THE AMBIENC,VIVANTA,SURAJKUND,ASHOKA CONTINENTAL , LEELA CHANKYAPURI,_ALL 3* 5* 7* STARTS HOTEL SERVICE BOOKING CALL Call WHATSAPP Call ☎+91–9953330565❤꧂ NIGHT SHORT TIME BOTH ARE AVAILABLE

Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service

9953056974 Low Rate Call Girls In Saket, Delhi NCR

Mature dropshipping via API with DroFx.pptx

olyaivanovalion

VidaXL dropshipping via API with DroFx.pptx

olyaivanovalion

Gen AI on Enterprise Cloud Apache NiFi Milvus Apache Kafka Apache Flink Cloudera Machine Learning Cloudera DataFlow https://medium.com/@tspann/building-a-milvus-connector-for-nifi-34372cb3c7fa https://www.meetup.com/futureofdata-princeton/events/300737266/ https://lu.ma/q7pcfyjn?source=post_page-----34372cb3c7fa--------------------------------&tk=TTyakY If you're interested in working with Generative AI on the cloud, this virtual workshop is for you. Tim Spann from Cloudera and Yujian Tang from Zilliz will cover how you can implement your own GenAI workflows on the cloud at enterprise scale. 9:00 - 9:05: Intro 9:05 - 9:15: What is Milvus 9:15 - 9:25: Cloudera Development Platform 9:25 - 10:00: Demo Location https://www.youtube.com/watch?v=IfWIzKsoHnA https://github.com/tspannhw/SpeakerProfile https://www.linkedin.com/in/yujiantang/

Generative AI on Enterprise Cloud with NiFi and Milvus

Timothy Spann

Sampling (random) method and Non random.ppt

Dr. Soumendra Kumar Patra

Edukaciniai dropshipping via API with DroFx

olyaivanovalion

Delhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call Booking Contact Details :- WhatsApp Chat :- +91-9711199171 27-April-2024(SMW) Best Escorts Service in Delhi Call Us — 9711199171 —Are you Looking for Call Girls in Delhi then This's a perfect place for you. We brings Many Models and Independent Call girls who Can fulfill all your Sexual Desires by Their Complete package of sex Service and It's Absolutely safe and secure. Book Your One night Stand Call Girls : 9711199171 -SERVICES- Our Delhi Call Girls are fully cooperative and understand your needs and they Give you their complete package of Sex service like- Real girl friend experience, Lip Kiss, Lip Lock, Smooch, Sucking without Condom, Oral, Erotic Massage, Lap Dance, Threesome, 69 Licking, Sex in all Position, Anal Sex etc, -AVAILABLE GIRLS- We Bring Many Good looking Slim, Busty, Hot and Sexy Call Girls as per our client's Choice like Housewives, College girls, Russian girls, Muslim girls, Afghani girls, Bengali girls, Working girls, south Indian girls, Punjabi girls, Big Boobs Call Girls etc, -PAYMENT METHOD- C O D. If you Want to Book our Call girls Service in Delhi . We don,t ask anything in Advance, you Can simply pay to her Cash on Delivery or via any upi. In-Call: — You can reach at our Place in Delhi Our place Hotel and Flat Which Is Very Clean Hygiene And 100% safe Accommodation. Out-Call: — You Can pick up the Girl from my Place if not we Provide Door-Step Call Girls Delivery in Delhi. NOTE: — Pic Collectors Time Passers and Bargainers please Stay Away As We Respect The Value For Your Money Time And Expect The Same From You. OUR SERVICES RATE: – let you know the our Call girls price in Delhi are very affordable and Best rate in genuine market of Call girls. But as all you knows that Quality has comes with its own Price tag. One Shot — 5000/in call (time 1 hour), 6000/out call Two shot with one girl — 8000/in call (time 2 hour), 10000/out call Body to body massage with sex- 8000/in call (time 1 hour) Full night Service for one person– 12000/in call, 13000/out call (shot limit 3-4 shots) Full night Service for more than 1 person — please contact Us —9711199171 We are available 24*7 all days of the year. Call us — 9711199171 Thank you for Visiting.

Delhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call

shivangimorya083

CebaBaby dropshipping via API with DroFX.pptx

olyaivanovalion

Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore Escorts Service Booking Contact Details :- WhatsApp Chat :- +91-7737669865 2-May-2024(SMW) Call Girls In Model Towh Bangalore +91-7737669865 !! Best Woman Seeking Man Call Girls Service, Escorts Service in Home Hotel in Bangalore NCR 24 Hours Available Service Call Girls, Contact Us +91-7737669865 (Any Time. Any Where) Call Girls in Bangalore, Noida, Gurgaon, Ghaziabad,Sexy Indian Female Escorts Service Bangalore NCRWelcome To Bangalore Escorts Service – An All Over New Bangalore Very Sexy Hot Call Girls Agency Service Escorts In South BangaloreNCRBangalore’s No. 1 High Profile Independent Female Escorts Service. We Provide Good Quality Educated Profile At Very Regnebal Price 100% Safe And Original.We Are Provide Escorts Service All OYO Hotels ,3*,4*,5* Star Hotel And Home Flat, Apartment. Guest-House. Services In -Call And Out – Call Both Are Services Available. 24Hrs. Any Time Any Where. In All Over Bangalore Noida Gurgaon Ghaziabad Faridabad.More Information And Contact Profile Real Pic Visit Our Website City Wise Escorts Service Agency.Good Looking Cheap And Best Models Girls U Can Get Best Click On Link……Night Call Girls Now In Hotel Le Meridien Gurgaon Near Female Escort One Shot — 5000/in call (time 1 hour), 6000/out call Two shot with one girl — 8000/in call (time 2 hour), 10000/out call Body to body massage with sex- 8000/in call (time 1 hour) Full night Service for one person– 12000/in call, 13000/out call (shot limit 3-4 shots) Full night Service for more than 1 person — please contact Us —7737669865 We are available 24*7 all days of the year. Call us — 7737669865 Thank you for Visiting.

Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...

amitlee9823

Halmar dropshipping via API with DroFx

olyaivanovalion

Call Girls In Connaught Place Delhi Call or Whataap 🔝 9953056974 🔝Escorts provide 24×7 Available With Room TIMINGS 24 HOURS OPENS Booking Now Gentleman Only:-Call Now Best High Class Normal Call Girls Escorts Service In Delhi NCR 24-7 Hours Available Service I, provide In Delhi NCR Female Escorts Sex Service 100% Customers Satisfaction Guarantee VIP Profiles Top Grade Service 100% Cooperative All round Service 🔝 9953056974 🔝 InCall: – You Can Reach At Our Place in Delhi Our place Which Is Very Clean Hygienic 100% safe Accommodation OutCall: – Service For Out Call You have To Come Pick The Girl From My Place We Also Provide Door Step Services Note: – Pic Collectors Time Passers Bargainers Stay Away As We Respect The Value For Your Money Time And Expect The Same From You 🔝 9953056974 🔝 Hygienic: – Full Ac Neat And Clean Rooms Available In Hotel 24 * 7 Hrs In Delhi Ncr 🔝 9953056974 🔝 Place: – South Extension Nehru Place Saket Malviya Nagar Munirka Vasant Kunj Safdarjung Katwaria Sarai Lajpat Nagar Kalkaji Hauz Khas Mahipalpur Dwarka Karol Bagh Noida Gurgaon Faridabad All Outcall Only Hotel Service In Delhi Ncr 🔝 9953056974 🔝 We Are Providing : – House Wife’s : – Private Independent House Wife’ : – Private Independent Collage Going Girls : – Corporate MNC Working Profiles : – Call Center Girls: – Live Band Girls : – Foreigners Many More: – Independent Models Service type For Pics And Other Details Pls Whatsapp Me Otherwise Call Me Any Time Incall Outcall Both Are Services Available Door Step, home, Apartment, Guest House, Flate, All Star Hotel Available 99530 vip 56974 THANKS FOR VISITING Booking 24×7 HRS

Delhi 99530 vip 56974 Genuine Escort Service Call Girls in Kishangarh

9953056974 Low Rate Call Girls In Saket, Delhi NCR

Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore Booking Contact Details :- WhatsApp Chat :- +91-7737669865 2-May-2024(SMW) Call Girls In Model Towh Bangalore +91-7737669865 !! Best Woman Seeking Man Call Girls Service, Escorts Service in Home Hotel in Bangalore NCR 24 Hours Available Service Call Girls, Contact Us +91-7737669865 (Any Time. Any Where) Call Girls in Bangalore, Noida, Gurgaon, Ghaziabad,Sexy Indian Female Escorts Service Bangalore NCRWelcome To Bangalore Escorts Service – An All Over New Bangalore Very Sexy Hot Call Girls Agency Service Escorts In South BangaloreNCRBangalore’s No. 1 High Profile Independent Female Escorts Service. We Provide Good Quality Educated Profile At Very Regnebal Price 100% Safe And Original.We Are Provide Escorts Service All OYO Hotels ,3*,4*,5* Star Hotel And Home Flat, Apartment. Guest-House. Services In -Call And Out – Call Both Are Services Available. 24Hrs. Any Time Any Where. In All Over Bangalore Noida Gurgaon Ghaziabad Faridabad.More Information And Contact Profile Real Pic Visit Our Website City Wise Escorts Service Agency.Good Looking Cheap And Best Models Girls U Can Get Best Click On Link……Night Call Girls Now In Hotel Le Meridien Gurgaon Near Female Escort One Shot — 5000/in call (time 1 hour), 6000/out call Two shot with one girl — 8000/in call (time 2 hour), 10000/out call Body to body massage with sex- 8000/in call (time 1 hour) Full night Service for one person– 12000/in call, 13000/out call (shot limit 3-4 shots) Full night Service for more than 1 person — please contact Us —7737669865 We are available 24*7 all days of the year. Call us — 7737669865 Thank you for Visiting.

Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...

amitlee9823

Discover Why Less is More in B2B Research

michael115558

Call Girl In Dwarka ☎92055#41914 ¶¶ Indian,Russian Best Quality full Educated And Full Cooperative Independent Call Girls Escort Services In New Delhi- I Have Extremely Beautiful Broad Minded Cute Sexy & Hot Call Girls and Escorts, We Are Located in 3* 4* 5* Hotels in Delhi. Safe & Secure High Class Services Affordable Rate 100% Satisfaction, Unlimited Enjoyment. Any Time for Model/Teens Escort in Delhi High class luxury and premium escorts agency Indian Russian Call Girls In Delhi Booking Good High Profile Escorts (Call Girls) In Delhi 5 Star Hotel ,Incall Service,OutCall Service, We provide services by Call Girls,College Girls,Modals Get High Profile queens,Well Educated,Good Looking,Full Cooperative Model, Russian Models,Punjabi Girls Kashmeri Girls Services etc… We Provide Hottest Female With Safe And Consensual With Most Limits Respected Complete Satisfaction Guaranteed…Service. Call Me Spacial For Including Incall//outcall Service In New Delhi Indian Russian Escorts Service

Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...

Delhi Call girls

Midocean dropshipping via API with DroFx

olyaivanovalion

Unlock the Secrets of Discriminative Models: Master the Art of Prediction! 🌟 Dive into our latest presentation where we simplify the complex world of machine learning. Discover how discriminative models, from Logistic Regression to Neural Networks, optimize decision-making by focusing on the relationships between observed features and outcomes. Perfect for beginners and experts alike! 🚀 #MachineLearning #DataScience #AI #PredictiveAnalytics #100ConceptsOfAIwithAnupamaK

100-Concepts-of-AI by Anupama Kate .pptx

Anupama Kate

Recently uploaded (20)

(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7

BDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort Service

Call me @ 9892124323 Cheap Rate Call Girls in Vashi with Real Photo 100% Secure

BigBuy dropshipping via API with DroFx.pptx

Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service

Mature dropshipping via API with DroFx.pptx

VidaXL dropshipping via API with DroFx.pptx

Generative AI on Enterprise Cloud with NiFi and Milvus

Sampling (random) method and Non random.ppt

Edukaciniai dropshipping via API with DroFx

Delhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call

CebaBaby dropshipping via API with DroFX.pptx

Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...

Halmar dropshipping via API with DroFx

Delhi 99530 vip 56974 Genuine Escort Service Call Girls in Kishangarh

Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...

Discover Why Less is More in B2B Research

Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...

Midocean dropshipping via API with DroFx

100-Concepts-of-AI by Anupama Kate .pptx

Cloud Computing Was Built for Web Developers—What Does v2 Look Like for Deep Learning with Daniel Kobran

1. 1 / 22 Paperspace DO NOT DISTRIBUTE Paperspace www.paperspace.com Serverless AI for the future of intelligence.

2. 2 / 22 Deep Learning platform built for developers. Infrastructure automation and software layer to build intelligent applications. Introduction

3. 3 / 22 A new generation of AI developers require a rethinking of tooling and workflows.

4. 4 / 22 Developers spend 75% of their time managing infrastructure. Why this matters

5. 5 / 22 The cloud was built for a different use- case (web servers) and a different audience (DevOps). So what’s the underlying problem?

6. 6 / 22 Traditional Web Services Deep Learning The DevOps ecosystem is rich storage, CDN, deploy, monitor, VPC, load balance, IPsec, CI/CD, DNS ... data, notebooks, train, visualize, collaborate, version, hyperparameters ... ? + 100s more ? ? ? ? ? ??

7. 7 / 22 The key to solving this problem is finding the right layer of abstraction.

8. 8 / 22 • BI • Prediction • Optimization • Recommender systems • Any heuristic • GPUs • Datastore • Algorithms (CNNs, RNNs, ...) • Frameworks (Pytorch, TensorFlow, etc) Put Uber/Facebook-grade AI platform in the hands of every developer InfrastructureBusiness Objective There is a huge disconnect between modern business objectives and the DL tools that can fulfill them. Closing the Gap

9. 9 / 22 Paperspace abstracts powerful infrastructure behind a simple software layer making cloud ML as easy as modern web services.

10. 10 / 22 A complete platform for modern deep learning Ingest → Train → Analyze → Deploy + Manage, collaborate, share • Fully-managed GPU infrastructure • Unified dev experience • 1 click Jupyter Notebooks/Lab • API & language integrations • ACL/team controls

11. 11 / 22 GRAI° Model building AI orchestration fabric • Job queuing / management • Cloud agnostic • Accelerator architecture native (GPU, FPGA, ASIC, TPU, etc) • Unified compute • Extensible • Built on best practices (containers, kubernetes, and data policies) Bare-metal Frameworks Tooling TensorFlow VPS Private cloud (VPC) Public Cloud GRAI° AI orchestration fabric PytorchKeras PythonJupyter Data Quilt Job queuing Uniﬁed compute Container deployment Data management Encryption / key managment

12. 12 / 22 > import paperspace as ps # Run job on GPU cluster > ps({‘Type’: ‘TPU’, ‘container’: ‘TensorFlow’ ... }) Connecting modern ML and the cloud by converting infrastructure into code. Raw compute is not sufficient. Gradient Toolstack GRAI Framework Cloud Orchestration & Automation Cloud Infra Network . Storage . Compute Cloudscale with a single line of code

13. 13 / 22 The Pipeline

14. 14 / 22 Trends: 1. Chip renaissance 2. Evolution of ML/AI in practice 3. Consolidation around best practices Remarks from the trenches

15. 15 / 22 Chip renaissance • Graphcore • Cerebras • Nervana • Wave • Google TPU ... The big question today is whether accelerator architectures will follow commodity CPU x86 or lead to a golden era for high-end, use-specific hardware.

16. 16 / 22 Consumable API → Refit the Model → Model as core IP The evolution of ML/AI in practice 2016 2018 • Clarifai • AWS Rekognition • Google Cloud Vision • MS cognitive services • Paperspace • Algorithmia • FloydHub • ClusterOne

17. 17 / 22 • Containerization • Jupyter • Job runner architecture • Pipeline • etc. Consolidation around best practices

18. Thank you. Paperspace 20 Jay St. Suite 312 Brooklyn, NY 11201 hello@paperspace.com www.paperspace.com (718) 619 4325

Cloud Computing Was Built for Web Developers—What Does v2 Look Like for Deep Learning with Daniel Kobran

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Cloud Computing Was Built for Web Developers—What Does v2 Look Like for Deep Learning with Daniel Kobran

Similar to Cloud Computing Was Built for Web Developers—What Does v2 Look Like for Deep Learning with Daniel Kobran (20)

More from Databricks

More from Databricks (20)

Recently uploaded

Recently uploaded (20)

Cloud Computing Was Built for Web Developers—What Does v2 Look Like for Deep Learning with Daniel Kobran