Productionizing Data Science at Experience

•

1 gefällt mir•366 views

Matt Mills

A Startup's (Ongoing) Journey building Machine Learning Products

Software

Agenda
• Intro
• Setting the Scene
• Proposed Pipeline
• A Look Back

Who am I?
• Matt Mills
• Born and raised in Atlanta
• BS in Industrial and Systems Engineering 2014, MS in Analytics 2015
• @statmills or www.statmills.com

Experience's mobile commerce, ticketing, and data
solutions empower sports and entertainment
leaders to generate new revenue streams, sell more
tickets, and make smarter decisions.
www.expapp.com/solutions
What is Experience?

Data Science at the end of 2016
• ~13 Engineers and 1 (me!) Data Scientist

Data Science at the end of 2016
• ~13 Engineers and 1 (me!) Data Scientist
• What happens to my work?

Data Science at the end of 2016
• ~13 Engineers and 1 (me!) Data Scientist
• What happens to my work?
Manager /
Management
Other
Departments
Partners

Goal for 2017
• Make an Impact on our Customers (Fans)
Inﬂuence
Fan
Behavior
Manager /
Management
Other
Departments
Partners

Goal for 2017
• Make an Impact on our Customers (Fans)
Predictive
Model
Inﬂuence
Fan
Behavior
Manager /
Management
Other
Departments
Partners

Goal for 2017: Continued
• Create a process to deploy models into production and use
predictions in real time

Goal for 2017: Continued
• Create a process to deploy models into production and use
predictions in real time
• Some considerations
• Minimal use of limited Engineering Resources
• Scalable (speed and processing power)
• Cheap, like, super cheap (read: Free)
• Had to handle data cleansing

Some Potential Solutions
• Build own R/Python Server

Some Potential Solutions
• Build own R/Python Server
• Learn Scala/Spark

Some Potential Solutions
• Build own R/Python Server
• Learn Scala/Spark
• Pay for ML Service

Scaling Experience Data Science with h2o
• ML Algorithms written in pure Java
• APIs written for R, Python, Scala, Spark
• Built for scale
• parallel and distributed out of the box
• Open Source

h2o Architecture
https://github.com/h2oai/h2o-meetups/blob/master/2017_09_12_Dublin/
2017_09_12_H2O_Intro_and_AutoML.pdf

h2o vs scikit-learn Syntax and Process
https://github.com/h2oai/h2o-meetups/blob/master/2015_05_14_H2O_Overview/H2O_Overview.pdf

Experience Predictive Modeling Pipeline
1. App Sends Data
2. Data Cleaning in Python 3. Predictions done in h2o
4. App Gets Prediction
input()
sys.stdout.ﬂush()
{JSON}

Model Deployment
Code
Pulled via Github
Terraform
to create infrastructure
and manage state
Served
via ECS
Dockerize
via Dockerﬁle and
stored in ECR
Discovery
via Consul

Pros and Cons of Current Set-Up
Pros
• Automated process to deploy
models into production
• Can iterate models with no/limited
effort from engineering
Cons
• Can only use algorithms available
to h2o (e.g. no multilevel models,
GAMs, Bayesian)
• h2o drives Python, why not the
other way around?

Conclusion and Questions
1. Lack of skills and/or support doesn’t have to stop you from putting models
into production
2. What’s best for your Data Scientists might not be best for your Engineers
and vice-versa

Weitere ähnliche Inhalte

Was ist angesagt?

What users expect from web applications today differs dramatically from what was available 5 years ago. They are used to interactivity, data persistence, and what’s more, the ability to share live collaboration experiences, like in Google Docs. If one user changes the data, other users want to see the changes immediately on their screens. They don’t care whether it is a data-exploration app from a data scientist or a solution built by a team of software engineers. Shiny is perfect for building interactive data-driven applications suited for the modern user. In this presentation, we show how to create real-time collaboration experience in Shiny apps. From the presentation, you will learn the concepts of reactive databases, how to use them in Shiny, and how to adapt existing components to provide live collaboration. We will present a package we developed for that. shiny.collections adds persistent reactive collections that can be effortlessly integrated with components like Shiny inputs, DT data table or rhandsontable. The package makes it easy to build collaborative Shiny applications with persistent data.

Shiny.collections - Google Docs-like live collaboration in Shiny!

Marek Rogala

Google Charts for native Android apps

Chuck Greb

Introduction to graphQL

Muhilvarnan V

Webinar: BI Mobile with SpagoBI: be aware everywhere!

SpagoWorld

HP ships millions of PCs, printers and other devices every year to customers in all market segments. Many of these systems have had various generations of data collection and reporting, going back as many as 16 years. That has led to a significant sprawl of custom data formats, specialized code and numerous brittle legacy systems collecting, analyzing and reporting data. This session will focus on samples of HP’s journey to find, catalog and ultimately eliminate these systems by migrating to Apache Spark with Databricks in the cloud. Hear about HP’s challenges dealing with legacy systems (some even located under engineers desks) and how the power of AWS, Spark, and visualization tools has significantly simplified their migrations. You’ll also learn how the success of this endeavor is not just in counting the number of systems deprecated, but also how the process is evolving into building companywide shared Spark libraries, notebooks and web services that are accelerating future migrations and analysis using Spark.

Herding Cats: Migrating Dozens of Oddball Analytics Systems to Apache Spark w...

Databricks

Massive Streaming Analytics with Spark Streaming

Paolo Platter

2018-10-23 3C - Lean, Scrum and low code approach of SharePoint and O365 proj...

aOS Community

DevOpsDays Amsterdam 2016 workshop

Arnold Van Wijnbergen

Enjoy the webinar recording here: https://youtu.be/Lll1qwQJKVw. Driverless AI speeds up data science workflows by automating feature engineering, model tuning, ensembling, and model deployment. In this presentation, Arno Candel (CTO, H2O.ai), gives a quick overview and guide attendees through an interactive hands-on lab using Qwiklabs. Driverless AI turns Kaggle-winning recipes into production-ready code and is specifically designed to avoid common mistakes such as under or overfitting, data leakage or improper model validation. Avoiding these pitfalls alone can save weeks or more for each model, and is necessary to achieve high modeling accuracy. With Driverless AI, everyone can now train and deploy modeling pipelines with just a few clicks from the GUI. Advanced users can use the client/server API through a variety of languages such as Python, Java, C++, go, C# and many more. To speed up training, Driverless AI uses highly optimized C++/CUDA algorithms to take full advantage of the latest compute hardware. For example, Driverless AI runs orders of magnitudes faster on the latest Nvidia GPU supercomputers on Intel and IBM platforms, both in the cloud or on-premise. There are two more product innovations in Driverless AI: statistically rigorous automatic data visualization and interactive model interpretation with reason codes and explanations in plain English. Both help data scientists and analysts to quickly validate the data and models.

Driverless AI - Intro + Interactive Hands-on Lab

Sri Ambati

Hyc program 17.10

Marek Nawa

[Jira Day 2018] PPM: The Tempo Story

Deviniti

GraphQL Advanced

LeanIX GmbH

Art of K2 Overview

Jeffry Belnap

apidays LIVE Paris 2021 - Building an analytics API by David Wobrock, Botify

apidays

Webinar: Free inquiry and Ad hoc reporting with SpagoBI

SpagoWorld

Speaker: Pooja Rallabhandi, Software Engineer, Ticketmaster Apache Kafka® is a high-performance distributed streaming platform. It is a scalable publish-subscribe messaging system that helps in building real-time applications with simple data pipelines that transform and react to the incoming streams of data. Over the past years, big data companies have struggled with low-latency ingestion of large volumes of event data and the demand to be continuously reactive as the data arrives. Existing message queues are not an ideal solution when applications require high throughput and a fault-tolerant, publish-subscribe messaging system. Kafka provides a platform for developing applications that react to streams of data to do real-time analytics, transform, aggregate real-time data flows, and perform complex event processing. In this session, my aim is to introduce the basic concepts of Kafka and Kafka Streams, and provide use cases where Kafka has proven to be a better solution for building event-driven applications. Pooja Rallabhandi is a software engineer at Ticketmaster specializing In web application and stream-based application development. Pooja is a big fan of Kafka and loves to provide optimized solutions for event-driven applications using Kafka Streams. She has completed her Masters in software engineering at Arizona State University. Pooja is passionate about connecting with women in technology and build stronger relationships that can help support learning and growth. In her leisure time, she loves visiting new places, hiking, and playing badminton. https://www.meetup.com/Kafka-Phoenix/events/260345584/

Introduction to Kafka Streams

confluent

Get Started with Driverless AI Recipes - Hands-on Training

Sri Ambati

AI and Machine Learning have become must-haves for almost all industries and companies. H2O.ai's goal is to help companies all over the world to use Machine Learning. H2O.ai's opensource toolset, which includes packages R, Python and Spark, starts from offering products which can accelerate the data preparation, then help with ML model building and finally make the deployment easier and platform agnostic!

H2o.ai presentation at 2nd Virtual Pydata Piraeus meetup

PyData Piraeus

Fifth elephant 2017 Data Pipeline workshop

Ketan Khairnar

apidays LIVE Paris 2021 - Localizing OpenAPI Specification by Olga Baybakova,...

apidays

Was ist angesagt? (20)

Shiny.collections - Google Docs-like live collaboration in Shiny!

Google Charts for native Android apps

Introduction to graphQL

Webinar: BI Mobile with SpagoBI: be aware everywhere!

Herding Cats: Migrating Dozens of Oddball Analytics Systems to Apache Spark w...

Massive Streaming Analytics with Spark Streaming

2018-10-23 3C - Lean, Scrum and low code approach of SharePoint and O365 proj...

DevOpsDays Amsterdam 2016 workshop

Driverless AI - Intro + Interactive Hands-on Lab

Hyc program 17.10

[Jira Day 2018] PPM: The Tempo Story

GraphQL Advanced

Art of K2 Overview

apidays LIVE Paris 2021 - Building an analytics API by David Wobrock, Botify

Webinar: Free inquiry and Ad hoc reporting with SpagoBI

Introduction to Kafka Streams

Get Started with Driverless AI Recipes - Hands-on Training

H2o.ai presentation at 2nd Virtual Pydata Piraeus meetup

Fifth elephant 2017 Data Pipeline workshop

apidays LIVE Paris 2021 - Localizing OpenAPI Specification by Olga Baybakova,...

Ähnlich wie Productionizing Data Science at Experience

Machine learning applications are typically stitched together from hopes and dreams, shell scripts, cron jobs, home-grown schedulers, snippets of configuration clipped from multiple blog posts, thousands of hard-coded business rules, a.k.a. "our SQL corpus," and a few lines of training and testing code. Organizing all the moving parts into something maintainable and supportive of ongoing development is a challenge most teams have on their TODO list, roadmap, or tech debt pile. Getting ahead of the day-to-day demands and settling into a sane architecture often seems like an unattainable goal. The past several years have seen an explosion of tool-building in the data engineering and analytics area, including in Apache projects spanning the areas of search and information retrieval, job orchestration, file and stream formats, and machine learning libraries. In this talk we will cover our product and development teams' choices of architecture and tools, from data ingestion and storage, through transformations and processing, to presentation of results and publishing to web services, reports, and applications.

Maintainable Machine Learning Products

Andrew Musselman

SPSNYC2019 - What is Common Data Model and how to use it?

Nicolas Georgeault

Deploying machine learning models seems like it should be a relatively easy task. Take your model and pass it some features in production. The reality is that the code written during the prototyping phase of model development doesn’t always work when applied at scale or on “real” data. This talk will explore 1) common problems at the intersection of data science and data engineering 2) how you can structure your code so there is minimal friction between prototyping and production, and 3) how you can use Apache Spark to run predictions on your models in batch or streaming contexts. You will take away how to address some of productionizing issues that data scientists and data engineers face while deploying machine learning models at scale and a better understanding of how to work collaboratively to minimize disparity between prototyping and productizing.

Deploying Python Machine Learning Models with Apache Spark with Brandon Hamri...

Databricks

Intro to Machine Learning with H2O and AWS

Sri Ambati

Building Business Applications in Office 365 SharePoint Online Using Logic Apps

Prashant G Bhoyar (Microsoft MVP)

2015 Data Science Summit @ dato Review

Hang Li

DevOps for DataScience

Stepan Pushkarev

The main objective of this workshop is to give the audience hands on experience with several Hadoop technologies and jump start their hadoop journey. In this workshop, you will load data and submit queries using Hadoop! Before jumping in to the technology, the Founders of DataKitchen review Hadoop and some of its technologies (MapReduce, Hive, Pig, Impala and Spark), look at performance, and present a rubric for choosing which technology to use when. NOTE: To complete hands on poriton in the time allotted, attendees should come with a newly created AWS (Amazon Web Services) Account and complete the other prerequisites found in the DataKitchen blog <http: />.

Open Data Science Conference Big Data Infrastructure – Introduction to Hadoop...

DataKitchen

PWR 106 Business Process Automation for SharePoint

William Huneycutt, II

End-to-End Data Pipelines with Apache Spark

Burak Yavuz

KTern.AI-SAP-DXaaS-Workshop-PLAN

KTern.AI

Your Roadmap for An Enterprise Graph Strategy

Neo4j

SharePoint 2013 Dev Features

Ricardo Wilkins

Searching for SharePoint Analytics

Jeff Fried

Interested in learning how Showtime is leveraging the power of Spark to transform a traditional premium cable network into a data-savvy analytical competitor? The growth in our over-the-top (OTT) streaming subscription business has led to an abundance of user-level data not previously available. To capitalize on this opportunity, we have been building and evolving our unified platform which allows data scientists and business analysts to tap into this rich behavioral data to support our business goals. We will share how our small team of data scientists is creating meaningful features which capture the nuanced relationships between users and content; productionizing machine learning models; and leveraging MLflow to optimize the runtime of our pipelines, track the accuracy of our models, and log the quality of our data over time. From data wrangling and exploration to machine learning and automation, we are augmenting our data supply chain by constantly rolling out new capabilities and analytical products to help the organization better understand our subscribers, our content, and our path forward to a data-driven future. Authors: Josh McNutt, Keria Bermudez-Hernandez

Data-Driven Transformation: Leveraging Big Data at Showtime with Apache Spark

Databricks

ABSTRACT: Due to recent advances in technology, humanity is collecting vast amounts of data at an unprecedented rate, making the skills necessary to mine insights from this data increasingly valuable. So what does it take for a Developer to enter the world of data science? Join me on a journey into the world of big data and machine learning where we will explore what the work actually looks like, identify which skills are most important, and design a road map for how you too can join this exciting and profitable industry.

From Developer to Data Scientist - Gaines Kergosien

ITCamp

For numerous large enterprises, the alignment of hardware and software processes is critical to managing an Agile environment. Agile Hardware implementations can be put in place by using the same framework as our typical Agile Software Development transformations. Start off with assessing the organization’s current state, then move to planning and preparing by and putting together a transition backlog, start execution with training and coaching, spread the cultural shift with change management and maintain and scale the transformation.

Introduction to Agile Hardware

Cprime

Bluegranite AA Webinar FINAL 28JUN16

Andy Lathrop

ML.NET is an open source, machine learning framework built in .NET and runs on Windows, Linux and macOS. It allows developers to integrate custom machine learning into their applications without any prior expertise in developing or tuning machine learning models. Enhance your .NET apps with sentiment analysis, price prediction, fraud detection and more using custom models built with ML.NET In this Session, Andy will show not only the core of ML.NET but best practices around Azure Data Lake and data in general when using .NET

ITCamp 2019 - Andy Cross - Machine Learning with ML.NET and Azure Data Lake

ITCamp

Data Science with Spark

Krishna Sankar

Ähnlich wie Productionizing Data Science at Experience (20)

Maintainable Machine Learning Products

SPSNYC2019 - What is Common Data Model and how to use it?

Deploying Python Machine Learning Models with Apache Spark with Brandon Hamri...

Intro to Machine Learning with H2O and AWS

Building Business Applications in Office 365 SharePoint Online Using Logic Apps

2015 Data Science Summit @ dato Review

DevOps for DataScience

Open Data Science Conference Big Data Infrastructure – Introduction to Hadoop...

PWR 106 Business Process Automation for SharePoint

End-to-End Data Pipelines with Apache Spark

KTern.AI-SAP-DXaaS-Workshop-PLAN

Your Roadmap for An Enterprise Graph Strategy

SharePoint 2013 Dev Features

Searching for SharePoint Analytics

Data-Driven Transformation: Leveraging Big Data at Showtime with Apache Spark

From Developer to Data Scientist - Gaines Kergosien

Introduction to Agile Hardware

Bluegranite AA Webinar FINAL 28JUN16

ITCamp 2019 - Andy Cross - Machine Learning with ML.NET and Azure Data Lake

Data Science with Spark

Kürzlich hochgeladen

In an era where security concerns are paramount, the integration of artificial intelligence (AI) into CCTV cameras has revolutionized surveillance capabilities. One of the most significant advancements is the ability to achieve real-time threat detection, enabling immediate responses to potential security breaches. This blog explores how AI is reshaping surveillance through real-time threat detection and the implications of this technology.

Optimizing AI for immediate response in Smart CCTV

shikhaohhpro

8257 interfacing 2 in microprocessor for btech students

HimanshiGarg82

Data spaces in distributed environments should be allowed to evolve in agile ways providing data space owners with large flexibility about which data they store. Agility and heterogeneity, however, jeopardize data exchanges because representations may build on varying ontologies and data consumers may not rely on the semantic correctness of their queries in the context of semantically heterogeneous, evolving data spaces. Graph data spaces are one example of a powerful model for representing and querying data whose semantics may change over time. To assert and enforce conditions on individual graph data spaces, shape languages (e.g SHACL) have been developed. We investigate the question of how querying and programming can be guarded by reasoning over SHACL constraints in a distributed setting and we sketch a picture of how a future landscape based on semantically heterogeneous data spaces might look like.

Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...

Steffen Staab

Azure Native Qumulo scales elastically for common High Performance Compute (HPC) workloads based on application requirements for: Financial Services, Automotive, Genomics / Life Sciences, Media and Entertainment, Energy, Oil and Gas, etc. Performance can be dialed UP (and back down) much higher than the examples shown here. These slides offer a glimpse into ANQ's HPC capabilities, although at a smaller scale. We invite YOU to do your own testing (with a free ANQ trial) and work with us to test your HPC workloads in Azure.

Azure_Native_Qumulo_High_Performance_Compute_Benchmarks.pdf

ryanfarris8

How To Troubleshoot Collaboration Apps for the Modern Connected Worker

ThousandEyes

+971565801893 Mtp-Kit (500MG) Prices » Dubai [(+971565801893**)] Abortion Pills For Sale In Dubai, UAE, Mifepristone and Misoprostol Tablets Available In Dubai, UAE CONTACT DR.Leen Whatsapp +971565801893 We Have Abortion Pills / Cytotec Tablets /Mifegest Kit Available in Dubai, Sharjah, Abudhabi, Ajman, Alain, Fujairah, Ras Al Khaimah, Umm Al Quwain, UAE, Buy cytotec in Dubai +971565801893''''Abortion Pills near me DUBAI | ABU DHABI|UAE. Price of Misoprostol, Cytotec” +971565801893' Dr.DEEM ''BUY ABORTION PILLS MIFEGEST KIT, MISOPROTONE, CYTOTEC PILLS IN DUBAI, ABU DHABI,UAE'' Contact me now via What's App…… abortion Pills Cytotec also available Oman Qatar Doha Saudi Arabia Bahrain Above all, Cytotec Abortion Pills are Available In Dubai / UAE, you will be very happy to do abortion in Dubai we are providing cytotec 200mg abortion pill in Dubai, UAE. Medication abortion offers an alternative to Surgical Abortion for women in the early weeks of pregnancy. We only offer abortion pills from 1 week-6 Months. We then advise you to use surgery if its beyond 6 months. Our Abu Dhabi, Ajman, Al Ain, Dubai, Fujairah, Ras Al Khaimah (RAK), Sharjah, Umm Al Quwain (UAQ) United Arab Emirates Abortion Clinic provides the safest and most advanced techniques for providing non-surgical, medical and surgical abortion methods for early through late second trimester, including the Abortion By Pill Procedure (RU 486, Mifeprex, Mifepristone, early options French Abortion Pill), Tamoxifen, Methotrexate and Cytotec (Misoprostol). The Abu Dhabi, United Arab Emirates Abortion Clinic performs Same Day Abortion Procedure using medications that are taken on the first day of the office visit and will cause the abortion to occur generally within 4 to 6 hours (as early as 30 minutes) for patients who are 3 to 12 weeks pregnant. When Mifepristone and Misoprostol are used, 50% of patients complete in 4 to 6 hours; 75% to 80% in 12 hours; and 90% in 24 hours. We use a regimen that allows for completion without the need for surgery 99% of the time. All advanced second trimester and late term pregnancies at our Tampa clinic (17 to 24 weeks or greater) can be completed within 24 hours or less 99% of the time without the need surgery. The procedure is completed with minimal to no complications. Our Women's Health Center located in Abu Dhabi, United Arab Emirates, uses the latest medications for medical abortions (RU-486, Mifeprex, Mifegyne, Mifepristone, early options French abortion pill), Methotrexate and Cytotec (Misoprostol). The safety standards of our Abu Dhabi, United Arab Emirates Abortion Doctors remain unparalleled. They consistently maintain the lowest complication rates throughout the nation. Our Physicians and staff are always available to answer questions and care for women in one of the most difficult times in their lives. The decision to have an abortion at the Abortion Clinic in Abu Dhabi, United Arab Emirates.+971565801893

+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...

Health

Define the academic and professional writing..pdf

PearlKirahMaeRagusta1

In the past six months, the AI landscape has undergone a massive transformation, ushering in a new era of productivity with the latest in Large Language Models (LLMs) and AI technology. This deep dive unlocks how to: Create CustomGPT Models: No coding needed to tailor AI for your unique projects. Integrate your own data, including PDFs and Excel sheets, making information handling a breeze. Plus, discover how to call your own actions/integrations for even more personalized utility. Navigate Advanced Prompting: Overcome AI's memory limits and utilize Retrieval-Augmented Generation for accessing your personalized data, streamlining how you interact with AI. Stay Ahead with AI Trends: Peek into the evolving world of LLMs, featuring newcomers like Google Gemini, Anthropic Claude, Open Sora, and Twitter Grok, and understand what their advancements mean for your productivity. Witness Real-Life Transformations: Through examples and prompt demonstrations, see firsthand how these AI strategies revolutionize routine tasks, from data analysis to content creation. Learn to leverage image output and input for advanced practical use cases, adding a new dimension to your productivity toolkit. No previous coding or AI experience is needed for this talk. Stay ahead in the fast-evolving world of work. Embrace the AI revolution and transform your workflow with advanced LLM techniques. Join us to ensure you're not left behind in the productivity race.

AI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques

VictorSzoltysek

introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf

VishalKumarJha10

Test automation is a cornerstone of software development and quality assurance in today's rapidly evolving digital landscape. Its significance cannot be overstated. Businesses can enhance efficiency, productivity, and accelerate software delivery to market through automation, streamlining testing processes effectively. This comprehensive guide addresses the best practices for test automation in 2024. It offers a detailed checklist to empower you to optimize your automation efforts and maintain a competitive edge.

The Ultimate Test Automation Guide_ Best Practices and Tips.pdf

kalichargn70th171

Unlocking the Future of AI Agents with Large Language Models

aagamshah0812

HR Software Buyers Guide in 2024 - HRSoftware.com

Fatema Valibhai

Craft an AI & Machine Learning Pitch with our Editable Professional PowerPoint Template. Ignite your AI & Machine Learning pitch with our cutting-edge PowerPoint template tailored for the industry. Perfect for AI conferences, investor presentations, sales pitches to tech-focused companies, training sessions, and educational programs. - 20+ editable slides: Get a variety of options to choose from for your presentation. - Time-saving solution: Download, replace text/images with a few clicks. - User-friendly customization: Easy to use and personalize. - Modern and attractive design: Captivating visuals, sleek layout. - Tailored to your requirements: Fully alterable for customization. - Well-organized slides: Complete control over content. - Thematic specificity: Reflects healthcare industry with relevant graphics. - Showcase your business idea: Communicate value proposition effectively.

AI & Machine Learning Presentation Template

Presentation.STUDIO

VTU technical seminar 8Th Sem on Scikit-learn

AmarnathKambale

A great deal of attention in medical devices has shifted towards cybersecurity with the ratification of section 524B of the FD&C act. This new law enables the FDA to enforce cybersecurity controls in any medical device that is capable of networked communications or that has software. In this webinar we will recap the process for managing vulnerabilities, identify categories of vulnerabilities and solutions and more.

The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...

ICS

Investing in AI transformation today The modern business advantage: Uncovering deep insights with AI Organizations around the world have come to recognize AI as the transformative technology that enables them to gain real business advantage. AI’s ability to organize vast quantities of data allows those who implement it to uncover deep business insights, augment human expertise, drive operational efficiency, transform their products, and better serve their customers

Microsoft AI Transformation Partner Playbook.pdf

Willy Marroquin (WillyDevNET)

Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf

kalichargn70th171

Many specialized tools cater to distinct stages within the software development lifecycle (SDLC). These tools target various aspects of development, delivery, and operations, each with its unique strengths. Uniting these diverse testing needs into a single continuous testing platform presents several challenges. Such a platform must seamlessly integrate with various development tools and environments, accommodate different testing methodologies, and remain flexible to adapt to organizational processes and quality standards.

The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...

kalichargn70th171

Conference: Engage2024 in Antwerp Type: Workshop Speakers: Florian Vogler, Henning Kunz, Christoph Adler Title: Navigating the Future with The Hitchhiker's Guide to Notes and Domino 14 Abstract: Embark on an exhilarating journey with industry trailblazers Florian Vogler, Henning Kunz, and Christoph Adler in this not-to-be-missed workshop at the forefront of the tech universe. Get ready for a thrilling kick-off as we navigate the current state of the HCL universe, setting the stage for an exploration of the groundbreaking Notes and Domino 14. Discover the latest enhancements and revolutionary features that will redefine your experience. In this interactive session, unlock a treasure trove of tips and tricks to elevate your utilization of version 14, both with and without the game-changing panagenda MarvelClient. Brace yourself for also diving into Nomad, Nomad Web, and VoltMX, expanding your horizons in the expansive HCL landscape. Be a part of this exclusive opportunity to stay ahead in the ever-evolving world of HCL technologies. Your journey to mastering Notes and Domino 14 begins here. And remember, in the spirit of intergalactic exploration, don't forget to bring your towel!

W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...

panagenda

Looking for an efficient way to manage your finances? Look no further than our money management app. With easy-to-use features, you can track your expenses, create budgets, and monitor your savings goals all in one place. Our app provides real-time updates on your spending habits and helps you make smarter financial decisions. Take control of your finances today with our user-friendly money management app.

Right Money Management App For Your Financial Goals

Jhone kinadey

Kürzlich hochgeladen (20)

Optimizing AI for immediate response in Smart CCTV

8257 interfacing 2 in microprocessor for btech students

Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...

Azure_Native_Qumulo_High_Performance_Compute_Benchmarks.pdf

How To Troubleshoot Collaboration Apps for the Modern Connected Worker

+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...

Define the academic and professional writing..pdf

AI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques

introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf

The Ultimate Test Automation Guide_ Best Practices and Tips.pdf

Unlocking the Future of AI Agents with Large Language Models

HR Software Buyers Guide in 2024 - HRSoftware.com

AI & Machine Learning Presentation Template

VTU technical seminar 8Th Sem on Scikit-learn

The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...

Microsoft AI Transformation Partner Playbook.pdf

Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf

The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...

W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...

Right Money Management App For Your Financial Goals

Productionizing Data Science at Experience

1. Productionizing Data Science at A Startup's (ongoing) Journey building Machine Learning Products

2. Agenda • Intro • Setting the Scene • Proposed Pipeline • A Look Back

3. Who am I? • Matt Mills • Born and raised in Atlanta • BS in Industrial and Systems Engineering 2014, MS in Analytics 2015 • @statmills or www.statmills.com

4. Experience's mobile commerce, ticketing, and data solutions empower sports and entertainment leaders to generate new revenue streams, sell more tickets, and make smarter decisions. www.expapp.com/solutions What is Experience?

5. What is Experience?

6. What is Experience?

7. Agenda • Intro • Setting the Scene • Proposed Pipeline • A Look Back

8. Data Science at the end of 2016 • ~13 Engineers and 1 (me!) Data Scientist

9. Data Science at the end of 2016 • ~13 Engineers and 1 (me!) Data Scientist • What happens to my work?

10. Data Science at the end of 2016 • ~13 Engineers and 1 (me!) Data Scientist • What happens to my work? Manager / Management Other Departments Partners

11. Data Science at the end of 2016 • ~13 Engineers and 1 (me!) Data Scientist • What happens to my work? Manager / Management Other Departments Partners

12. Goal for 2017 • Make an Impact on our Customers (Fans) Inﬂuence Fan Behavior Manager / Management Other Departments Partners

13. Goal for 2017 • Make an Impact on our Customers (Fans) Predictive Model Inﬂuence Fan Behavior Manager / Management Other Departments Partners

14. Goal for 2017: Continued • Create a process to deploy models into production and use predictions in real time

15. Goal for 2017: Continued • Create a process to deploy models into production and use predictions in real time • Some considerations • Minimal use of limited Engineering Resources • Scalable (speed and processing power) • Cheap, like, super cheap (read: Free) • Had to handle data cleansing

16. Some Potential Solutions

17. Some Potential Solutions • Build own R/Python Server

18. Some Potential Solutions • Build own R/Python Server • Learn Scala/Spark

19. Some Potential Solutions • Build own R/Python Server • Learn Scala/Spark • Pay for ML Service

20. Some Potential Solutions • Build own R/Python Server • Learn Scala/Spark • Pay for ML Service

21. Scaling Experience Data Science with h2o • ML Algorithms written in pure Java • APIs written for R, Python, Scala, Spark • Built for scale • parallel and distributed out of the box • Open Source

22. Scaling Experience Data Science with h2o • ML Algorithms written in pure Java • APIs written for R, Python, Scala, Spark • Built for scale • parallel and distributed out of the box • Open Source • Models exportable as Java Objects to embed in other apps • Can embed python pre-processing scripts within the POJO

23. Agenda • Intro • Setting the Scene • Proposed Pipeline • A Look Back

24. h2o Architecture https://github.com/h2oai/h2o-meetups/blob/master/2017_09_12_Dublin/ 2017_09_12_H2O_Intro_and_AutoML.pdf

25. h2o Algorithm List

26. h2o vs scikit-learn Syntax and Process https://github.com/h2oai/h2o-meetups/blob/master/2015_05_14_H2O_Overview/H2O_Overview.pdf

27. Experience Production Pipeline

28. Experience Production Pipeline

29. Experience Predictive Modeling Pipeline 1. App Sends Data 2. Data Cleaning in Python 3. Predictions done in h2o 4. App Gets Prediction input() sys.stdout.ﬂush() {JSON}

30. Benefits of Using Open Source Software

31. Experience Predictive Modeling Setup

32. Model Deployment Code Pulled via Github Terraform to create infrastructure and manage state Served via ECS Dockerize via Dockerﬁle and stored in ECR Discovery via Consul

33. Agenda • Intro • Setting the Scene • Proposed Pipeline • A Look Back

34. Pros and Cons of Current Set-Up Pros • Automated process to deploy models into production • Can iterate models with no/limited effort from engineering Cons • Can only use algorithms available to h2o (e.g. no multilevel models, GAMs, Bayesian) • h2o drives Python, why not the other way around?

35. Conclusion and Questions 1. Lack of skills and/or support doesn’t have to stop you from putting models into production 2. What’s best for your Data Scientists might not be best for your Engineers and vice-versa

36. Conclusion and Questions 1. Lack of skills and/or support doesn’t have to stop you from putting models into production 2. What’s best for your Data Scientists might not be best for your Engineers and vice-versa www.statmills.com ? http://docs.h2o.ai/ https://www.expapp.com/about/#careers

Productionizing Data Science at Experience

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

Ähnlich wie Productionizing Data Science at Experience

Ähnlich wie Productionizing Data Science at Experience (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

Productionizing Data Science at Experience