Alexandra Johnson, Software Engineer, SigOpt at MLconf ATL 2017

•Download as PPTX, PDF•

1 like•547 views

Best Practices for Hyperparameter Optimization: All machine learning and artificial intelligence pipelines – from reinforcement agents to deep neural nets – have tunable hyperparameters. Optimizing these hyperparameters provides tremendous performance gains, but only if the optimization is done correctly. This presentation will discuss topics including selecting performance criteria, why you should always use cross validation, and choosing between state of the art optimization methods.

Best Practices for Hyperparameter
Optimization
Alexandra Johnson
@alexandraj777

Example: Beating Vegas
Scott Clark. Using Model Tuning to Beat Vegas.

Terminology
● Optimization
● Hyperparameter
Optimization
● Hyperparameter
tuning
● Model tuning

Tune the Whole Pipeline

Optimize all Parameters at Once
TensorFlow Playground

Include Feature Parameters

Include Feature Parameters

Choosing a Metric
● Balance long-term
and short-term goals
● Question underlying
assumptions
● Example from
Microsoft

Composite Metric
Example: Lifetime Value
clicks*wclicks + likes*wlikes + views*wviews

Choose Multiple Metrics
● Balance competing
metrics
● Explore entire result
space
Image from PhD Comics

Avoiding Overfitting

Get A Suggestion

Shuffle and Split Data

Train the Model

Test the Performance

Repeat
Shuffle Train Evaluate

Report An Observation

Repeat the Entire Process
Shuffle Train Evaluate

Optimization Methods

Hand Tuning
● Hand tuning is time
consuming and
expensive
● Algorithms can
quickly and cheaply
beat expert tuning

Grid Search Random Search Bayesian Optimization
Alternatives to Hand Tuning

No Grid Search
Hyper-
parameters
Model
Evaluations
2 100
3 1,000
4 10,000
5 100,000

No Random Search
● Theoretically more
effective than grid
search
● Large variance in
results
● No intelligence

Bayesian Optimization
● Explore/exploit
● Ideal for "expensive"
optimization
● No requirements on:
convex,
differentiable,
continuous

Alternatives to Bayesian Optimization
Genetic algorithms
Particle-based methods
Convex optimizers
Simulated annealing
To name a few...

Takeaways
●Optimize the entire pipeline
●Ensure generalization
●Use Bayesian optimization

Thank You!
blog.sigopt.com
sigopt.com/research

More Related Content

What's hot

Generalized linear models (GLMs) and gradient boosting machines (GBMs) are two of the most widely used supervised learning approaches in all of commercial data science. GLMs have been the go-to predictive and inferential modeling tool for decades, but important mathematical and computational advances have been made in training GLMs in recent years. This talk will contrast H2O’s implementation of penalized GLM techniques with ordinary least squares and give specific hints for building regularized and accurate GLMs for both predictive and inferential purposes. As more organizations begin experimenting with and embracing algorithms from the machine learning tradition, GBMs have come to prominence due to their predictive accuracy, the ability to train on real-world data, and resistance to overfitting training data. This talk will give some background on the GBM approach, some insight into the H2O implementation, and some tips for tuning and interpreting GBMs in H2O. Patrick's Bio: Patrick Hall is a senior data scientist and product engineer at H2O.ai. Patrick works with H2O.ai customers to derive substantive business value from machine learning technologies. His product work at H2O.ai focuses on two important aspects of applied machine learning, model interpretability and model deployment. Patrick is also currently an adjunct professor in the Department of Decision Sciences at George Washington University, where he teaches graduate classes in data mining and machine learning. Prior to joining H2O.ai, Patrick held global customer facing roles and R & D research roles at SAS Institute. He holds multiple patents in automated market segmentation using clustering and deep neural networks. Patrick is the 11th person worldwide to become a Cloudera certified data scientist. He studied computational chemistry at the University of Illinois before graduating from the Institute for Advanced Analytics at North Carolina State University.

GLM & GBM in H2O

GLM & GBM in H2O

GLM & GBM in H2O

GraphAware Framework Intro

GraphAware Framework Intro

GraphAware Framework Intro

Talk from Software Engineering for Machine Learning Workshop (SW4ML) at the Neural Information Processing Systems (NIPS) 2014 conference in Montreal, Canada on 2014-12-13. Abstract: Building a real system that incorporates machine learning as a part can be a difficult effort, both in terms of the algorithmic and engineering challenges involved. In this talk I will focus on the engineering side and discuss some of the practical issues we’ve encountered in developing real machine learning systems at Netflix and some of the lessons we’ve learned over time. I will describe our approach for building machine learning systems and how it comes from a desire to balance many different, and sometimes conflicting, requirements such as handling large volumes of data, choosing and adapting good algorithms, keeping recommendations fresh and accurate, remaining responsive to user actions, and also being flexible to accommodate research and experimentation. I will focus on what it takes to put machine learning into a real system that works in a feedback loop with our users and how that imposes different requirements and a different focus than doing machine learning only within a lab environment. I will address the particular software engineering challenges that we’ve faced in running our algorithms at scale in the cloud. I will also mention some simple design patterns that we’ve fond to be useful across a wide variety of machine-learned systems.

Lessons Learned from Building Machine Learning Software at Netflix

Lessons Learned from Building Machine Learning Software at Netflix

Lessons Learned from Building Machine Learning Software at Netflix

Justin Basilico

Presented at #H2OWorld 2017 in Mountain View, CA. Enjoy the video: https://youtu.be/WKAuXlsq6xw. Learn more about H2O.ai: https://www.h2o.ai/. Follow @h2oai: https://twitter.com/h2oai. - - - Leaderboard shake-up and overfitting are commonly known problems in Kaggle competitions. In his talk Dmitry is going to share an interesting approach to model’s performance validation which proven to be useful on Kaggle competitions with noisy data. Dmitry Larko's Bio: Senior Data Scientist at H2O.ai, Dmitry also is a former #25 Kaggle Grandmaster and loves to use his machine learning and data science skills in Kaggle Competitions and predictive analytics software development. He has more than 15 years of experience in information technology. Post his masters in computer information systems from Krasnoyarsk State Technical University (KSTU), he started his career in data warehousing and business intelligence and gradually moved to big data and data science. He holds a lot of experience in predictive analytics in a wide array of domains and tasks. Prior to H2O.ai, Dmitry held the position of SAP BW Developer at Chevron, Data Scientist at EPAM, and that of Lead Software Engineer with the Russian Federation.

Robust approach to machine learning models comparison - Dmitry Larko, Sr. Dat...

Robust approach to machine learning models comparison - Dmitry Larko, Sr. Dat...

Robust approach to machine learning models comparison - Dmitry Larko, Sr. Dat...

Spark Summit EU talk by Javier Aguedes

Spark Summit EU talk by Javier Aguedes

Spark Summit EU talk by Javier Aguedes

Linear regression on 1 terabytes of data? Some crazy observations and actions

Linear regression on 1 terabytes of data? Some crazy observations and actions

Linear regression on 1 terabytes of data? Some crazy observations and actions

Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning

Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning

Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning

Adopting software design practices for better machine learning

Adopting software design practices for better machine learning

Adopting software design practices for better machine learning

ThesisDefensePresentation_KyleIngersoll

ThesisDefensePresentation_KyleIngersoll

ThesisDefensePresentation_KyleIngersoll

MATLAB Major Projects

MATLAB Major Projects

MATLAB Major Projects

Matlab Simulation

Deep Learning has gained a huge popularity over the last several years. Especially due to its magnificent progress in many domains. Many resources are out there including open source implementations of recent research advancements. This vast availability is somehow misleading because when one actually wants to create a Deep Learning based product, he soon realizes that there is a large gap between these open source implementations and a real production grade Deep Learning product. Closing this gap can take months of work involving large costs, especially on man power and compute power. Throughout this talk I will talk based on my experience leading the research at Brodmann17 about several aspects we have found to be important for building Deep Learning based computer vision products.

5 Practical Steps to a Successful Deep Learning Research

5 Practical Steps to a Successful Deep Learning Research

5 Practical Steps to a Successful Deep Learning Research

Download It

Feature Engineering

Feature Engineering

Feature Engineering

Neural_Programmer_Interpreter

Neural_Programmer_Interpreter

Neural_Programmer_Interpreter

GDG PDX - An Intro to Google Cloud AutoML Vision

GDG PDX - An Intro to Google Cloud AutoML Vision

GDG PDX - An Intro to Google Cloud AutoML Vision

Predicting Multiple Metrics for Queries: Better Decision Enabled by Machine L...

Predicting Multiple Metrics for Queries: Better Decision Enabled by Machine L...

Predicting Multiple Metrics for Queries: Better Decision Enabled by Machine L...

Soheila Dehghanzadeh

Nag software For Finance

Nag software For Finance

Nag software For Finance

QTP AUTOMATION TESTING SYLLABUS

QTP AUTOMATION TESTING SYLLABUS

QTP AUTOMATION TESTING SYLLABUS

SHPINE TECHNOLOGIES

AI-Assisted Feature Selection for Big Data Modeling

AI-Assisted Feature Selection for Big Data Modeling

AI-Assisted Feature Selection for Big Data Modeling

Recently, an AI education firm named fast.ai topped a Kaggle competition beating researchers from Google, Amazon and Intel AI research. One of the ingredients that allowed them this success is the effective use of Cyclical Learning Rates in their models. CLR is not a well-studied topic and it is still not accepted by the community because it was proposed by an organization which is not that much in the AI limelight. But CLR has shown some exceptional results in the training of Neural Nets.

Introduction to cyclical learning rates for training neural nets

Introduction to cyclical learning rates for training neural nets

Introduction to cyclical learning rates for training neural nets

What's hot (20)

GLM & GBM in H2O

GLM & GBM in H2O

GLM & GBM in H2O

GraphAware Framework Intro

GraphAware Framework Intro

GraphAware Framework Intro

Lessons Learned from Building Machine Learning Software at Netflix

Lessons Learned from Building Machine Learning Software at Netflix

Lessons Learned from Building Machine Learning Software at Netflix

Robust approach to machine learning models comparison - Dmitry Larko, Sr. Dat...

Robust approach to machine learning models comparison - Dmitry Larko, Sr. Dat...

Robust approach to machine learning models comparison - Dmitry Larko, Sr. Dat...

Spark Summit EU talk by Javier Aguedes

Spark Summit EU talk by Javier Aguedes

Spark Summit EU talk by Javier Aguedes

Linear regression on 1 terabytes of data? Some crazy observations and actions

Linear regression on 1 terabytes of data? Some crazy observations and actions

Linear regression on 1 terabytes of data? Some crazy observations and actions

Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning

Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning

Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning

Adopting software design practices for better machine learning

Adopting software design practices for better machine learning

Adopting software design practices for better machine learning

ThesisDefensePresentation_KyleIngersoll

ThesisDefensePresentation_KyleIngersoll

ThesisDefensePresentation_KyleIngersoll

MATLAB Major Projects

MATLAB Major Projects

MATLAB Major Projects

5 Practical Steps to a Successful Deep Learning Research

5 Practical Steps to a Successful Deep Learning Research

5 Practical Steps to a Successful Deep Learning Research

Download It

Feature Engineering

Feature Engineering

Feature Engineering

Neural_Programmer_Interpreter

Neural_Programmer_Interpreter

Neural_Programmer_Interpreter

GDG PDX - An Intro to Google Cloud AutoML Vision

GDG PDX - An Intro to Google Cloud AutoML Vision

GDG PDX - An Intro to Google Cloud AutoML Vision

Predicting Multiple Metrics for Queries: Better Decision Enabled by Machine L...

Predicting Multiple Metrics for Queries: Better Decision Enabled by Machine L...

Predicting Multiple Metrics for Queries: Better Decision Enabled by Machine L...

Nag software For Finance

Nag software For Finance

Nag software For Finance

QTP AUTOMATION TESTING SYLLABUS

QTP AUTOMATION TESTING SYLLABUS

QTP AUTOMATION TESTING SYLLABUS

AI-Assisted Feature Selection for Big Data Modeling

AI-Assisted Feature Selection for Big Data Modeling

AI-Assisted Feature Selection for Big Data Modeling

Introduction to cyclical learning rates for training neural nets

Introduction to cyclical learning rates for training neural nets

Introduction to cyclical learning rates for training neural nets

Viewers also liked

Lessons Learnt from building ML Products for enterprise SaaS: Having spent the last 4+ years productizing ML powered enterprise products, we have learnt a lot! Join us to hear the stories of our stumbles (ahem learnings) in applying machine learning to solve business problems for Fortune 500 companies. Our hands-on experience has shaped our product strategy, ML platform design and organization’s operational principles. And the investments we made based on our learnings have helped us drastically improve our time to market for ML products. Come on by to hear the technical and organizational challenges (and some solutions) in building ML products for enterprise SaaS. Hopefully our learnings will be useful in your journey. Bio: LN leads the architecture and design of Workday’s ML Platform and Services. He is all about building large scale distributed systems and data platforms. Currently his days (and some nights) are spent on solving the challenges in building ML products for Enterprise SaaS. LN’s career spans across HP, IBM Research, Symantec and now Workday. At Symantec, he was the architect and lead of a streaming platform that ingested and processed 2+ billions of events per day. As a Research Staff Member at IBM T.J. Watson Research Center, LN built optimizations for automatic parallelization, techniques for approximate computing, deployment automation for OpenStack, and analytics for large scale cloud services. LN holds a Ph.D. in Computer Science from Colorado State University and has published more than 40 technical publications / patents. His work has received awards from ACM, IBM, and HP. Bio:Madhura Dudhgaonkar is responsible for leading Workday’s search, data science and machine learning teams based in San Francisco. Her teams have spent ~4 years building machine learning products used by Fortune 500 companies. Her experience ranges from being a hands-on engineer to leading large engineering organizations. Madhura’s career spans across SUN Microsystems, Adobe and now Workday. During her career, she has been involved with building a variety of products – from developing Java Language to building a version 1.0 consumer product to building enterprise SaaS products. She holds a bachelor’s degree in electronics and telecommunications and a master’s degree in math and computer science. Madhura is originally from a small town in India and came to the United States to pursue her passion in technology. She currently calls San Francisco home, and despite nine years here, can’t get enough of its hilly charm, the diversity of people, culture, and experiences.

LN Renganarayana, Architect, ML Platform and Services and Madhura Dudhgaonkar...

LN Renganarayana, Architect, ML Platform and Services and Madhura Dudhgaonkar...

LN Renganarayana, Architect, ML Platform and Services and Madhura Dudhgaonkar...

Classifying Multi-Variate Time Series at Scale: Characterizing and understanding the runtime behavior of large scale Big Data production systems is extremely important. Typical systems consist of hundreds to thousands of machines in a cluster with hundreds of terabytes of storage costing millions of dollars, solving problems that are business critical. By instrumenting each running process, and measuring their resource utilization including CPU, Memory, I/O, network etc., as time series it is possible to understand and characterize the workload on these massive clusters. Each time series is a series consisting of tens to tens of thousands of data points that must be ingested and then classified. At Pepperdata, our instrumentation of the clusters collects over three hundred metrics from each task every five seconds resulting in millions of data points per hour. At this scale the data are equivalent to the biggest IOT data sets in the world. Our objective is to classify the collection of time series into a set of classes that represent different work load types. Or phrased differently, our problem is essentially the problem of classifying multivariate time series. In this talk, we propose a unique, off-the-shelf approach to classifying time series that achieves near best-in-class accuracy for univariate series and generalizes to multivariate time series. Our technique maps each time series to a Grammian Angular Difference Field (GADF), interprets that as an image, uses Google’s pre-trained CNN (trained on Inception v3) to map the GADF images into a 2048-dimensional vector space and then uses a small MLP with two hidden layers, with fifty nodes in each layer, and a softmax output to achieve the final classification. Our work is not domain specific – a fact proven by our achieving competitive accuracies with published results on the univariate UCR data set as well as the multivariate UCI data set. Bio: Before joining Pepperdata, Ash was executive chairman for Marianas Labs, a deep learning startup sold in December 2015. Prior to that he was CEO for Graphite Systems, a big data storage startup that was sold to EMC DSSD in August 2015. Munshi also served as CTO of Yahoo, as a CEO of both public and private companies, and is on the board of several technology startups.

Ashfaq Munshi, ML7 Fellow, Pepperdata

Ashfaq Munshi, ML7 Fellow, Pepperdata

Ashfaq Munshi, ML7 Fellow, Pepperdata

Machine Learning Systems at Scale: OpenAI is a non-profit research company, discovering and enacting the path to safe artificial general intelligence. As part of our work, we regularly push the limits of scalability in cutting-edge ML algorithms. We’ve found that in many cases, designing the systems we build around the core algorithms is as important as designing the algorithms themselves. This means that many systems engineering areas, such as distributed computing, networking, and orchestration, are crucial for machine learning to succeed on large problems requiring thousands of computers. As a result, at OpenAI engineers and researchers work closely together to build these large systems as opposed to a strict researcher/engineer split. In this talk, we will go over some of the lessons we’ve learned, and how they come together in the design and internals of our system for learning-based robotics research. Bio: Jonas leads technology development for OpenAI’s robotics group, developing methods to apply machine learning and AI to robots. He also helped build the infrastructure to scale OpenAI’s distributed ML systems to thousands of machines.

Jonas Schneider, Head of Engineering for Robotics, OpenAI

Jonas Schneider, Head of Engineering for Robotics, OpenAI

Jonas Schneider, Head of Engineering for Robotics, OpenAI

Deep Reinforcement Learning with Shallow Trees: In this talk, I present Concept Network Reinforcement Learning (CNRL), developed at Bonsai. It is an industrially applicable approach to solving complex tasks using reinforcement learning, which facilitates problem decomposition, allows component reuse, and simplifies reward functions. Inspired by Sutton’s options framework, we introduce the notion of “Concept Networks” which are tree-like structures in which leaves are “sub-concepts” (sub-tasks), representing policies on a subset of state space. The parent (non-leaf) nodes are “Selectors”, containing policies on which sub-concept to choose from the child nodes, at each time during an episode. There will be a high-level overview on the reinforcement learning fundamentals at the beginning of the talk. Bio: Matineh Shaker is an Artificial Intelligence Scientist at Bonsai in Berkeley, CA, where she builds machine learning, reinforcement learning, and deep learning tools and algorithms for general purpose intelligent systems. She was previously a Machine Learning Researcher at Geometric Intelligence, Data Science Fellow at Insight Data Science, Predoctoral Fellow at Harvard Medical School. She received her PhD from Northeastern University with a dissertation in geometry-inspired manifold learning.

Matineh Shaker, Artificial Intelligence Scientist, Bonsai at MLconf SF 2017

Matineh Shaker, Artificial Intelligence Scientist, Bonsai at MLconf SF 2017

Matineh Shaker, Artificial Intelligence Scientist, Bonsai at MLconf SF 2017

Getting Value Out of Chat Data: Chat-based interfaces are increasingly common, whether as customers interacting with companies or as employees communicating with each other within an organization. Given the large number of chat logs being captured, along with recent advances in natural language processing, there is a desire to leverage this data for both insight generation and machine learning applications. Unfortunately, chat data is user-generated data, meaning it is often noisy and difficult to normalize. It is also mostly short texts and heavily context-dependent, which cause difficulty in applying methods such as topic modeling and information extraction. Despite these challenges, it is still possible to extract useful information from these data sources. In this talk, I will be providing an overview of techniques and practices for working with chat-based user interaction data with a focus on machine-augmented data annotation and unsupervised learning methods. Bio: Daniel Shank is a Senior Data Scientist at Talla, a company developing a platform for intelligent information discovery and delivery. His focus is on developing machine learning techniques to handle various business automation tasks, such as scheduling, polls, expert identification, as well as doing work on NLP. Before joining Talla as the company’s first employee in 2015, Daniel worked with TechStars Boston and did consulting work for ThriveHive, a small business focused marketing company in Boston. He studied economics at the University of Chicago.

Daniel Shank, Data Scientist, Talla at MLconf SF 2017

Daniel Shank, Data Scientist, Talla at MLconf SF 2017

Daniel Shank, Data Scientist, Talla at MLconf SF 2017

Large Scale Graph Processing & Machine Learning Algorithms for Payment Fraud Prevention: PayPal is at the forefront of applying large scale graph processing and machine learning algorithms to keep fraudsters at bay. In this talk, I’ll present how advanced graph processing and machine learning algorithms such as Deep Learning and Gradient Boosting are applied at PayPal for fraud prevention. I’ll elaborate on specific challenges in applying large scale graph processing & machine technique to payment fraud prevention. I’ll explain how we employ sophisticated machine learning tools – open source and in-house developed. I will also present results from experiments conducted on a very large graph data set containing millions of edges and vertices.

Venkatesh Ramanathan, Data Scientist, PayPal at MLconf ATL 2017

Venkatesh Ramanathan, Data Scientist, PayPal at MLconf ATL 2017

Venkatesh Ramanathan, Data Scientist, PayPal at MLconf ATL 2017

ML to Cure the World: The practice of medicine involves diagnosis, treatment, and prevention of diseases. Recent technological breakthroughs have made little dent to the centuries-old system of practicing medicine: complex diagnostic decisions are still mostly dependent on “educated” work-ups of the doctors, and rely on somewhat outdated tools and incomplete data. All of this often leads to imperfect, biased, and, at times, incorrect diagnosis and treatment. With a growing research community as well as tech companies working on AI advances to medicine, the hope for healthcare renaissance is definitely not lost. The emphasis of this talk will be on ML-driven medicine. We will discuss recent AI advancements for aiding medical decision including language understanding, medical knowledge base construction and diagnosis systems. We will discuss the importance of personalized medicine that takes into account not only the user, but also the context, and other metadata. We will also highlight challenges in designing ML-based medical systems that are accurate, but at the same time engaging and trustworthy for the user. Bio: Xavier Amatriain is currently co-founder and CTO of Curai, a stealth startup trying to radically improve healthcare for patients by using AI. Previous to this, he was VP of Engineering at Quora, and Research/engineering Director at Netflix, where he led the team building the famous Netflix recommendation algorithms. Before going into leadership positions in industry, Xavier was a research scientist at Telefonica Research and a research director at UCSB. With over 50 publications (and 3k+ citations) in different fields, Xavier is best known for his work on machine learning in general and recommender systems in particular. He has lectured at different universities both in the US and Spain and is frequently invited as a speaker at conferences and companies.

Xavier Amatriain, Cofounder & CTO, Curai at MLconf SF 2017

Xavier Amatriain, Cofounder & CTO, Curai at MLconf SF 2017

Xavier Amatriain, Cofounder & CTO, Curai at MLconf SF 2017

Application of Support Vector Machine Modeling and Graph Theory Metrics for Disease Classification: Disease classification is a crucial element of biomedical research. Recent studies have demonstrated that machine learning techniques, such as Support Vector Machine (SVM) modeling, produce similar or improved predictive capabilities in comparison to the traditional method of Logistic Regression. In addition, it has been found that social network metrics can provide useful predictive information for disease modeling. In this study, we combine simulated social network metrics with SVM to predict diabetes in a sample of data from the Behavioral Risk Factor Surveillance System. In this dataset, Logistic Regression outperformed SVM with ROC index of 81.8 and 81.7 for models with and without graph metrics, respectively. SVM with a polynomial kernel had ROC index of 72.9 and 75.6 for models with and without graph metrics, respectively. Although this did not perform as well as Logistic Regression, the results are consistent with previous studies utilizing SVM to classify diabetes.

Jessica Rudd, PhD Student, Analytics and Data Science, Kennesaw State Univers...

Jessica Rudd, PhD Student, Analytics and Data Science, Kennesaw State Univers...

Jessica Rudd, PhD Student, Analytics and Data Science, Kennesaw State Univers...

The Role of AI and Machine Learning in Creativity: I’ll discuss Magenta, a Google Brain project investigating music and art generation using deep learning and reinforcement learning. I’ll describe the goals of Magenta and how it fits into the general trend of AI moving into our daily lives. One crucial question is: Where does AI and Machine Learning fit in the creative process? I’ll argue that it’s about augmenting and extending the artist rather than just creating artifacts (songs, paintings, etc.) with machines. I’ll talk about two recent projects. In the first, we explore the use of recurrent neural networks to extend musical phrases in different ways. In the second we look at teaching a neural network to draw with strokes. This will be a high-level overview talk with no need for knowledge of AI or Machine Learning. Bio:Doug leads Magenta, a Google Brain project working to generate music, video, image and text using deep learning and reinforcement learning. A main goal of Magenta is to better understanding how AI can enable artists and musicians to express themselves in innovative new ways. Before Magenta, Doug led the Google Play Music search and recommendation team. From 2003 to 2010 Doug was faculty at the University of Montreal’s MILA Machine Learning lab, where he worked on expressive music performance and automatic tagging of music audio.

Doug Eck, Research Scientist, Google Magenta, at MLconf SF 2017

Doug Eck, Research Scientist, Google Magenta, at MLconf SF 2017

Doug Eck, Research Scientist, Google Magenta, at MLconf SF 2017

Personalized User Recommendations at Tinder: The TinVec Approach: With 26 million matches per day and more than 20 billion matches made to date, Tinder is the world’s most popular app for meeting new people. Our users swipe for a variety of purposes, like dating to find love, expanding social networks and meeting locals when traveling. Recommendation is an important service behind-the-scenes at Tinder, and a good recommendation system needs to be personalized to meet an individual user’s preferences. In this talk, we will discuss a new personalized recommendation approach being developed at Tinder, called TinVec. TinVec embeds users’ preferences into vectors leveraging on the large amount of swipes by Tinder users. We will discuss the design, implementation, and evaluation of TinVec as well as its application to personalized recommendations. Bio: Dr. Steve Liu is chief scientist at Tinder. In his role, he leads research innovation and applies novel technologies to new product developments. He is currently a professor and William Dawson Scholar at McGill University School of Computer Science. He has also served as a visiting research scientist at HP Labs. Dr. Liu has published more than 280 research papers in peer-reviewed international journals and conference proceedings. He has also authored and co-authored several books. Over the course of his career, his research has focused on big data, machine learning/AI, computing systems and networking, Internet of Things, and more. His research has been referenced in articles publishing across The New York Times, IDG/Computer World, The Register, Business Insider, Huffington Post, CBC, NewScientist, MIT Technology Review, McGill Daily and others. He is a recipient of the Outstanding Young Canadian Computer Science Researcher Prizes from the Canadian Association of Computer Science and is a recipient of the Tomlinson Scientist Award from McGill University. He is serving or has served on the editorial boards of ACM Transactions on Cyber-Physical Systems (TCPS), IEEE/ACM Transactions on Networking (ToN), IEEE Transactions on Parallel and Distributed Systems (TPDS), IEEE Transactions on Vehicular Technology (TVT), and IEEE Communications Surveys and Tutorials (COMST). He has also served on the organizing committees of more than 38 major international conferences and workshops. Dr. Liu received his Ph.D. in Computer Science with multiple honors from the University of Illinois at Urbana-Champaign. He received his Master’s degree in Automation and BSc degree in Mathematics from Tsinghua University.

Dr. Steve Liu, Chief Scientist, Tinder at MLconf SF 2017

Dr. Steve Liu, Chief Scientist, Tinder at MLconf SF 2017

Dr. Steve Liu, Chief Scientist, Tinder at MLconf SF 2017

Codifying Data Science Intuition: Using Decision Theory to Automate Time Series Model Selection: While models generated from cross-sectional data can utilize cross-validation for model selection, most time series models cannot be cross-validated due to the temporal structure of the data used to create them. It is possible to employ a rolling cross-validation technique, however this process is computationally expensive and provides no indication of the long-term forecast accuracies of the models. The purpose of this talk is to elaborate how decision theory can be used to automate time series model selection in order to streamline the manual process of validation and testing. By creating consecutive, temporally independent holdout sets, performance metrics for each model’s prediction on each holdout set are fed into a decision function to select an unbiased model. The decision function helps minimize the poorest performance of each model across all holdout sets in order to counteract the possibility of choosing a model that overfits or underfits the holdout sets. Not only does this process improve forecast accuracy, but it also reduces computation time by only requiring the creation of a fixed number of proposed forecasting models.

Ryan West, Machine Learning Engineer, Nexosis at MLconf ATL 2017

Ryan West, Machine Learning Engineer, Nexosis at MLconf ATL 2017

Ryan West, Machine Learning Engineer, Nexosis at MLconf ATL 2017

Tensor Decomposition: A Mathematical Tool for Data Analysis: Tensors are multiway arrays, and tensor decompositions are powerful tools for data analysis. In this talk, we demonstrate the wide-ranging utility of the canonical polyadic (CP) tensor decomposition with examples in neuroscience and chemical detection. The CP model is extremely useful for interpretation, as we show with an example in neuroscience. However, it can be difficult to fit to real data for a variety of reasons. We present a novel randomized method for fitting the CP decomposition to dense data that is more scalable and robust than the standard techniques. We further consider the modeling assumptions for fitting tensor decompositions to data and explain alternative strategies for different statistical scenarios, resulting in a _generalized_ CP tensor decomposition. Bio: Tamara G. Kolda is a member of the Data Science and Cyber Analytics Department at Sandia National Laboratories in Livermore, CA. Her research is generally in the area of computational science and data analysis, with specialties in multilinear algebra and tensor decompositions, graph models and algorithms, data mining, optimization, nonlinear solvers, parallel computing and the design of scientific software. She has received a Presidential Early Career Award for Scientists and Engineers (PECASE), been named a Distinguished Scientist of the Association for Computing Machinery (ACM) and a Fellow of the Society for Industrial and Applied Mathematics (SIAM). She was the winner of an R&D100 award and three best paper prizes at international conferences. She is currently a member of the SIAM Board of Trustees and serves as associate editor for both the SIAM J. Scientific Computing and the SIAM J. Matrix Analysis and Applications.

Tamara G. Kolda, Distinguished Member of Technical Staff, Sandia National Lab...

Tamara G. Kolda, Distinguished Member of Technical Staff, Sandia National Lab...

Tamara G. Kolda, Distinguished Member of Technical Staff, Sandia National Lab...

Machine Learning Based Attack Vector Modeling for CyberSecurity: Connections have behavioural patterns that are unique to protocols, loads, window sizes, bandwidth, and mainly the type of traffic. A CDN enterprise behaves completely differently than how a Cloud service company would behave and they both would be different from a corporation. This also means that attack vectors and attack landscapes are different in all these places. In this talk we speak about modeling different kinds of attacks and build a model that is able to identify these different kinds of attacks using ML. The method we use is to identify different profiles based on many variables that specifically but robustly identify attacks of different kinds. The variables are specific to business, network profile, traffic. The variables are also high-level i.e. aggregate, and packet-level. This way the models are specifically picking up on constant variations in traffic, and create machine learning models to identify these attacks. Using the power of H2O these analyses are not just limited to a research and analysis of the traffic and concluding with a “OH, this was what it was.” moment but to actually deploy code, besides existing IDS and IPS, or deploying highly optimized, independent programs that can handle high thruputs at the rate of 1.2 Million decisions per second making it one of the fastest implementations of ML to identify, defend and protect critical infrastructure that are potentially under threat.

Ashrith Barthur, Security Scientist, H2o.ai, at MLconf 2017

Ashrith Barthur, Security Scientist, H2o.ai, at MLconf 2017

Ashrith Barthur, Security Scientist, H2o.ai, at MLconf 2017

Natural Language Understanding @ Facebook Scale: At Facebook, text understanding is the key to surfacing content that’s relevant and personalized, plus enabling new experiences like social recommendations and Marketplace suggestions. In this talk, I will introduce you to DeepText, Facebook’s platform for text understanding, and discuss the various models it supports. Bio: Rushin Shah is an engineering leader at Facebook, currently working on natural language understanding and dialog. Previously, he was at Siri at Apple for 5 years, where he built and headed the natural language understanding group, which included teams dedicated to modeling, engineering and data science. He also worked at the query understanding group at Yahoo. He has worked on a broad range of problems in the NLP area including parsing, information extraction, dialog and question answering. He holds degrees in language technologies and computer science from Carnegie Mellon and IIT Kharagpur.

Rushin Shah, Engineering Manager, Facebook at MLconf SF 2017

Rushin Shah, Engineering Manager, Facebook at MLconf SF 2017

Rushin Shah, Engineering Manager, Facebook at MLconf SF 2017

Representation Learning @ Red Hat: For many companies, the vast majority of their data is unstructured and unlabeled; however, the data often contains information that could be useful in a variety of scenarios. Representation learning is the process of extracting meaningful features from unlabeled data so that it can be used in other tasks. In this talk, you’ll hear about how Red Hat is using deep learning to discover meaningful entity representations in a number of different settings, including: (1) identifying duplicate documents on the Customer Portal, (2) finding contextually similar URLs with word2vec, and (3) clustering behaviorally similar customers with doc2vec. To close, we will walk through an example demonstrating how representation learning can be applied to Major League Baseball players. Bio: Michael first developed his data crunching chops as an undergraduate at Auburn University (War Eagle!) where he used a number of different statistical techniques to investigate various aspects of salamander biology (work that led to several publications). He then went on to earn a M.S. in evolutionary biology from The University of Chicago (where he wrote a thesis on frog ecomorphology) before changing directions and earning a second M.S. in computer science (with a focus on intelligent systems) from The University of Texas at Dallas. As a Machine Learning Engineer – Information Retrieval at Red Hat, Michael is constantly looking for ways to use the latest and greatest machine learning technology to improve search.

Michael Alcorn, Sr. Software Engineer, Red Hat Inc. at MLconf SF 2017

Michael Alcorn, Sr. Software Engineer, Red Hat Inc. at MLconf SF 2017

Michael Alcorn, Sr. Software Engineer, Red Hat Inc. at MLconf SF 2017

Counter Intuitive Machine Learning for the Industrial Internet of Things: The Industrial Internet of Things (IIoT) is the infrastructure and data flow built around the world’s most valuable things like airplane engines, medical scanners, nuclear power plants, and oil pipelines. These machines and systems require far greater uptime, security, governance, and regulation than the IoT landscape based around consumer activity. In the IIoT the cost of being wrong can be the catastrophic loss of life on a massive scale. Nevertheless, given the growing scale through the digitalization of industrial assets, there is clearly a growing role for machine learning to help augment and automate human decision making. It is against this backdrop that traditional machine learning techniques must be adapted and need based innovations created. We see industrial machine learning as distinct from consumer machine learning and in this talk we will cover the counterintuitive changes of featurization, metrics for model performance, and human-in-the-loop design changes for using machine learning in an industrial environment. Bio: June Andrews is a Principal Data Scientist at Wise.io, From GE Digital working on a machine learning and data science platform for the Industrial Internet of Things, which includes aviation, trains, and power plants. Previously, she worked at Pinterest spearheading the Data Trustworthiness and Signals Program to create a healthy data ecosystem for machine learning. She has also lead efforts at LinkedIn on growth, engagement, and social network analysis to increase economic opportunity for professionals. June holds degrees in applied mathematics, computer science, and electrical engineering from UC Berkeley and Cornell.

Dr. June Andrews, Principal Data Scientist, Wise.io, From GE Digital at MLcon...

Dr. June Andrews, Principal Data Scientist, Wise.io, From GE Digital at MLcon...

Dr. June Andrews, Principal Data Scientist, Wise.io, From GE Digital at MLcon...

Large-scale Machine Learning: Deep, Distributed and Multi-Dimensional: Modern machine learning involves deep neural network architectures which yields state-of-art performance on multiple domains such as computer vision, natural language processing and speech recognition. As the data and models scale, it becomes necessary to have multiple processing units for both training and inference. Apache MXNet is an open-source framework developed for distributed deep learning. I will describe the underlying lightweight hierarchical parameter server architecture that results in high efficiency in distributed settings. Pushing the current boundaries of deep learning requires using multiple dimensions and modalities. These can be encoded into tensors, which are natural extensions of matrices. We present new deep learning architectures that preserve the multi-dimensional information in data end-to-end. We show that tensor contractions and regression layers are an effective replacement for fully connected layers in deep learning architectures. They result in significant space savings with negligible performance degradation. These functionalities are available in the Tensorly package with MXNet backend interface for large-scale efficient learning. Bio: Anima Anandkumar is a principal scientist at Amazon Web Services and a Bren professor at Caltech CMS department. Her research interests are in the areas of large-scale machine learning, non-convex optimization and high-dimensional statistics. In particular, she has been spearheading the development and analysis of tensor algorithms. She is the recipient of several awards such as the Alfred. P. Sloan Fellowship, Microsoft Faculty Fellowship, Google research award, ARO and AFOSR Young Investigator Awards, NSF Career Award, Early Career Excellence in Research Award at UCI, Best Thesis Award from the ACM Sigmetrics society, IBM Fran Allen PhD fellowship, and several best paper awards. She has been featured in a number of forums such as the yourstory, Quora ML session, O’Reilly media, and so on. She received her B.Tech in Electrical Engineering from IIT Madras in 2004 and her PhD from Cornell University in 2009. She was a postdoctoral researcher at MIT from 2009 to 2010, an assistant professor at U.C. Irvine between 2010 and 2016, and a visiting researcher at Microsoft Research New England in 2012 and 2014.

Anima Anadkumar, Principal Scientist, Amazon Web Services, Endowed Professor,...

Anima Anadkumar, Principal Scientist, Amazon Web Services, Endowed Professor,...

Anima Anadkumar, Principal Scientist, Amazon Web Services, Endowed Professor,...

A Machine Learning approach for detecting a Malware: The project is to improve the way we detect script based malware using Machine Learning. Malware has become one of the most active channel to deliver threats like Banking Trojans and Ransomware. The talk is aimed at finding a new and effective way to detect the malware. We started with acquiring both malicious and clean samples. Later we performed feature identification, while building on top of existing knowledge base of malware. Then we performed automated feature extraction. After certain feature set is obtained, we teased-out feature which are categorical, interdependent or composite. We applied varying machine learning models, producing both binary and categorical outcomes. We cross validated our results and re-tuned our feature set and our model, until we obtained satisfying results, with least false-positives. We concluded that not all the extracted features are significant, in fact some features are detrimental on the model performance. Once such features are factored-out, it results not only in better match, but also provides a significant gain in performance.

Talha Obaid, Email Security, Symantec at MLconf ATL 2017

Talha Obaid, Email Security, Symantec at MLconf ATL 2017

Talha Obaid, Email Security, Symantec at MLconf ATL 2017

Viewers also liked (18)

LN Renganarayana, Architect, ML Platform and Services and Madhura Dudhgaonkar...

LN Renganarayana, Architect, ML Platform and Services and Madhura Dudhgaonkar...

LN Renganarayana, Architect, ML Platform and Services and Madhura Dudhgaonkar...

Ashfaq Munshi, ML7 Fellow, Pepperdata

Ashfaq Munshi, ML7 Fellow, Pepperdata

Ashfaq Munshi, ML7 Fellow, Pepperdata

Jonas Schneider, Head of Engineering for Robotics, OpenAI

Jonas Schneider, Head of Engineering for Robotics, OpenAI

Jonas Schneider, Head of Engineering for Robotics, OpenAI

Matineh Shaker, Artificial Intelligence Scientist, Bonsai at MLconf SF 2017

Matineh Shaker, Artificial Intelligence Scientist, Bonsai at MLconf SF 2017

Matineh Shaker, Artificial Intelligence Scientist, Bonsai at MLconf SF 2017

Daniel Shank, Data Scientist, Talla at MLconf SF 2017

Daniel Shank, Data Scientist, Talla at MLconf SF 2017

Daniel Shank, Data Scientist, Talla at MLconf SF 2017

Venkatesh Ramanathan, Data Scientist, PayPal at MLconf ATL 2017

Venkatesh Ramanathan, Data Scientist, PayPal at MLconf ATL 2017

Venkatesh Ramanathan, Data Scientist, PayPal at MLconf ATL 2017

Xavier Amatriain, Cofounder & CTO, Curai at MLconf SF 2017

Xavier Amatriain, Cofounder & CTO, Curai at MLconf SF 2017

Xavier Amatriain, Cofounder & CTO, Curai at MLconf SF 2017

Jessica Rudd, PhD Student, Analytics and Data Science, Kennesaw State Univers...

Jessica Rudd, PhD Student, Analytics and Data Science, Kennesaw State Univers...

Jessica Rudd, PhD Student, Analytics and Data Science, Kennesaw State Univers...

Doug Eck, Research Scientist, Google Magenta, at MLconf SF 2017

Doug Eck, Research Scientist, Google Magenta, at MLconf SF 2017

Doug Eck, Research Scientist, Google Magenta, at MLconf SF 2017

Dr. Steve Liu, Chief Scientist, Tinder at MLconf SF 2017

Dr. Steve Liu, Chief Scientist, Tinder at MLconf SF 2017

Dr. Steve Liu, Chief Scientist, Tinder at MLconf SF 2017

Ryan West, Machine Learning Engineer, Nexosis at MLconf ATL 2017

Ryan West, Machine Learning Engineer, Nexosis at MLconf ATL 2017

Ryan West, Machine Learning Engineer, Nexosis at MLconf ATL 2017

Tamara G. Kolda, Distinguished Member of Technical Staff, Sandia National Lab...

Tamara G. Kolda, Distinguished Member of Technical Staff, Sandia National Lab...

Tamara G. Kolda, Distinguished Member of Technical Staff, Sandia National Lab...

Ashrith Barthur, Security Scientist, H2o.ai, at MLconf 2017

Ashrith Barthur, Security Scientist, H2o.ai, at MLconf 2017

Ashrith Barthur, Security Scientist, H2o.ai, at MLconf 2017

Rushin Shah, Engineering Manager, Facebook at MLconf SF 2017

Rushin Shah, Engineering Manager, Facebook at MLconf SF 2017

Rushin Shah, Engineering Manager, Facebook at MLconf SF 2017

Michael Alcorn, Sr. Software Engineer, Red Hat Inc. at MLconf SF 2017

Michael Alcorn, Sr. Software Engineer, Red Hat Inc. at MLconf SF 2017

Michael Alcorn, Sr. Software Engineer, Red Hat Inc. at MLconf SF 2017

Dr. June Andrews, Principal Data Scientist, Wise.io, From GE Digital at MLcon...

Dr. June Andrews, Principal Data Scientist, Wise.io, From GE Digital at MLcon...

Dr. June Andrews, Principal Data Scientist, Wise.io, From GE Digital at MLcon...

Anima Anadkumar, Principal Scientist, Amazon Web Services, Endowed Professor,...

Anima Anadkumar, Principal Scientist, Amazon Web Services, Endowed Professor,...

Anima Anadkumar, Principal Scientist, Amazon Web Services, Endowed Professor,...

Talha Obaid, Email Security, Symantec at MLconf ATL 2017

Talha Obaid, Email Security, Symantec at MLconf ATL 2017

Talha Obaid, Email Security, Symantec at MLconf ATL 2017

Similar to Alexandra Johnson, Software Engineer, SigOpt at MLconf ATL 2017

Using Bayesian Optimization to Tune Machine Learning Models

Using Bayesian Optimization to Tune Machine Learning Models

Using Bayesian Optimization to Tune Machine Learning Models

Using Bayesian Optimization to Tune Machine Learning Models

Using Bayesian Optimization to Tune Machine Learning Models

Using Bayesian Optimization to Tune Machine Learning Models

To build a decision-making system, we must provide answers to two sets of questions: (1) ""What will happen if I make decision X?"" and (2) ""How should I pick which decision to make?"". Typically, the first set of questions are answered with supervised learning: we build models to forecast whether someone will click on an ad, or visit a post. The second set of questions are more open-ended. In this talk, we will dive into how we can answer ""how"" questions, starting with heuristics and search. This will lead us to bandits, reinforcement learning, and Horizon: an open-source platform for training and deploying reinforcement learning models at massive scale. At Facebook, we are using Horizon, built using PyTorch 1.0 and Apache Spark, in a variety of AI-related and control tasks, spanning recommender systems, marketing & promotion distribution, and bandwidth optimization. The talk will cover the key components of Horizon and the lessons we learned along the way that influenced the development of the platform. Author: Jason Gauci

Horizon: Deep Reinforcement Learning at Scale

Horizon: Deep Reinforcement Learning at Scale

Horizon: Deep Reinforcement Learning at Scale

Search Engine Switching

Search Engine Switching

Search Engine Switching

Hemanth Kumar Mantri

Production ready big ml workflows from zero to hero daniel marcous @ waze

Production ready big ml workflows from zero to hero daniel marcous @ waze

Production ready big ml workflows from zero to hero daniel marcous @ waze

"Regular performance testing is one of the pillars of Kafka Streams’ reliability and efficiency. Beyond ensuring dependable releases, regular performance testing supports engineers in new feature development with the ability to easily test the performance impact of their features, compare different approaches, etc. In this session, Alex and John share their experience from developing, using, and maintaining a performance testing framework for Kafka Streams that has prevented multiple performance regressions over the last 5 years. They cover guiding principles and architecture, how to ensure statistical significance and stability of results, and how to automate regression detection for actionable notifications. This talk sheds light on how Apache Kafka is able to foster a vibrant open-source community while maintaining a high performance bar across many years and releases. It also empowers performance-minded engineers to avoid common pitfalls and bring high-quality performance testing to their own systems."

Automating Speed: A Proven Approach to Preventing Performance Regressions in ...

Automating Speed: A Proven Approach to Preventing Performance Regressions in ...

Automating Speed: A Proven Approach to Preventing Performance Regressions in ...

HostedbyConfluent

Small is Beautiful- Fully Automate your Test Case Design

Small is Beautiful- Fully Automate your Test Case Design

Small is Beautiful- Fully Automate your Test Case Design

Using SigOpt to Tune Deep Learning Models with Nervana Cloud

Using SigOpt to Tune Deep Learning Models with Nervana Cloud

Using SigOpt to Tune Deep Learning Models with Nervana Cloud

Webinar en colaboración de QAminds y Abstracta Tech Talks. Abstract: En estos días de lockdown y recesión económica muchas empresas están buscando formas de recortar costos por acá y por allá, y por supuesto, el testing es de las cosas que se suele recortar primero. El problema de recortar presupuesto y recursos para testing queda reflejado en el viejo dicho "pan para hoy hambre para mañana". En esta charla quiero compartir algunas estrategias con las que puedes optimizar costos de testing sin comprometer la calidad del sistema o producto que estás desarrollando.

Webinar: Estrategias para optimizar los costos de testing

Webinar: Estrategias para optimizar los costos de testing

Webinar: Estrategias para optimizar los costos de testing

Federico Toledo

One of the most difficult aspects of deep experimentation ― which requires a full stack solution and server-side testing ― is laying a solid foundation for success. Join Optimizely and WiderFunnel to learn best practices for going beyond client-side testing, and implementing a full stack experimentation strategy to drive results on the entire customer journey. -How to identify your key success metrics, such as customer retention and lifetime value -How to integrate experimentation into your product roadmap -How to start testing on your full customer journey

Getting Started with Server-Side Testing

Getting Started with Server-Side Testing

Getting Started with Server-Side Testing

Multi Model Machine Learning by Maximo Gurmendez and Beth Logan

Multi Model Machine Learning by Maximo Gurmendez and Beth Logan

Multi Model Machine Learning by Maximo Gurmendez and Beth Logan

Using Bayesian Optimization to Tune Machine Learning Models: In this talk we briefly introduce Bayesian Global Optimization as an efficient way to optimize machine learning model parameters, especially when evaluating different parameters is time-consuming or expensive. We will motivate the problem and give example applications. We will also talk about our development of a robust benchmark suite for our algorithms including test selection, metric design, infrastructure architecture, visualization, and comparison to other standard and open source methods. We will discuss how this evaluation framework empowers our research engineers to confidently and quickly make changes to our core optimization engine. We will end with an in-depth example of using these methods to tune the features and hyperparameters of a real world problem and give several real world applications.

Scott Clark, Co-Founder and CEO, SigOpt at MLconf SF 2016

Scott Clark, Co-Founder and CEO, SigOpt at MLconf SF 2016

Scott Clark, Co-Founder and CEO, SigOpt at MLconf SF 2016

MLConf 2016 SigOpt Talk by Scott Clark

MLConf 2016 SigOpt Talk by Scott Clark

MLConf 2016 SigOpt Talk by Scott Clark

[Webinar] Getting started with server-side testing - presented by WiderFunnel...

[Webinar] Getting started with server-side testing - presented by WiderFunnel...

[Webinar] Getting started with server-side testing - presented by WiderFunnel...

Alexandra Johnson, Software Engineer, SigOpt Alexandra works on everything from infrastructure to product features to blog posts. Previously, she worked on growth, APIs, and recommender systems at Polyvore (acquired by Yahoo). She majored in computer science at Carnegie Mellon University with a minor in discrete mathematics and logic, and during the summers she A/B tested recommendations at internships with Facebook and Rent the Runway. Abstract Summary: Common Problems In Hyperparameter Optimization: All large machine learning pipelines have tunable parameters, commonly referred to as hyperparameters. Hyperparameter optimization is the process by which we find the values for these parameters that cause our system to perform the best. SigOpt provides a Bayesian optimization platform that is commonly used for hyperparameter optimization, and I’m going to share some of the common problems we’ve seen when integrating into machine learning pipelines.

Alexandra Johnson, Software Engineer, SigOpt, at MLconf NYC 2017

Alexandra Johnson, Software Engineer, SigOpt, at MLconf NYC 2017

Alexandra Johnson, Software Engineer, SigOpt, at MLconf NYC 2017

Just like traditional applications development, machine learning involves writing code. One aspect where the two differ is the workflow. While software development follows a fairly linear process (design, develop, and deploy a feature), machine learning is a different beast. You work on a single feature, which is never 100% complete. You constantly run experiments, and re-design your model in depth at a rapid pace. Traditional tests are entirely useless. Validating whether you are on the right track takes minutes, if not hours. In this talk, we will take the example of a Machine Learning competition we recently participated in, the Kaggle Home Depot competition, to illustrate what "doing Machine Learning" looks like. We will explain the challenges we faced, and how we tackled them, setting up a harness to easily create and run experiments, while keeping our sanity. We will also draw comparisons with traditional software development, and highlight how some ideas translate from one context to the other, adapted to different constraints.

Agile experiments in Machine Learning with F#

Agile experiments in Machine Learning with F#

Agile experiments in Machine Learning with F#

Video Recommendation Engines as a Service

Video Recommendation Engines as a Service

Video Recommendation Engines as a Service

OutSystems Tips and Tricks

OutSystems Tips and Tricks

OutSystems Tips and Tricks

Tuning 2.0: Advanced Optimization Techniques Webinar

Tuning 2.0: Advanced Optimization Techniques Webinar

Tuning 2.0: Advanced Optimization Techniques Webinar

Recsys 2016 tutorial: Lessons learned from building real-life recommender sys...

Recsys 2016 tutorial: Lessons learned from building real-life recommender sys...

Recsys 2016 tutorial: Lessons learned from building real-life recommender sys...

Xavier Amatriain

Similar to Alexandra Johnson, Software Engineer, SigOpt at MLconf ATL 2017 (20)

Using Bayesian Optimization to Tune Machine Learning Models

Using Bayesian Optimization to Tune Machine Learning Models

Using Bayesian Optimization to Tune Machine Learning Models

Using Bayesian Optimization to Tune Machine Learning Models

Using Bayesian Optimization to Tune Machine Learning Models

Using Bayesian Optimization to Tune Machine Learning Models

Horizon: Deep Reinforcement Learning at Scale

Horizon: Deep Reinforcement Learning at Scale

Horizon: Deep Reinforcement Learning at Scale

Search Engine Switching

Search Engine Switching

Search Engine Switching

Production ready big ml workflows from zero to hero daniel marcous @ waze

Production ready big ml workflows from zero to hero daniel marcous @ waze

Production ready big ml workflows from zero to hero daniel marcous @ waze

Automating Speed: A Proven Approach to Preventing Performance Regressions in ...

Automating Speed: A Proven Approach to Preventing Performance Regressions in ...

Automating Speed: A Proven Approach to Preventing Performance Regressions in ...

Small is Beautiful- Fully Automate your Test Case Design

Small is Beautiful- Fully Automate your Test Case Design

Small is Beautiful- Fully Automate your Test Case Design

Using SigOpt to Tune Deep Learning Models with Nervana Cloud

Using SigOpt to Tune Deep Learning Models with Nervana Cloud

Using SigOpt to Tune Deep Learning Models with Nervana Cloud

Webinar: Estrategias para optimizar los costos de testing

Webinar: Estrategias para optimizar los costos de testing

Webinar: Estrategias para optimizar los costos de testing

Getting Started with Server-Side Testing

Getting Started with Server-Side Testing

Getting Started with Server-Side Testing

Multi Model Machine Learning by Maximo Gurmendez and Beth Logan

Multi Model Machine Learning by Maximo Gurmendez and Beth Logan

Multi Model Machine Learning by Maximo Gurmendez and Beth Logan

Scott Clark, Co-Founder and CEO, SigOpt at MLconf SF 2016

Scott Clark, Co-Founder and CEO, SigOpt at MLconf SF 2016

Scott Clark, Co-Founder and CEO, SigOpt at MLconf SF 2016

MLConf 2016 SigOpt Talk by Scott Clark

MLConf 2016 SigOpt Talk by Scott Clark

MLConf 2016 SigOpt Talk by Scott Clark

[Webinar] Getting started with server-side testing - presented by WiderFunnel...

[Webinar] Getting started with server-side testing - presented by WiderFunnel...

[Webinar] Getting started with server-side testing - presented by WiderFunnel...

Alexandra Johnson, Software Engineer, SigOpt, at MLconf NYC 2017

Alexandra Johnson, Software Engineer, SigOpt, at MLconf NYC 2017

Alexandra Johnson, Software Engineer, SigOpt, at MLconf NYC 2017

Agile experiments in Machine Learning with F#

Agile experiments in Machine Learning with F#

Agile experiments in Machine Learning with F#

Video Recommendation Engines as a Service

Video Recommendation Engines as a Service

Video Recommendation Engines as a Service

OutSystems Tips and Tricks

OutSystems Tips and Tricks

OutSystems Tips and Tricks

Tuning 2.0: Advanced Optimization Techniques Webinar

Tuning 2.0: Advanced Optimization Techniques Webinar

Tuning 2.0: Advanced Optimization Techniques Webinar

Recsys 2016 tutorial: Lessons learned from building real-life recommender sys...

Recsys 2016 tutorial: Lessons learned from building real-life recommender sys...

Recsys 2016 tutorial: Lessons learned from building real-life recommender sys...

More from MLconf

Understanding Human Impact: Social and Equity Assessments for AI Technologies Social and Equity Impact Assessments have broad applications but can be a useful tool to explore and mitigate for Machine Learning fairness issues and can be applied to product specific questions as a way to generate insights and learnings about users, as well as impacts on society broadly as a result of the deployment of new and emerging technologies. In this presentation, my goal is to advocate for and highlight the need to consult community and external stakeholder engagement to develop a new knowledge base and understanding of the human and social consequences of algorithmic decision making and to introduce principles, methods and process for these types of impact assessments.

Jamila Smith-Loud - Understanding Human Impact: Social and Equity Assessments...

Jamila Smith-Loud - Understanding Human Impact: Social and Equity Assessments...

Jamila Smith-Loud - Understanding Human Impact: Social and Equity Assessments...

The Brain’s Guide to Dealing with Context in Language Understanding Like the visual cortex, the regions of the brain involved in understanding language represent information hierarchically. But whereas the visual cortex organizes things into a spatial hierarchy, the language regions encode information into a hierarchy of timescale. This organization is key to our uniquely human ability to integrate semantic information across narratives. More and more, deep learning-based approaches to natural language understanding embrace models that incorporate contextual information at varying timescales. This has not only led to state-of-the art performance on many difficult natural language tasks, but also to breakthroughs in our understanding of brain activity. In this talk, we will discuss the important connection between language understanding and context at different timescales. We will explore how different deep learning architectures capture timescales in language and how closely their encodings mimic the brain. Along the way, we will uncover some surprising discoveries about what depth does and doesn’t buy you in deep recurrent neural networks. And we’ll describe a new, more flexible way to think about these architectures and ease design space exploration. Finally, we’ll discuss some of the exciting applications made possible by these breakthroughs.

Ted Willke - The Brain’s Guide to Dealing with Context in Language Understanding

Ted Willke - The Brain’s Guide to Dealing with Context in Language Understanding

Ted Willke - The Brain’s Guide to Dealing with Context in Language Understanding

Applying Computer Vision to Reduce Contamination in the Recycling Stream With China’s recent refusal of most foreign recyclables, North American waste haulers are scrambling to figure out how to make on-shore recycling cost-effective in order to continue providing recycling services. Recyclables that were once being shipped to China for manual sorting are now primarily being redirected to landfills or incinerators. Without a solution, a nearly $5 billion annual recycling market could come to a halt. Purity in the recycling stream is key to this effort as contaminants in the stream can increase the cost of operations, damage equipment and reduce the ability to create pure commodities suitable for creating recycled goods. This market disruption as a result of China’s new regulations, however, provides us the chance to re-examine and improve our current disposal & collection habits with modern monitoring & artificial intelligence technology. Using images from our in-dumpster cameras, Compology has developed an ML-based process that helps identify, measure and alert for contaminants in recycling containers before they are picked-up, helping keep the recycling stream clean. Our convolutional neural network flags potential instances of contamination inside a dumpster, enabling garbage haulers to know which containers have the wrong type of material inside. This allows them to provide targeted, timely education, and when appropriate, assess fines, to improve recycling compliance at the businesses and residences they serve, helping keep recycling services financially viable. In this presentation, we will walk through our ML-based contamination measurement and scoring process by showing how Waste Management, a national waste hauler, has experienced 57% contamination reduction in nearly 2,000 containers over six months, This progress shows significant strides towards financially viable recycling services.

Justin Armstrong - Applying Computer Vision to Reduce Contamination in the Re...

Justin Armstrong - Applying Computer Vision to Reduce Contamination in the Re...

Justin Armstrong - Applying Computer Vision to Reduce Contamination in the Re...

Quantum Computing: a Treasure Hunt, not a Gold Rush Quantum computers promise a significant step up in computational power over conventional computers, but also suffer a number of counterintuitive limitations --- both in their computational model and in leading lab implementations. In this talk, we review how quantum computers compete with conventional computers and how conventional computers try to hold their ground. Then we outline what stands in the way of successful quantum ML applications.

Igor Markov - Quantum Computing: a Treasure Hunt, not a Gold Rush

Igor Markov - Quantum Computing: a Treasure Hunt, not a Gold Rush

Igor Markov - Quantum Computing: a Treasure Hunt, not a Gold Rush

Data Labeling as Religious Experience One of the most common places to deploy a production machine learning systems is as a replacement for a legacy rules-based system that is having a hard time keeping up with new edge cases and requirements. I'll be walking through the process and tooling we used to help us design, train, and deploy a model to replace a set of static rules we had for handling invite spam at Slack, talk about what we learned, and discuss some problems to solve in order to make these migrations easier for everyone.

Josh Wills - Data Labeling as Religious Experience

Josh Wills - Data Labeling as Religious Experience

Josh Wills - Data Labeling as Religious Experience

Project GaitNet: Ushering in the ImageNet moment for human Gait kinematics The emergence of the upright human bipedal gait can be traced back 4 to 2.8 million years ago, to the now extinct hominin Australopithecus afarensis. Fine grained analysis of gait using the modern MEMS sensors found on all smartphones not just reveals a lot about the person’s orthopedic and neuromuscular health status, but also has enough idiosyncratic clues that it can be harnessed as a passive biometric. While there were many siloed attempts made by the machine learning community to model Bipedal Gait sensor data, these were done with small datasets oft collected in restricted academic environs. In this talk, we will introduce the ImageNet moment for human gait analysis by presenting 'Project GaitNet', the largest ever planet-sized motion sensor based human bipedal gait dataset ever curated. We’ll also present the associated state-of-the-art results in classifying humans harnessing novel deep neural architectures and the related success stories we have enjoyed in transfer-learning into disparate domains of human kinematics analysis.

Vinay Prabhu - Project GaitNet: Ushering in the ImageNet moment for human Gai...

Vinay Prabhu - Project GaitNet: Ushering in the ImageNet moment for human Gai...

Vinay Prabhu - Project GaitNet: Ushering in the ImageNet moment for human Gai...

Machine Learning Methods in Detecting Alzheimer’s Disease from Speech and Language Alzheimer's disease affects millions of people worldwide, and it is important to predict the disease as early and as accurate as possible. In this talk, I will discuss development of novel ML models that help classifying healthy people from those who develop Alzheimer's, using short samples of human speech. As an input to the model, features of different modalities are extracted from speech audio samples and transcriptions: (1) syntactic measures, such as e.g. production rules extracted from syntactic parse trees, (2) lexical measures, such as e.g. features of lexical richness and complexity and lexical norms, and (3) acoustic measures, such as e.g. standard Mel-frequency cepstral coefficients. I will present the ML model that detects cognitive impairment by reaching agreement among modalities. The resulting model is able to achieve state of the art performance in both supervised and semi-supervised manner, using manual transcripts of human speech. Additionally, I will discuss potential limitations of any fully-automated speech-based Alzheimer's disease detection model, focusing mostly on the analysis of the impact of a not-so-accurate automatic speech recognition (ASR) on the classification performance. To illustrate this, I will present the experiments with controlled amounts of artificially generated ASR errors and explain how the deletion errors affect Alzheimer's detection performance the most, due to their impact on the features of syntactic and lexical complexity.

Jekaterina Novikova - Machine Learning Methods in Detecting Alzheimer’s Disea...

Jekaterina Novikova - Machine Learning Methods in Detecting Alzheimer’s Disea...

Jekaterina Novikova - Machine Learning Methods in Detecting Alzheimer’s Disea...

Optimized Image Classification on the Cheap In this talk, we anchor on building an image classifier trained on the Stanford Cars dataset to evaluate two approaches to transfer learning -fine tuning and feature extraction- and the impact of hyperparameter optimization on these techniques. Once we define the most performant transfer learning technique for Stanford Cars, we will double the size of the dataset through image augmentation to boost the classifier’s performance. We will use Bayesian optimization to learn the hyperparameters associated with image transformations using the downstream image classifier’s performance as the guide. In conjunction with model performance, we will also focus on the features of these augmented images and the downstream implications for our image classifier. To both maximize model performance on a budget and explore the impact of optimization on these methods, we apply a particularly efficient implementation of Bayesian optimization to each of these architectures in this comparison. Our goal is to draw on a rigorous set of experimental results that can help us answer the question: how can resource-constrained teams make trade-offs between efficiency and effectiveness using pre-trained models?

Meghana Ravikumar - Optimized Image Classification on the Cheap

Meghana Ravikumar - Optimized Image Classification on the Cheap

Meghana Ravikumar - Optimized Image Classification on the Cheap

The Importance of Modeling Data Collection Data sets used in machine learning are often collected in a systematically biased way - certain data points are more likely to be collected than others. We call this "observation bias". For example, in health care, we are more likely to see lab tests when the patient is feeling unwell than otherwise. Failing to account for observation bias can, of course, result in poor predictions on new data. By contrast, properly accounting for this bias allows us to make better use of the data we do have. In this presentation, we discuss practical and theoretical approaches to dealing with observation bias. When the nature of the bias is known, there are simple adjustments we can make to nonparametric function estimation techniques, such as Gaussian Process models. We also discuss the scenario where the data collection model is unknown. In this case, there are steps we can take to estimate it from observed data. Finally, we demonstrate that having a small subset of data points that are known to be collected at random - that is, in an unbiased way - can vastly improve our ability to account for observation bias in the rest of the data set. My hope is that attendees of this presentation will be aware of the perils of observation bias in their own work, and be equipped with tools to address it.

Noam Finkelstein - The Importance of Modeling Data Collection

Noam Finkelstein - The Importance of Modeling Data Collection

Noam Finkelstein - The Importance of Modeling Data Collection

The Uncanny Valley of ML Every so often, the conundrum of the Uncanny Valley re-emerges as advanced technologies evolve from clearly experimental products to refined accepted technologies. We have seen its effects in robotics, computer graphics, and page load times. The debate of how to handle the new technology detracts from its benefits. When machine learning is added to human decision systems a similar effect can be measured in increased response time and decreased accuracy. These systems include radiology, judicial assignments, bus schedules, housing prices, power grids and a growing variety of applications. Unfortunately, the Uncanny Valley of ML can be hard to detect in these systems and can lead to degraded system performance when ML is introduced, at great expense. Here, we'll introduce key design principles for introducing ML into human decision systems to navigate around the Uncanny Valley and avoid its pitfalls.

June Andrews - The Uncanny Valley of ML

June Andrews - The Uncanny Valley of ML

June Andrews - The Uncanny Valley of ML

Deep Learning Architectures for Semantic Relation Detection Tasks Recognizing and distinguishing specific semantic relations from other types of semantic relations is an essential part of language understanding systems. Identifying expressions with similar and contrasting meanings is valuable for NLP systems which go beyond recognizing semantic relatedness and require to identify specific semantic relations. In this talk, I will first present novel techniques for creating labelled datasets required for training deep learning models for classifying semantic relations between phrases. I will further present various neural network architectures that integrate morphological features into integrated path-based and distributional relation detection algorithms and demonstrate that this model outperforms state-of-the-art models in distinguishing semantic relations and is capable of efficiently handling multi-word expressions.

Sneha Rajana - Deep Learning Architectures for Semantic Relation Detection Tasks

Sneha Rajana - Deep Learning Architectures for Semantic Relation Detection Tasks

Sneha Rajana - Deep Learning Architectures for Semantic Relation Detection Tasks

Building an Incrementally Trained, Local Taste Aware, Global Deep Learned Recommender System Model At Netflix, our main goal is to maximize our members’ enjoyment of the selected show by minimizing the amount of time it takes for them to find it. We try to achieve this goal by personalizing almost all the aspects of our product -- from what shows to recommend, to how to present these shows and construct their home-pages to what images to select per show, among many other things. Everything is recommendations for us and as an applied Machine Learning group, we spend our time building models for personalization that will eventually increase the joy and satisfaction of our members. In this talk we will primarily focus our attention on a) making a global deep learned recommender model that is regional tastes and popularity aware and b) adapting this model to changing taste preferences as well as dynamic catalog availability. We will first go through some standard recommender system models that use Matrix Factorization and Topic Models and then compare and contrast them with more powerful and higher capacity deep learning based models such as sequence models that use recurrent neural networks. We will show what it entails to build a global model that is aware of regional taste preferences and catalog availability. We will show how models that are built on simple Maximum Likelihood principle fail to do that. We will then describe one solution that we have employed in order to enable the global deep learned models to focus their attention on capturing regional taste preferences and changing catalog.In the latter half of the talk, we will discuss how we do incremental learning of deep learned recommender system models. Why do we need to do that ? Everything changes with time. Users’ tastes change with time. What’s available on Netflix and what’s popular also change over time. Therefore, updating or improving recommendation systems over time is necessary to bring more joy to users. In addition to how we apply incremental learning, we will discuss some of the challenges we face involving large-scale data preparation, infrastructure setup for incremental model training as well as pipeline scheduling. The incremental training enables us to serve fresher models trained on fresher and larger amounts of data. This helps our recommender system to nicely and quickly adapt to catalog and users’ taste changes, and improve overall performance.

Anoop Deoras - Building an Incrementally Trained, Local Taste Aware, Global D...

Anoop Deoras - Building an Incrementally Trained, Local Taste Aware, Global D...

Anoop Deoras - Building an Incrementally Trained, Local Taste Aware, Global D...

Vito Ostuni - The Voice: New Challenges in a Zero UI World The adoption of voice-enabled devices has seen an explosive growth in the last few years and music consumption is among the most popular use cases. Music personalization and recommendation plays a major role at Pandora in providing a daily delightful listening experience for millions of users. In turn, providing the same perfectly tailored listening experience through these novel voice interfaces brings new interesting challenges and exciting opportunities. In this talk we will describe how we apply personalization and recommendation techniques in three common voice scenarios which can be defined in terms of request types: known-item, thematic, and broad open-ended. We will describe how we use deep learning slot filling techniques and query classification to interpret the user intent and identify the main concepts in the query. We will also present the differences and challenges regarding evaluation of voice powered recommendation systems. Since pure voice interfaces do not contain visual UI elements, relevance labels need to be inferred through implicit actions such as play time, query reformulations or other types of session level information. Another difference is that while the typical recommendation task corresponds to recommending a ranked list of items, a voice play request translates into a single item play action. Thus, some considerations about closed feedback loops need to be made. In summary, improving the quality of voice interactions in music services is a relatively new challenge and many exciting opportunities for breakthroughs still remain. There are many new aspects of recommendation system interfaces to address to bring a delightful and effortless experience for voice users. We will share a few open challenges to solve for the future.

Vito Ostuni - The Voice: New Challenges in a Zero UI World

Vito Ostuni - The Voice: New Challenges in a Zero UI World

Vito Ostuni - The Voice: New Challenges in a Zero UI World

Anna choromanska - Data-driven Challenges in AI: Scale, Information Selection...

Anna choromanska - Data-driven Challenges in AI: Scale, Information Selection...

Anna choromanska - Data-driven Challenges in AI: Scale, Information Selection...

Janani Kalyanam - Machine Learning to Detect Illegal Online Sales of Prescrip...

Janani Kalyanam - Machine Learning to Detect Illegal Online Sales of Prescrip...

Janani Kalyanam - Machine Learning to Detect Illegal Online Sales of Prescrip...

Esperanza Lopez Aguilera - Using a Bayesian Neural Network in the Detection o...

Esperanza Lopez Aguilera - Using a Bayesian Neural Network in the Detection o...

Esperanza Lopez Aguilera - Using a Bayesian Neural Network in the Detection o...

Neel Sundaresan - Teaching a machine to code

Neel Sundaresan - Teaching a machine to code

Neel Sundaresan - Teaching a machine to code

Rishabh Mehrotra - Recommendations in a Marketplace: Personalizing Explainabl...

Rishabh Mehrotra - Recommendations in a Marketplace: Personalizing Explainabl...

Rishabh Mehrotra - Recommendations in a Marketplace: Personalizing Explainabl...

Soumith Chintala - Increasing the Impact of AI Through Better Software

Soumith Chintala - Increasing the Impact of AI Through Better Software

Soumith Chintala - Increasing the Impact of AI Through Better Software

Roy Lowrance - Predicting Bond Prices: Regime Changes

Roy Lowrance - Predicting Bond Prices: Regime Changes

Roy Lowrance - Predicting Bond Prices: Regime Changes

More from MLconf (20)

Jamila Smith-Loud - Understanding Human Impact: Social and Equity Assessments...

Jamila Smith-Loud - Understanding Human Impact: Social and Equity Assessments...

Jamila Smith-Loud - Understanding Human Impact: Social and Equity Assessments...

Ted Willke - The Brain’s Guide to Dealing with Context in Language Understanding

Ted Willke - The Brain’s Guide to Dealing with Context in Language Understanding

Ted Willke - The Brain’s Guide to Dealing with Context in Language Understanding

Justin Armstrong - Applying Computer Vision to Reduce Contamination in the Re...

Justin Armstrong - Applying Computer Vision to Reduce Contamination in the Re...

Justin Armstrong - Applying Computer Vision to Reduce Contamination in the Re...

Igor Markov - Quantum Computing: a Treasure Hunt, not a Gold Rush

Igor Markov - Quantum Computing: a Treasure Hunt, not a Gold Rush

Igor Markov - Quantum Computing: a Treasure Hunt, not a Gold Rush

Josh Wills - Data Labeling as Religious Experience

Josh Wills - Data Labeling as Religious Experience

Josh Wills - Data Labeling as Religious Experience

Vinay Prabhu - Project GaitNet: Ushering in the ImageNet moment for human Gai...

Vinay Prabhu - Project GaitNet: Ushering in the ImageNet moment for human Gai...

Vinay Prabhu - Project GaitNet: Ushering in the ImageNet moment for human Gai...

Jekaterina Novikova - Machine Learning Methods in Detecting Alzheimer’s Disea...

Jekaterina Novikova - Machine Learning Methods in Detecting Alzheimer’s Disea...

Jekaterina Novikova - Machine Learning Methods in Detecting Alzheimer’s Disea...

Meghana Ravikumar - Optimized Image Classification on the Cheap

Meghana Ravikumar - Optimized Image Classification on the Cheap

Meghana Ravikumar - Optimized Image Classification on the Cheap

Noam Finkelstein - The Importance of Modeling Data Collection

Noam Finkelstein - The Importance of Modeling Data Collection

Noam Finkelstein - The Importance of Modeling Data Collection

June Andrews - The Uncanny Valley of ML

June Andrews - The Uncanny Valley of ML

June Andrews - The Uncanny Valley of ML

Sneha Rajana - Deep Learning Architectures for Semantic Relation Detection Tasks

Sneha Rajana - Deep Learning Architectures for Semantic Relation Detection Tasks

Sneha Rajana - Deep Learning Architectures for Semantic Relation Detection Tasks

Anoop Deoras - Building an Incrementally Trained, Local Taste Aware, Global D...

Anoop Deoras - Building an Incrementally Trained, Local Taste Aware, Global D...

Anoop Deoras - Building an Incrementally Trained, Local Taste Aware, Global D...

Vito Ostuni - The Voice: New Challenges in a Zero UI World

Vito Ostuni - The Voice: New Challenges in a Zero UI World

Vito Ostuni - The Voice: New Challenges in a Zero UI World

Anna choromanska - Data-driven Challenges in AI: Scale, Information Selection...

Anna choromanska - Data-driven Challenges in AI: Scale, Information Selection...

Anna choromanska - Data-driven Challenges in AI: Scale, Information Selection...

Janani Kalyanam - Machine Learning to Detect Illegal Online Sales of Prescrip...

Janani Kalyanam - Machine Learning to Detect Illegal Online Sales of Prescrip...

Janani Kalyanam - Machine Learning to Detect Illegal Online Sales of Prescrip...

Esperanza Lopez Aguilera - Using a Bayesian Neural Network in the Detection o...

Esperanza Lopez Aguilera - Using a Bayesian Neural Network in the Detection o...

Esperanza Lopez Aguilera - Using a Bayesian Neural Network in the Detection o...

Neel Sundaresan - Teaching a machine to code

Neel Sundaresan - Teaching a machine to code

Neel Sundaresan - Teaching a machine to code

Rishabh Mehrotra - Recommendations in a Marketplace: Personalizing Explainabl...

Rishabh Mehrotra - Recommendations in a Marketplace: Personalizing Explainabl...

Rishabh Mehrotra - Recommendations in a Marketplace: Personalizing Explainabl...

Soumith Chintala - Increasing the Impact of AI Through Better Software

Soumith Chintala - Increasing the Impact of AI Through Better Software

Soumith Chintala - Increasing the Impact of AI Through Better Software

Roy Lowrance - Predicting Bond Prices: Regime Changes

Roy Lowrance - Predicting Bond Prices: Regime Changes

Roy Lowrance - Predicting Bond Prices: Regime Changes

Recently uploaded

Following the popularity of "Cloud Revolution: Exploring the New Wave of Serverless Spatial Data," we're thrilled to announce this much-anticipated encore webinar. In this sequel, we'll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you're building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Manulife - Insurer Transformation Award 2024

Manulife - Insurer Transformation Award 2024

Manulife - Insurer Transformation Award 2024

The Digital Insurer

Effective data discovery is crucial for maintaining compliance and mitigating risks in today's rapidly evolving privacy landscape. However, traditional manual approaches often struggle to keep pace with the growing volume and complexity of data. Join us for an insightful webinar where industry leaders from TrustArc and Privya will share their expertise on leveraging AI-powered solutions to revolutionize data discovery. You'll learn how to: - Effortlessly maintain a comprehensive, up-to-date data inventory - Harness code scanning insights to gain complete visibility into data flows leveraging the advantages of code scanning over DB scanning - Simplify compliance by leveraging Privya's integration with TrustArc - Implement proven strategies to mitigate third-party risks Our panel of experts will discuss real-world case studies and share practical strategies for overcoming common data discovery challenges. They'll also explore the latest trends and innovations in AI-driven data management, and how these technologies can help organizations stay ahead of the curve in an ever-changing privacy landscape.

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

2024: Domino Containers - The Next Step. News from the Domino Container commu...

2024: Domino Containers - The Next Step. News from the Domino Container commu...

2024: Domino Containers - The Next Step. News from the Domino Container commu...

Martijn de Jong

Strategies for Landing an Oracle DBA Job as a Fresher

Strategies for Landing an Oracle DBA Job as a Fresher

Strategies for Landing an Oracle DBA Job as a Fresher

Remote DBA Services

Webinar Recording: https://www.panagenda.com/webinars/why-teams-call-analytics-is-critical-to-your-entire-business Nothing is as frustrating and noticeable as being in an important call and being unable to see or hear the other person. Not surprising then, that issues with Teams calls are among the most common problems users call their helpdesk for. Having in depth insight into everything relevant going on at the user’s device, local network, ISP and Microsoft itself during the call is crucial for good Microsoft Teams Call quality support. To ensure a quick and adequate solution and to ensure your users get the most out of their Microsoft 365. But did you know that ‘bad calls’ are also an excellent indicator of other problems arising? Precisely because it is so noticeable!? Like the canary in the mine, bad calls can be early indicators of problems. Problems that might otherwise not have been noticed for a while but can have a big impact on productivity and satisfaction. Join this session by Christoph Adler to learn how true Microsoft Teams call quality analytics helped other organizations troubleshoot bad calls and identify and fix problems that impacted Teams calls or the use of Microsoft365 in general. See what it can do to keep your users happy and productive! In this session we will cover - Why CQD data alone is not enough to troubleshoot call problems - The importance of attributing call problems to the right call participant - What call quality analytics can do to help you quickly find, fix-, and prevent problems - Why having retrospective detailed insights matters - Real life examples of how others have used Microsoft Teams call quality monitoring to problem shoot problems with their ISP, network, device health and more.

Why Teams call analytics are critical to your entire business

Why Teams call analytics are critical to your entire business

Why Teams call analytics are critical to your entire business

Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows. We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases. This video focuses on the deployment of external web forms using Jotform for Bonterra Impact Management. This solution can be customized to your organization’s needs and deployed to support the common use cases below: - Intake and consent - Assessments - Surveys - Applications - Program registration Interested in deploying web form automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Jeffrey Haguewood

How to Troubleshoot Apps for the Modern Connected Worker

How to Troubleshoot Apps for the Modern Connected Worker

How to Troubleshoot Apps for the Modern Connected Worker

ICT role in 21st century education and its challenges

ICT role in 21st century education and its challenges

ICT role in 21st century education and its challenges

rafiqahmad00786416

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Scaling API-first – The story of a global engineering organization Ian Reasor, Senior Computer Scientist - Adobe Radu Cotescu, Senior Computer Scientist - Adobe Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Artificial Intelligence Chap.5 : Uncertainty

Artificial Intelligence Chap.5 : Uncertainty

Artificial Intelligence Chap.5 : Uncertainty

Khushali Kathiriya

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

This presentations targets students or working professionals. You may know Google for search, YouTube, Android, Chrome, and Gmail, but did you know Google has many developer tools, platforms & APIs? This comprehensive yet still high-level overview outlines the most impactful tools for where to run your code, store & analyze your data. It will also inspire you as to what's possible. This talk is 50 minutes in length.

Powerful Google developer tools for immediate impact! (2023-24 C)

Powerful Google developer tools for immediate impact! (2023-24 C)

Powerful Google developer tools for immediate impact! (2023-24 C)

Architecting Cloud Native Applications

Architecting Cloud Native Applications

Architecting Cloud Native Applications

Data Cloud, More than a CDP by Matt Robison

Data Cloud, More than a CDP by Matt Robison

Data Cloud, More than a CDP by Matt Robison

Anna Loughnan Colquhoun

Whatsapp Number Escorts Call girls 8617370543 Available 24x7 Navi Mumbai Call Girls Service Offer Genuine VIP Model Escorts Call Girls in Your Budget. Navi Mumbai Call Girls Service Provide Real Call Girls Number. Make Your Sexual Pleasure Memorable with Our Navi Mumbai Call Girls at Affordable Price. Top VIP Escorts Call Girls, High Profile Independent Escorts Call Girls, Housewife Women Escorts Call Girl, College Girls Escorts Call Girls, Russian Escorts Call girls Service in Your Budget.

Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model

In the thrilling conclusion to 2023, ransomware groups had a banner year, really outdoing themselves in the "make everyone's life miserable" department. LockBit 3.0 took gold in the hacking olympics, followed by the plucky upstarts Clop and ALPHV/BlackCat. Apparently, 48% of organizations were feeling left out and decided to get in on the cyber attack action. Business services won the "most likely to get digitally mugged" award, with education and retail nipping at their heels. Hackers expanded their repertoire beyond boring old encryption to the much more exciting world of extortion. The US, UK and Canada took top honors in the "countries most likely to pay up" category. Bitcoins were the currency of choice for discerning hackers, because who doesn't love untraceable money?

Ransomware_Q4_2023. The report. [EN].pdf

Ransomware_Q4_2023. The report. [EN].pdf

Ransomware_Q4_2023. The report. [EN].pdf

Overkill Security

Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...

Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...

Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...

The value of a flexible API Management solution for Open Banking Steve Melan, Manager for IT Innovation and Architecture - State's and Saving's Bank of Luxembourg Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The value of a flexible API Management solution for O...

Apidays New York 2024 - The value of a flexible API Management solution for O...

Apidays New York 2024 - The value of a flexible API Management solution for O...

Recently uploaded (20)

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Manulife - Insurer Transformation Award 2024

Manulife - Insurer Transformation Award 2024

Manulife - Insurer Transformation Award 2024

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

2024: Domino Containers - The Next Step. News from the Domino Container commu...

2024: Domino Containers - The Next Step. News from the Domino Container commu...

2024: Domino Containers - The Next Step. News from the Domino Container commu...

Strategies for Landing an Oracle DBA Job as a Fresher

Strategies for Landing an Oracle DBA Job as a Fresher

Strategies for Landing an Oracle DBA Job as a Fresher

Why Teams call analytics are critical to your entire business

Why Teams call analytics are critical to your entire business

Why Teams call analytics are critical to your entire business

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

How to Troubleshoot Apps for the Modern Connected Worker

How to Troubleshoot Apps for the Modern Connected Worker

How to Troubleshoot Apps for the Modern Connected Worker

ICT role in 21st century education and its challenges

ICT role in 21st century education and its challenges

ICT role in 21st century education and its challenges

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Artificial Intelligence Chap.5 : Uncertainty

Artificial Intelligence Chap.5 : Uncertainty

Artificial Intelligence Chap.5 : Uncertainty

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

Powerful Google developer tools for immediate impact! (2023-24 C)

Powerful Google developer tools for immediate impact! (2023-24 C)

Powerful Google developer tools for immediate impact! (2023-24 C)

Architecting Cloud Native Applications

Architecting Cloud Native Applications

Architecting Cloud Native Applications

Data Cloud, More than a CDP by Matt Robison

Data Cloud, More than a CDP by Matt Robison

Data Cloud, More than a CDP by Matt Robison

Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Ransomware_Q4_2023. The report. [EN].pdf

Ransomware_Q4_2023. The report. [EN].pdf

Ransomware_Q4_2023. The report. [EN].pdf

Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...

Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...

Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...

Apidays New York 2024 - The value of a flexible API Management solution for O...

Apidays New York 2024 - The value of a flexible API Management solution for O...

Apidays New York 2024 - The value of a flexible API Management solution for O...

Alexandra Johnson, Software Engineer, SigOpt at MLconf ATL 2017

1. Best Practices for Hyperparameter Optimization Alexandra Johnson @alexandraj777

2. Example: Beating Vegas Scott Clark. Using Model Tuning to Beat Vegas.

3. Terminology ● Optimization ● Hyperparameter Optimization ● Hyperparameter tuning ● Model tuning

4. Tune the Whole Pipeline

5. Optimize all Parameters at Once TensorFlow Playground

6. Include Feature Parameters

7. Include Feature Parameters

8. Choosing a Metric ● Balance long-term and short-term goals ● Question underlying assumptions ● Example from Microsoft

9. Composite Metric Example: Lifetime Value clicks*wclicks + likes*wlikes + views*wviews

10. Choose Multiple Metrics ● Balance competing metrics ● Explore entire result space Image from PhD Comics

11. Avoiding Overfitting

12. Get A Suggestion

13. Shuffle and Split Data

14. Train the Model

15. Test the Performance

16. Repeat Shuffle Train Evaluate

17. Report An Observation

18. Repeat the Entire Process Shuffle Train Evaluate

19. Optimization Methods

20. Hand Tuning ● Hand tuning is time consuming and expensive ● Algorithms can quickly and cheaply beat expert tuning

21. Grid Search Random Search Bayesian Optimization Alternatives to Hand Tuning

22. No Grid Search Hyper- parameters Model Evaluations 2 100 3 1,000 4 10,000 5 100,000

23. No Random Search ● Theoretically more effective than grid search ● Large variance in results ● No intelligence

24. Bayesian Optimization ● Explore/exploit ● Ideal for "expensive" optimization ● No requirements on: convex, differentiable, continuous

25. Alternatives to Bayesian Optimization Genetic algorithms Particle-based methods Convex optimizers Simulated annealing To name a few...

26. Takeaways ●Optimize the entire pipeline ●Ensure generalization ●Use Bayesian optimization

27. Thank You! blog.sigopt.com sigopt.com/research

Editor's Notes

Hyperparameter Optimization was the difference between making money and losing money