Ewa Dominowska – Engineering Manager, Facebook at MLconf ATL

•

10 gefällt mir•4,619 views

In the last decade, Facebook has quickly risen to become the most popular social networking and communication site in the world, with over 750 million daily active users. In this talk, I describe the advertising systems that we have developed to support and complement that network. With over one million active advertisers, in order to select what ads each person sees, Facebook’s ad ranking system evaluates many trillion candidate matches every day. I will share a few practical lessons gathered from working on machine learning at that scale and cover some of the broad learnings and improvements that we have made. I will also relate this to the application of machine learning in online advertising overall, and suggest that understating what separates the current systems and approaches from the real world is more important than striving to achieve perfection.

▪
▪
▪
▪
▪
▪
▪

▪
▪
▪
▪
▪
▪
▪
▪
▪
▪
▪
▪
▪
▪
▪

•
•
•
•
•
•

•
•
•

¢
¢
¢

¢
¢
¢

¢
-¢
¢
-¢
¢
+¢

¢
-¢
¢

▪
•
•
•
•
•

w11
Σ
w12
w13
w14
w1n
w21
w22
w23
w24
w2n
•
•
•
•

ctr1
Σ
ctr2
ctr3
ctr4
ctrn
ctr1
ctr2
ctr3
ctr4
ctrn
•
•
•
•
•
w1
w2

0.02
0.24
0.55
0.74
0.01
0.15
0.48
0.69
•
•
•
•
Σ

w11
Σ
w12
w13
w14
w21
w22
w23
w24

f
0%
100%
200%
300%
400%
500%
600%
0
50
100
150
Time Elapsed (hours)

f
0%
100%
200%
300%
400%
500%
600%
0
50
100
150
Time Elapsed
(hours)

•
•
•
•
•
•
•

▪
▪
▪
▪

▪
▪
▪
▪
▪
▪
▪
▪
▪

▪
▪
▪
▪
▪
▪
▪
▪
▪
▪
▪

▪
▪
▪
▪
▪
▪
▪

▪
▪
▪
▪
▪
▪
▪

▪
▪
▪
▪
▪
▪
▪
▪
▪

Ewa Dominowska – Engineering Manager, Facebook at MLconf ATL

Weitere ähnliche Inhalte

Andere mochten auch

Marc Hergenröther

Marc Hergenröther

Marc Hergenröther

Adknowledge is a digital advertising marketplace for all digital platforms: desktop, mobile, tablet or laptop. Their AdParlor is the leader in managing large Facebook Ad campaigns through full-service or self-service solutions. At the App Promotion Summit Berlin, Markus Von Der Luehe from Adknowledge talks about Facebook app advertising and gives lessons from 4m installs. How to plan your Facebook campaign, how to optimize target and how to evaluate performance.

'Facebook app advertising' - Markus Von Der Luehe at App Promotion Summit Berlin

'Facebook app advertising' - Markus Von Der Luehe at App Promotion Summit Berlin

'Facebook app advertising' - Markus Von Der Luehe at App Promotion Summit Berlin

App Promotion Summit Conference

Gerard O'Hara, Head of IT EMEA at Facebook - How the Facebook IT department i...

Gerard O'Hara, Head of IT EMEA at Facebook - How the Facebook IT department i...

Gerard O'Hara, Head of IT EMEA at Facebook - How the Facebook IT department i...

Global Business Events

'Best practices to deliver Lifetime Value Optimization' - Kaya Taner at App P...

'Best practices to deliver Lifetime Value Optimization' - Kaya Taner at App P...

'Best practices to deliver Lifetime Value Optimization' - Kaya Taner at App P...

App Promotion Summit Conference

Sm2 innovation summit nyc how to get the most out of twitter's new mobile app...

Sm2 innovation summit nyc how to get the most out of twitter's new mobile app...

Sm2 innovation summit nyc how to get the most out of twitter's new mobile app...

Profitable Facebook Marketing by Mari Smith - Social Media Marketing World 20...

Profitable Facebook Marketing by Mari Smith - Social Media Marketing World 20...

Profitable Facebook Marketing by Mari Smith - Social Media Marketing World 20...

Recording Date: 2/6/14 Presenter: Luke Walsh A modular approach to redesign is a perfect fit for the tools and features found in Enhanced WebAssign (EWA). In this session, we will explore the powerful resources found in EWA, showing how simple they are to implement for instructors and keep students engaged and elevated in their thinking. Come learn how to harness the power of EWA and get your developmental math students learning math, not just doing math.

Enhancing a Modular Redesign with Enhanced WebAssign

Enhancing a Modular Redesign with Enhanced WebAssign

Enhancing a Modular Redesign with Enhanced WebAssign

Cengage Learning

Abstract: Near real-time Updates for Cooccurrence-based Recommenders Most recommendation algorithms are inherently batch oriented and require all relevant history to be processed. In some contexts such as music, this does not cause significant problems because waiting a day or three before recommendations are available for new items doesn’t significantly change their impact. In other contexts, the value of items drops precipitously with time so that recommending day-old items has little value to users. In this talk, I will describe how a large-scale multi-modal cooccurrence recommender can be extended to include near real-time updates. In addition, I will show how these real-time updates are compatible with delivery of recommendations via search engines.

Ted Dunning, Chief Application Architect, MapR at MLconf SF

Ted Dunning, Chief Application Architect, MapR at MLconf SF

Ted Dunning, Chief Application Architect, MapR at MLconf SF

Abstract: Introducing the Metric Optimization Engine (MOE); an open source, black box, Bayesian Global Optimization engine for optimal experimental design. In this talk we will introduce MOE, the Metric Optimization Engine. MOE is an efficient way to optimize a system’s parameters, when evaluating parameters is time-consuming or expensive. It can be used to help tackle a myriad of problems including optimizing a system’s click-through or conversion rate via A/B testing, tuning parameters of a machine learning prediction method or expensive batch job, designing an engineering system or finding the optimal parameters of a real-world experiment. MOE is ideal for problems in which the optimization problem’s objective function is a black box, not necessarily convex or concave, derivatives are unavailable, and we seek a global optimum, rather than just a local one. This ability to handle black-box objective functions allows us to use MOE to optimize nearly any system, without requiring any internal knowledge or access. To use MOE, we simply need to specify some objective function, some set of parameters, and any historical data we may have from previous evaluations of the objective function. MOE then finds the set of parameters that maximize (or minimize) the objective function, while evaluating the objective function as few times as possible. This is done internally using Bayesian Global Optimization on a Gaussian Process model of the underlying system and finding the points of highest Expected Improvement to sample next. MOE provides easy to use Python, C++, CUDA and REST interfaces to accomplish these goals and is fully open source. We will present the motivation and background, discuss the implementation and give real-world examples.

Scott Clark, Software Engineer, Yelp at MLconf SF

Scott Clark, Software Engineer, Yelp at MLconf SF

Scott Clark, Software Engineer, Yelp at MLconf SF

Abstract: One of the challenges in big data analytics lies in being able to reason collectively about extremely large, heterogeneous, incomplete, noisy interlinked data. We need data science techniques which an represent and reason effectively with this form of rich and multi-relational graph data. In this presentation, I will describe some common collective inference patterns needed for graph data including: collective classification (predicting missing labels for nodes in a network), link prediction (predicting potential edges), and entity resolution (determining when two nodes refer to the same underlying entity). I will describe three key capabilities required: relational feature construction, collective inference, and scaling. Finally, I briefly describe some of the cutting edge analytic tools being developed within the machine learning, AI, and database communities to address these challenges.

Lise Getoor, Professor, Computer Science, UC Santa Cruz at MLconf SF

Lise Getoor, Professor, Computer Science, UC Santa Cruz at MLconf SF

Lise Getoor, Professor, Computer Science, UC Santa Cruz at MLconf SF

Abstract: How graphs became just another big data primitive Graph-shaped data is used in product recommendation systems, social network analysis, network threat detection, image de-noising, and many other important applications. And, a growing number of these applications will benefit from parallel distributed processing for graph featuring engineering, model training, and model serving. But today’s graph tools are riddled with limitations and shortcomings, such as a lack of language bindings, streaming support, and seamless integration with other popular data services. In this talk, we’ll argue that the key to doing more with graphs is doing less with specialized systems and more with systems already good at handling data of other shapes. We’ll examine some practical data science workflows to further motivate this argument and we’ll talk about some of the things that Intel is doing with the open source community and industry to make graphs just another big data primitive.

Ted Willke, Senior Principal Engineer & GM, Datacenter Group, Intel at MLconf SF

Ted Willke, Senior Principal Engineer & GM, Datacenter Group, Intel at MLconf SF

Ted Willke, Senior Principal Engineer & GM, Datacenter Group, Intel at MLconf SF

InMobi inDecode - Optimizing for LTV

InMobi inDecode - Optimizing for LTV

InMobi inDecode - Optimizing for LTV

Join Datacratic for the Profiling of Engagers and Converters with Audience Analytics and Look-alike Modeling discussion at the conference. How much are you able to learn about your current email and site converters? Do you have a way to extract learned attributes of your best audiences to guide and optimize your audience profile and personas? In this session, we will do deep dive into audience analytics capabilities that will help you discover new audiences and drive additional scale for digital marketing programs.

Profiling of Engagers and Converters with Audience Analytics and Look-alike M...

Profiling of Engagers and Converters with Audience Analytics and Look-alike M...

Profiling of Engagers and Converters with Audience Analytics and Look-alike M...

Lessons learned from Running Hundreds of Kaggle Competitions: At Kaggle, we've run hundreds of machine learning competitions and seen over 80,000 data scientists make submissions. One thing is clear: winning competitions isn't random. We've learned that certain tools and methodologies work consistently well on different types of problems. Many participants make common mistakes (such as overfitting) that should be actively avoided. Similarly, competition hosts have their own set of pitfalls (such as data leakage). In this talk, I'll share what goes into a winning competition toolkit along with some war stories on what to avoid. Additionally, I’ll share what we’re seeing on the collaborative side of competitions. Our community is showing an increasing amount of collaboration in developing machine learning models and analytic solutions. I'll showcase examples of this and discuss how these types of collaboration will improve how data science is learned and applied.

Ben Hamner, Co-founder and CTO, Kaggle at MLconf SF - 11/13/15

Ben Hamner, Co-founder and CTO, Kaggle at MLconf SF - 11/13/15

Ben Hamner, Co-founder and CTO, Kaggle at MLconf SF - 11/13/15

These are slides presented at MLconf in San Francisco, November 14, 2014. I share the approach to real-time machine learning for recommender systems developed at if(we). We achieve rapid iterative cycles by adhering to a strict approach to structuring and accessing our data, as well as to building the online features that comprise our models. These developments support teams of data scientist and data engineers, who work together to solve complex recommendation problems. We also introduce the Antelope Realtime Events framework, an open source demonstration application which derives from our scalable proprietary software stack.

Agile Machine Learning for Real-time Recommender Systems

Agile Machine Learning for Real-time Recommender Systems

Agile Machine Learning for Real-time Recommender Systems

Johann Schleier-Smith

InMobi inDecode - How to Acquire & Retain High LTV Users

InMobi inDecode - How to Acquire & Retain High LTV Users

InMobi inDecode - How to Acquire & Retain High LTV Users

Andere mochten auch (16)

Marc Hergenröther

Marc Hergenröther

Marc Hergenröther

'Facebook app advertising' - Markus Von Der Luehe at App Promotion Summit Berlin

'Facebook app advertising' - Markus Von Der Luehe at App Promotion Summit Berlin

'Facebook app advertising' - Markus Von Der Luehe at App Promotion Summit Berlin

Gerard O'Hara, Head of IT EMEA at Facebook - How the Facebook IT department i...

Gerard O'Hara, Head of IT EMEA at Facebook - How the Facebook IT department i...

Gerard O'Hara, Head of IT EMEA at Facebook - How the Facebook IT department i...

'Best practices to deliver Lifetime Value Optimization' - Kaya Taner at App P...

'Best practices to deliver Lifetime Value Optimization' - Kaya Taner at App P...

'Best practices to deliver Lifetime Value Optimization' - Kaya Taner at App P...

Sm2 innovation summit nyc how to get the most out of twitter's new mobile app...

Sm2 innovation summit nyc how to get the most out of twitter's new mobile app...

Sm2 innovation summit nyc how to get the most out of twitter's new mobile app...

Profitable Facebook Marketing by Mari Smith - Social Media Marketing World 20...

Profitable Facebook Marketing by Mari Smith - Social Media Marketing World 20...

Profitable Facebook Marketing by Mari Smith - Social Media Marketing World 20...

Enhancing a Modular Redesign with Enhanced WebAssign

Enhancing a Modular Redesign with Enhanced WebAssign

Enhancing a Modular Redesign with Enhanced WebAssign

Ted Dunning, Chief Application Architect, MapR at MLconf SF

Ted Dunning, Chief Application Architect, MapR at MLconf SF

Ted Dunning, Chief Application Architect, MapR at MLconf SF

Scott Clark, Software Engineer, Yelp at MLconf SF

Scott Clark, Software Engineer, Yelp at MLconf SF

Scott Clark, Software Engineer, Yelp at MLconf SF

Lise Getoor, Professor, Computer Science, UC Santa Cruz at MLconf SF

Lise Getoor, Professor, Computer Science, UC Santa Cruz at MLconf SF

Lise Getoor, Professor, Computer Science, UC Santa Cruz at MLconf SF

Ted Willke, Senior Principal Engineer & GM, Datacenter Group, Intel at MLconf SF

Ted Willke, Senior Principal Engineer & GM, Datacenter Group, Intel at MLconf SF

Ted Willke, Senior Principal Engineer & GM, Datacenter Group, Intel at MLconf SF

InMobi inDecode - Optimizing for LTV

InMobi inDecode - Optimizing for LTV

InMobi inDecode - Optimizing for LTV

Profiling of Engagers and Converters with Audience Analytics and Look-alike M...

Profiling of Engagers and Converters with Audience Analytics and Look-alike M...

Profiling of Engagers and Converters with Audience Analytics and Look-alike M...

Ben Hamner, Co-founder and CTO, Kaggle at MLconf SF - 11/13/15

Ben Hamner, Co-founder and CTO, Kaggle at MLconf SF - 11/13/15

Ben Hamner, Co-founder and CTO, Kaggle at MLconf SF - 11/13/15

Agile Machine Learning for Real-time Recommender Systems

Agile Machine Learning for Real-time Recommender Systems

Agile Machine Learning for Real-time Recommender Systems

InMobi inDecode - How to Acquire & Retain High LTV Users

InMobi inDecode - How to Acquire & Retain High LTV Users

InMobi inDecode - How to Acquire & Retain High LTV Users

Mehr von MLconf

Understanding Human Impact: Social and Equity Assessments for AI Technologies Social and Equity Impact Assessments have broad applications but can be a useful tool to explore and mitigate for Machine Learning fairness issues and can be applied to product specific questions as a way to generate insights and learnings about users, as well as impacts on society broadly as a result of the deployment of new and emerging technologies. In this presentation, my goal is to advocate for and highlight the need to consult community and external stakeholder engagement to develop a new knowledge base and understanding of the human and social consequences of algorithmic decision making and to introduce principles, methods and process for these types of impact assessments.

Jamila Smith-Loud - Understanding Human Impact: Social and Equity Assessments...

Jamila Smith-Loud - Understanding Human Impact: Social and Equity Assessments...

Jamila Smith-Loud - Understanding Human Impact: Social and Equity Assessments...

The Brain’s Guide to Dealing with Context in Language Understanding Like the visual cortex, the regions of the brain involved in understanding language represent information hierarchically. But whereas the visual cortex organizes things into a spatial hierarchy, the language regions encode information into a hierarchy of timescale. This organization is key to our uniquely human ability to integrate semantic information across narratives. More and more, deep learning-based approaches to natural language understanding embrace models that incorporate contextual information at varying timescales. This has not only led to state-of-the art performance on many difficult natural language tasks, but also to breakthroughs in our understanding of brain activity. In this talk, we will discuss the important connection between language understanding and context at different timescales. We will explore how different deep learning architectures capture timescales in language and how closely their encodings mimic the brain. Along the way, we will uncover some surprising discoveries about what depth does and doesn’t buy you in deep recurrent neural networks. And we’ll describe a new, more flexible way to think about these architectures and ease design space exploration. Finally, we’ll discuss some of the exciting applications made possible by these breakthroughs.

Ted Willke - The Brain’s Guide to Dealing with Context in Language Understanding

Ted Willke - The Brain’s Guide to Dealing with Context in Language Understanding

Ted Willke - The Brain’s Guide to Dealing with Context in Language Understanding

Applying Computer Vision to Reduce Contamination in the Recycling Stream With China’s recent refusal of most foreign recyclables, North American waste haulers are scrambling to figure out how to make on-shore recycling cost-effective in order to continue providing recycling services. Recyclables that were once being shipped to China for manual sorting are now primarily being redirected to landfills or incinerators. Without a solution, a nearly $5 billion annual recycling market could come to a halt. Purity in the recycling stream is key to this effort as contaminants in the stream can increase the cost of operations, damage equipment and reduce the ability to create pure commodities suitable for creating recycled goods. This market disruption as a result of China’s new regulations, however, provides us the chance to re-examine and improve our current disposal & collection habits with modern monitoring & artificial intelligence technology. Using images from our in-dumpster cameras, Compology has developed an ML-based process that helps identify, measure and alert for contaminants in recycling containers before they are picked-up, helping keep the recycling stream clean. Our convolutional neural network flags potential instances of contamination inside a dumpster, enabling garbage haulers to know which containers have the wrong type of material inside. This allows them to provide targeted, timely education, and when appropriate, assess fines, to improve recycling compliance at the businesses and residences they serve, helping keep recycling services financially viable. In this presentation, we will walk through our ML-based contamination measurement and scoring process by showing how Waste Management, a national waste hauler, has experienced 57% contamination reduction in nearly 2,000 containers over six months, This progress shows significant strides towards financially viable recycling services.

Justin Armstrong - Applying Computer Vision to Reduce Contamination in the Re...

Justin Armstrong - Applying Computer Vision to Reduce Contamination in the Re...

Justin Armstrong - Applying Computer Vision to Reduce Contamination in the Re...

Quantum Computing: a Treasure Hunt, not a Gold Rush Quantum computers promise a significant step up in computational power over conventional computers, but also suffer a number of counterintuitive limitations --- both in their computational model and in leading lab implementations. In this talk, we review how quantum computers compete with conventional computers and how conventional computers try to hold their ground. Then we outline what stands in the way of successful quantum ML applications.

Igor Markov - Quantum Computing: a Treasure Hunt, not a Gold Rush

Igor Markov - Quantum Computing: a Treasure Hunt, not a Gold Rush

Igor Markov - Quantum Computing: a Treasure Hunt, not a Gold Rush

Data Labeling as Religious Experience One of the most common places to deploy a production machine learning systems is as a replacement for a legacy rules-based system that is having a hard time keeping up with new edge cases and requirements. I'll be walking through the process and tooling we used to help us design, train, and deploy a model to replace a set of static rules we had for handling invite spam at Slack, talk about what we learned, and discuss some problems to solve in order to make these migrations easier for everyone.

Josh Wills - Data Labeling as Religious Experience

Josh Wills - Data Labeling as Religious Experience

Josh Wills - Data Labeling as Religious Experience

Project GaitNet: Ushering in the ImageNet moment for human Gait kinematics The emergence of the upright human bipedal gait can be traced back 4 to 2.8 million years ago, to the now extinct hominin Australopithecus afarensis. Fine grained analysis of gait using the modern MEMS sensors found on all smartphones not just reveals a lot about the person’s orthopedic and neuromuscular health status, but also has enough idiosyncratic clues that it can be harnessed as a passive biometric. While there were many siloed attempts made by the machine learning community to model Bipedal Gait sensor data, these were done with small datasets oft collected in restricted academic environs. In this talk, we will introduce the ImageNet moment for human gait analysis by presenting 'Project GaitNet', the largest ever planet-sized motion sensor based human bipedal gait dataset ever curated. We’ll also present the associated state-of-the-art results in classifying humans harnessing novel deep neural architectures and the related success stories we have enjoyed in transfer-learning into disparate domains of human kinematics analysis.

Vinay Prabhu - Project GaitNet: Ushering in the ImageNet moment for human Gai...

Vinay Prabhu - Project GaitNet: Ushering in the ImageNet moment for human Gai...

Vinay Prabhu - Project GaitNet: Ushering in the ImageNet moment for human Gai...

Machine Learning Methods in Detecting Alzheimer’s Disease from Speech and Language Alzheimer's disease affects millions of people worldwide, and it is important to predict the disease as early and as accurate as possible. In this talk, I will discuss development of novel ML models that help classifying healthy people from those who develop Alzheimer's, using short samples of human speech. As an input to the model, features of different modalities are extracted from speech audio samples and transcriptions: (1) syntactic measures, such as e.g. production rules extracted from syntactic parse trees, (2) lexical measures, such as e.g. features of lexical richness and complexity and lexical norms, and (3) acoustic measures, such as e.g. standard Mel-frequency cepstral coefficients. I will present the ML model that detects cognitive impairment by reaching agreement among modalities. The resulting model is able to achieve state of the art performance in both supervised and semi-supervised manner, using manual transcripts of human speech. Additionally, I will discuss potential limitations of any fully-automated speech-based Alzheimer's disease detection model, focusing mostly on the analysis of the impact of a not-so-accurate automatic speech recognition (ASR) on the classification performance. To illustrate this, I will present the experiments with controlled amounts of artificially generated ASR errors and explain how the deletion errors affect Alzheimer's detection performance the most, due to their impact on the features of syntactic and lexical complexity.

Jekaterina Novikova - Machine Learning Methods in Detecting Alzheimer’s Disea...

Jekaterina Novikova - Machine Learning Methods in Detecting Alzheimer’s Disea...

Jekaterina Novikova - Machine Learning Methods in Detecting Alzheimer’s Disea...

Optimized Image Classification on the Cheap In this talk, we anchor on building an image classifier trained on the Stanford Cars dataset to evaluate two approaches to transfer learning -fine tuning and feature extraction- and the impact of hyperparameter optimization on these techniques. Once we define the most performant transfer learning technique for Stanford Cars, we will double the size of the dataset through image augmentation to boost the classifier’s performance. We will use Bayesian optimization to learn the hyperparameters associated with image transformations using the downstream image classifier’s performance as the guide. In conjunction with model performance, we will also focus on the features of these augmented images and the downstream implications for our image classifier. To both maximize model performance on a budget and explore the impact of optimization on these methods, we apply a particularly efficient implementation of Bayesian optimization to each of these architectures in this comparison. Our goal is to draw on a rigorous set of experimental results that can help us answer the question: how can resource-constrained teams make trade-offs between efficiency and effectiveness using pre-trained models?

Meghana Ravikumar - Optimized Image Classification on the Cheap

Meghana Ravikumar - Optimized Image Classification on the Cheap

Meghana Ravikumar - Optimized Image Classification on the Cheap

The Importance of Modeling Data Collection Data sets used in machine learning are often collected in a systematically biased way - certain data points are more likely to be collected than others. We call this "observation bias". For example, in health care, we are more likely to see lab tests when the patient is feeling unwell than otherwise. Failing to account for observation bias can, of course, result in poor predictions on new data. By contrast, properly accounting for this bias allows us to make better use of the data we do have. In this presentation, we discuss practical and theoretical approaches to dealing with observation bias. When the nature of the bias is known, there are simple adjustments we can make to nonparametric function estimation techniques, such as Gaussian Process models. We also discuss the scenario where the data collection model is unknown. In this case, there are steps we can take to estimate it from observed data. Finally, we demonstrate that having a small subset of data points that are known to be collected at random - that is, in an unbiased way - can vastly improve our ability to account for observation bias in the rest of the data set. My hope is that attendees of this presentation will be aware of the perils of observation bias in their own work, and be equipped with tools to address it.

Noam Finkelstein - The Importance of Modeling Data Collection

Noam Finkelstein - The Importance of Modeling Data Collection

Noam Finkelstein - The Importance of Modeling Data Collection

The Uncanny Valley of ML Every so often, the conundrum of the Uncanny Valley re-emerges as advanced technologies evolve from clearly experimental products to refined accepted technologies. We have seen its effects in robotics, computer graphics, and page load times. The debate of how to handle the new technology detracts from its benefits. When machine learning is added to human decision systems a similar effect can be measured in increased response time and decreased accuracy. These systems include radiology, judicial assignments, bus schedules, housing prices, power grids and a growing variety of applications. Unfortunately, the Uncanny Valley of ML can be hard to detect in these systems and can lead to degraded system performance when ML is introduced, at great expense. Here, we'll introduce key design principles for introducing ML into human decision systems to navigate around the Uncanny Valley and avoid its pitfalls.

June Andrews - The Uncanny Valley of ML

June Andrews - The Uncanny Valley of ML

June Andrews - The Uncanny Valley of ML

Deep Learning Architectures for Semantic Relation Detection Tasks Recognizing and distinguishing specific semantic relations from other types of semantic relations is an essential part of language understanding systems. Identifying expressions with similar and contrasting meanings is valuable for NLP systems which go beyond recognizing semantic relatedness and require to identify specific semantic relations. In this talk, I will first present novel techniques for creating labelled datasets required for training deep learning models for classifying semantic relations between phrases. I will further present various neural network architectures that integrate morphological features into integrated path-based and distributional relation detection algorithms and demonstrate that this model outperforms state-of-the-art models in distinguishing semantic relations and is capable of efficiently handling multi-word expressions.

Sneha Rajana - Deep Learning Architectures for Semantic Relation Detection Tasks

Sneha Rajana - Deep Learning Architectures for Semantic Relation Detection Tasks

Sneha Rajana - Deep Learning Architectures for Semantic Relation Detection Tasks

Building an Incrementally Trained, Local Taste Aware, Global Deep Learned Recommender System Model At Netflix, our main goal is to maximize our members’ enjoyment of the selected show by minimizing the amount of time it takes for them to find it. We try to achieve this goal by personalizing almost all the aspects of our product -- from what shows to recommend, to how to present these shows and construct their home-pages to what images to select per show, among many other things. Everything is recommendations for us and as an applied Machine Learning group, we spend our time building models for personalization that will eventually increase the joy and satisfaction of our members. In this talk we will primarily focus our attention on a) making a global deep learned recommender model that is regional tastes and popularity aware and b) adapting this model to changing taste preferences as well as dynamic catalog availability. We will first go through some standard recommender system models that use Matrix Factorization and Topic Models and then compare and contrast them with more powerful and higher capacity deep learning based models such as sequence models that use recurrent neural networks. We will show what it entails to build a global model that is aware of regional taste preferences and catalog availability. We will show how models that are built on simple Maximum Likelihood principle fail to do that. We will then describe one solution that we have employed in order to enable the global deep learned models to focus their attention on capturing regional taste preferences and changing catalog.In the latter half of the talk, we will discuss how we do incremental learning of deep learned recommender system models. Why do we need to do that ? Everything changes with time. Users’ tastes change with time. What’s available on Netflix and what’s popular also change over time. Therefore, updating or improving recommendation systems over time is necessary to bring more joy to users. In addition to how we apply incremental learning, we will discuss some of the challenges we face involving large-scale data preparation, infrastructure setup for incremental model training as well as pipeline scheduling. The incremental training enables us to serve fresher models trained on fresher and larger amounts of data. This helps our recommender system to nicely and quickly adapt to catalog and users’ taste changes, and improve overall performance.

Anoop Deoras - Building an Incrementally Trained, Local Taste Aware, Global D...

Anoop Deoras - Building an Incrementally Trained, Local Taste Aware, Global D...

Anoop Deoras - Building an Incrementally Trained, Local Taste Aware, Global D...

Vito Ostuni - The Voice: New Challenges in a Zero UI World The adoption of voice-enabled devices has seen an explosive growth in the last few years and music consumption is among the most popular use cases. Music personalization and recommendation plays a major role at Pandora in providing a daily delightful listening experience for millions of users. In turn, providing the same perfectly tailored listening experience through these novel voice interfaces brings new interesting challenges and exciting opportunities. In this talk we will describe how we apply personalization and recommendation techniques in three common voice scenarios which can be defined in terms of request types: known-item, thematic, and broad open-ended. We will describe how we use deep learning slot filling techniques and query classification to interpret the user intent and identify the main concepts in the query. We will also present the differences and challenges regarding evaluation of voice powered recommendation systems. Since pure voice interfaces do not contain visual UI elements, relevance labels need to be inferred through implicit actions such as play time, query reformulations or other types of session level information. Another difference is that while the typical recommendation task corresponds to recommending a ranked list of items, a voice play request translates into a single item play action. Thus, some considerations about closed feedback loops need to be made. In summary, improving the quality of voice interactions in music services is a relatively new challenge and many exciting opportunities for breakthroughs still remain. There are many new aspects of recommendation system interfaces to address to bring a delightful and effortless experience for voice users. We will share a few open challenges to solve for the future.

Vito Ostuni - The Voice: New Challenges in a Zero UI World

Vito Ostuni - The Voice: New Challenges in a Zero UI World

Vito Ostuni - The Voice: New Challenges in a Zero UI World

Anna choromanska - Data-driven Challenges in AI: Scale, Information Selection...

Anna choromanska - Data-driven Challenges in AI: Scale, Information Selection...

Anna choromanska - Data-driven Challenges in AI: Scale, Information Selection...

Janani Kalyanam - Machine Learning to Detect Illegal Online Sales of Prescrip...

Janani Kalyanam - Machine Learning to Detect Illegal Online Sales of Prescrip...

Janani Kalyanam - Machine Learning to Detect Illegal Online Sales of Prescrip...

Esperanza Lopez Aguilera - Using a Bayesian Neural Network in the Detection o...

Esperanza Lopez Aguilera - Using a Bayesian Neural Network in the Detection o...

Esperanza Lopez Aguilera - Using a Bayesian Neural Network in the Detection o...

Neel Sundaresan - Teaching a machine to code

Neel Sundaresan - Teaching a machine to code

Neel Sundaresan - Teaching a machine to code

Rishabh Mehrotra - Recommendations in a Marketplace: Personalizing Explainabl...

Rishabh Mehrotra - Recommendations in a Marketplace: Personalizing Explainabl...

Rishabh Mehrotra - Recommendations in a Marketplace: Personalizing Explainabl...

Soumith Chintala - Increasing the Impact of AI Through Better Software

Soumith Chintala - Increasing the Impact of AI Through Better Software

Soumith Chintala - Increasing the Impact of AI Through Better Software

Roy Lowrance - Predicting Bond Prices: Regime Changes

Roy Lowrance - Predicting Bond Prices: Regime Changes

Roy Lowrance - Predicting Bond Prices: Regime Changes

Mehr von MLconf (20)

Jamila Smith-Loud - Understanding Human Impact: Social and Equity Assessments...

Jamila Smith-Loud - Understanding Human Impact: Social and Equity Assessments...

Jamila Smith-Loud - Understanding Human Impact: Social and Equity Assessments...

Ted Willke - The Brain’s Guide to Dealing with Context in Language Understanding

Ted Willke - The Brain’s Guide to Dealing with Context in Language Understanding

Ted Willke - The Brain’s Guide to Dealing with Context in Language Understanding

Justin Armstrong - Applying Computer Vision to Reduce Contamination in the Re...

Justin Armstrong - Applying Computer Vision to Reduce Contamination in the Re...

Justin Armstrong - Applying Computer Vision to Reduce Contamination in the Re...

Igor Markov - Quantum Computing: a Treasure Hunt, not a Gold Rush

Igor Markov - Quantum Computing: a Treasure Hunt, not a Gold Rush

Igor Markov - Quantum Computing: a Treasure Hunt, not a Gold Rush

Josh Wills - Data Labeling as Religious Experience

Josh Wills - Data Labeling as Religious Experience

Josh Wills - Data Labeling as Religious Experience

Vinay Prabhu - Project GaitNet: Ushering in the ImageNet moment for human Gai...

Vinay Prabhu - Project GaitNet: Ushering in the ImageNet moment for human Gai...

Vinay Prabhu - Project GaitNet: Ushering in the ImageNet moment for human Gai...

Jekaterina Novikova - Machine Learning Methods in Detecting Alzheimer’s Disea...

Jekaterina Novikova - Machine Learning Methods in Detecting Alzheimer’s Disea...

Jekaterina Novikova - Machine Learning Methods in Detecting Alzheimer’s Disea...

Meghana Ravikumar - Optimized Image Classification on the Cheap

Meghana Ravikumar - Optimized Image Classification on the Cheap

Meghana Ravikumar - Optimized Image Classification on the Cheap

Noam Finkelstein - The Importance of Modeling Data Collection

Noam Finkelstein - The Importance of Modeling Data Collection

Noam Finkelstein - The Importance of Modeling Data Collection

June Andrews - The Uncanny Valley of ML

June Andrews - The Uncanny Valley of ML

June Andrews - The Uncanny Valley of ML

Sneha Rajana - Deep Learning Architectures for Semantic Relation Detection Tasks

Sneha Rajana - Deep Learning Architectures for Semantic Relation Detection Tasks

Sneha Rajana - Deep Learning Architectures for Semantic Relation Detection Tasks

Anoop Deoras - Building an Incrementally Trained, Local Taste Aware, Global D...

Anoop Deoras - Building an Incrementally Trained, Local Taste Aware, Global D...

Anoop Deoras - Building an Incrementally Trained, Local Taste Aware, Global D...

Vito Ostuni - The Voice: New Challenges in a Zero UI World

Vito Ostuni - The Voice: New Challenges in a Zero UI World

Vito Ostuni - The Voice: New Challenges in a Zero UI World

Anna choromanska - Data-driven Challenges in AI: Scale, Information Selection...

Anna choromanska - Data-driven Challenges in AI: Scale, Information Selection...

Anna choromanska - Data-driven Challenges in AI: Scale, Information Selection...

Janani Kalyanam - Machine Learning to Detect Illegal Online Sales of Prescrip...

Janani Kalyanam - Machine Learning to Detect Illegal Online Sales of Prescrip...

Janani Kalyanam - Machine Learning to Detect Illegal Online Sales of Prescrip...

Esperanza Lopez Aguilera - Using a Bayesian Neural Network in the Detection o...

Esperanza Lopez Aguilera - Using a Bayesian Neural Network in the Detection o...

Esperanza Lopez Aguilera - Using a Bayesian Neural Network in the Detection o...

Neel Sundaresan - Teaching a machine to code

Neel Sundaresan - Teaching a machine to code

Neel Sundaresan - Teaching a machine to code

Rishabh Mehrotra - Recommendations in a Marketplace: Personalizing Explainabl...

Rishabh Mehrotra - Recommendations in a Marketplace: Personalizing Explainabl...

Rishabh Mehrotra - Recommendations in a Marketplace: Personalizing Explainabl...

Soumith Chintala - Increasing the Impact of AI Through Better Software

Soumith Chintala - Increasing the Impact of AI Through Better Software

Soumith Chintala - Increasing the Impact of AI Through Better Software

Roy Lowrance - Predicting Bond Prices: Regime Changes

Roy Lowrance - Predicting Bond Prices: Regime Changes

Roy Lowrance - Predicting Bond Prices: Regime Changes

Kürzlich hochgeladen

Three things you will take away from the session: • How to run an effective tenant-to-tenant migration • Best practices for before, during, and after migration • Tips for using migration as a springboard to prepare for Copilot in Microsoft 365 Main ideas: Migration Overview: The presentation covers the current reality of cross-tenant migrations, the triggers, phases, best practices, and benefits of a successful tenant migration Considerations: When considering a migration, it is important to consider the migration scope, performance, customization, flexibility, user-friendly interface, automation, monitoring, support, training, scalability, data integrity, data security, cost, and licensing structure Next Wave: The next wave of change includes the launch of Copilot, which requires businesses to be prepared for upcoming changes related to Copilot and the cloud, and to consolidate data and tighten governance ShareGate: ShareGate can help with pre-migration analysis, configurable migration tool, and automated, end-user driven collaborative governance

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

Automating Google Workspace (GWS) & more with Apps Script

Automating Google Workspace (GWS) & more with Apps Script

Automating Google Workspace (GWS) & more with Apps Script

Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows. We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases. This video focuses on the deployment of external web forms using Jotform for Bonterra Impact Management. This solution can be customized to your organization’s needs and deployed to support the common use cases below: - Intake and consent - Assessments - Surveys - Applications - Program registration Interested in deploying web form automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Jeffrey Haguewood

Boost Fertility New Invention Ups Success Rates.pdf

Boost Fertility New Invention Ups Success Rates.pdf

Boost Fertility New Invention Ups Success Rates.pdf

sudhanshuwaghmare1

ICT role in 21st century education and its challenges

ICT role in 21st century education and its challenges

ICT role in 21st century education and its challenges

rafiqahmad00786416

Corporate and higher education. Two industries that, in the past, have had a clear divide with very little crossover. The difference in goals, learning styles and objectives paved the way for differing learning technologies platforms to evolve. Now, those stark lines are blurring as both sides are discovering they have content that’s relevant to the other. Join Tammy Rutherford as she walks through the pros and cons of corporate and higher ed collaborating. And the challenges of these different technology platforms working together for a brighter future.

Corporate and higher education May webinar.pptx

Corporate and higher education May webinar.pptx

Corporate and higher education May webinar.pptx

Rustici Software

Data Cloud, More than a CDP by Matt Robison

Data Cloud, More than a CDP by Matt Robison

Data Cloud, More than a CDP by Matt Robison

Anna Loughnan Colquhoun

Join our latest Connector Corner webinar to discover how UiPath Integration Service revolutionizes API-centric automation in a 'Quote to Cash' process—and how that automation empowers businesses to accelerate revenue generation. A comprehensive demo will explore connecting systems, GenAI, and people, through powerful pre-built connectors designed to speed process cycle times. Speakers: James Dickson, Senior Software Engineer Charlie Greenberg, Host, Product Marketing Manager

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

Manulife - Insurer Transformation Award 2024

Manulife - Insurer Transformation Award 2024

Manulife - Insurer Transformation Award 2024

The Digital Insurer

Effective data discovery is crucial for maintaining compliance and mitigating risks in today's rapidly evolving privacy landscape. However, traditional manual approaches often struggle to keep pace with the growing volume and complexity of data. Join us for an insightful webinar where industry leaders from TrustArc and Privya will share their expertise on leveraging AI-powered solutions to revolutionize data discovery. You'll learn how to: - Effortlessly maintain a comprehensive, up-to-date data inventory - Harness code scanning insights to gain complete visibility into data flows leveraging the advantages of code scanning over DB scanning - Simplify compliance by leveraging Privya's integration with TrustArc - Implement proven strategies to mitigate third-party risks Our panel of experts will discuss real-world case studies and share practical strategies for overcoming common data discovery challenges. They'll also explore the latest trends and innovations in AI-driven data management, and how these technologies can help organizations stay ahead of the curve in an ever-changing privacy landscape.

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

How to Troubleshoot Apps for the Modern Connected Worker

How to Troubleshoot Apps for the Modern Connected Worker

How to Troubleshoot Apps for the Modern Connected Worker

Whatsapp Number Escorts Call girls 8617370543 Available 24x7 Navi Mumbai Call Girls Service Offer Genuine VIP Model Escorts Call Girls in Your Budget. Navi Mumbai Call Girls Service Provide Real Call Girls Number. Make Your Sexual Pleasure Memorable with Our Navi Mumbai Call Girls at Affordable Price. Top VIP Escorts Call Girls, High Profile Independent Escorts Call Girls, Housewife Women Escorts Call Girl, College Girls Escorts Call Girls, Russian Escorts Call girls Service in Your Budget.

Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Scaling API-first – The story of a global engineering organization Ian Reasor, Senior Computer Scientist - Adobe Radu Cotescu, Senior Computer Scientist - Adobe Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

2024: Domino Containers - The Next Step. News from the Domino Container commu...

2024: Domino Containers - The Next Step. News from the Domino Container commu...

2024: Domino Containers - The Next Step. News from the Domino Container commu...

Martijn de Jong

MS Copilot expands with MS Graph connectors

MS Copilot expands with MS Graph connectors

MS Copilot expands with MS Graph connectors

Nanddeep Nachan

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

Scalable LLM APIs for AI and Generative AI Application Development Ettikan Karuppiah, Director/Technologist - NVIDIA Apidays Singapore 2024: Connecting Customers, Business and Technology (April 17 & 18, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...

Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...

Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...

presentation ICT roal in 21st century education

presentation ICT roal in 21st century education

presentation ICT roal in 21st century education

In this session, we will delve into strategic approaches for optimizing knowledge management within Microsoft 365, amidst the evolving landscape of Copilot. From leveraging automatic metadata classification and permission governance with SharePoint Premium, to unlocking Viva Engage for the cultivation of knowledge and communities, you will gain actionable insights to bolster your organization's knowledge-sharing initiatives. In this session, we will also explore how to facilitate solutions to enable your employees to find answers and expertise within Microsoft 365. You will leave equipped with practical techniques and a deeper understanding of how there is more to effective knowledge management than just enabling Copilot, but building actual solutions to prepare the knowledge that Copilot and your employees can use.

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Kürzlich hochgeladen (20)

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

Automating Google Workspace (GWS) & more with Apps Script

Automating Google Workspace (GWS) & more with Apps Script

Automating Google Workspace (GWS) & more with Apps Script

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Boost Fertility New Invention Ups Success Rates.pdf

Boost Fertility New Invention Ups Success Rates.pdf

Boost Fertility New Invention Ups Success Rates.pdf

ICT role in 21st century education and its challenges

ICT role in 21st century education and its challenges

ICT role in 21st century education and its challenges

Corporate and higher education May webinar.pptx

Corporate and higher education May webinar.pptx

Corporate and higher education May webinar.pptx

Data Cloud, More than a CDP by Matt Robison

Data Cloud, More than a CDP by Matt Robison

Data Cloud, More than a CDP by Matt Robison

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

Manulife - Insurer Transformation Award 2024

Manulife - Insurer Transformation Award 2024

Manulife - Insurer Transformation Award 2024

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

How to Troubleshoot Apps for the Modern Connected Worker

How to Troubleshoot Apps for the Modern Connected Worker

How to Troubleshoot Apps for the Modern Connected Worker

Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

2024: Domino Containers - The Next Step. News from the Domino Container commu...

2024: Domino Containers - The Next Step. News from the Domino Container commu...

2024: Domino Containers - The Next Step. News from the Domino Container commu...

MS Copilot expands with MS Graph connectors

MS Copilot expands with MS Graph connectors

MS Copilot expands with MS Graph connectors

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...

Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...

Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...

presentation ICT roal in 21st century education

presentation ICT roal in 21st century education

presentation ICT roal in 21st century education

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Ewa Dominowska – Engineering Manager, Facebook at MLconf ATL

1.

2.

3. ▪ ▪ ▪ ▪ ▪ ▪ ▪

4. ▪ ▪ ▪ ▪ ▪ ▪ ▪ ▪ ▪ ▪ ▪ ▪ ▪ ▪ ▪

5.

6.

7.

8. • • • • • •

12. ¢ -¢ ¢ -¢ ¢ +¢

14.

15. ▪ • • • • •

16. w11 Σ w12 w13 w14 w1n w21 w22 w23 w24 w2n • • • •

17. ctr1 Σ ctr2 ctr3 ctr4 ctrn ctr1 ctr2 ctr3 ctr4 ctrn • • • • • w1 w2

18. 0.02 0.24 0.55 0.74 0.01 0.15 0.48 0.69 • • • • Σ

19. w11 Σ w12 w13 w14 w21 w22 w23 w24

20. f 0% 100% 200% 300% 400% 500% 600% 0 50 100 150 Time Elapsed (hours)

21. f 0% 100% 200% 300% 400% 500% 600% 0 50 100 150 Time Elapsed (hours)

22. • • • • • • •

23.

24.

25.

26. ▪ ▪ ▪ ▪

27.

28.

29. ▪ ▪ ▪ ▪ ▪ ▪ ▪ ▪ ▪

30. ▪ ▪ ▪ ▪ ▪ ▪ ▪ ▪ ▪ ▪ ▪

31. ▪ ▪ ▪ ▪ ▪ ▪ ▪

32.

33. ▪ ▪ ▪ ▪ ▪ ▪ ▪

34. ▪ ▪ ▪ ▪ ▪ ▪ ▪ ▪ ▪