re:Invent re:Cap - An overview of Artificial Intelligence and Machine Learning on AWS
•
9 gefällt mir•1,868 views
In this session, you will learn about our strategy for driving machine learning innovation for our customers and learn what’s new from AWS in the machine learning space. We will discuss and demonstrate the latest new services for ML on AWS: Amazon SageMaker, AWS DeepLens, Amazon Rekogntion Video, Amazon Translate, Amazon Transcribe, and Amazon Comprehend. Attend this session to understand how to make the most of machine learning in the cloud.
Empfohlen
Empfohlen
Weitere ähnliche Inhalte
Was ist angesagt?
Was ist angesagt? (20)
Ähnlich wie re:Invent re:Cap - An overview of Artificial Intelligence and Machine Learning on AWS
Ähnlich wie re:Invent re:Cap - An overview of Artificial Intelligence and Machine Learning on AWS (20)
Mehr von Adrian Hornsby
Mehr von Adrian Hornsby (19)
Kürzlich hochgeladen
Kürzlich hochgeladen (20)
re:Invent re:Cap - An overview of Artificial Intelligence and Machine Learning on AWS
- 1. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ML@Amazon re:CAP A d r i a n H o r n s b y – Te c h n i c a l E v a n g e l i s t w i t h A W S @ a d h o r n
- 2. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
- 4. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
- 8. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Put machine learning in the hands of every developer and data scientist ML @ AWS: Our mission
- 9. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Application Services Platform Services Frameworks & Infrastructure API-driven services: Vision & Language Services, Conversational Chatbots AWS ML Stack Deploy machine learning models with high-performance machine learning algorithms, broad framework support, and one-click training, tuning, and inference. Develop sophisticated models with any framework, create managed, auto- scaling clusters of GPUs for large scale training, or run inference on trained models.
- 10. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Customer Running ML on AWS Today
- 11. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Application Services API-driven services: Vision & Language Services, Conversational Chatbots AWS ML Stack
- 12. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Rekognition Deep learning-based visual analysis service
- 13. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Rekognition Object and scene detection Facial analysis Face comparison Celebrity recognition Image moderation Deep learning-based visual analysis service
- 14. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Object & Scene Detection
- 15. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Facial Analysis
- 16. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Crowd-Mode Face Detection
- 17. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Facial Search
- 18. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Explicit Nudity Nudity Graphic Male Nudity Graphic Female Nudity Sexual Activity Partial Nudity Suggestive Female Swimwear or Underwear Male Swimwear or Underwear Revealing Clothes Image Moderation
- 20. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Text in Image
- 21. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Rekognition API example aws rekognition detect-labels –-image '{"S3Object":{"Bucket":"adhorn-reko","Name":"horse.jpg"}}' { "Labels": [ { "Confidence": 99.29136657714844, "Name": "Human" }, { "Confidence": 99.29136657714844, "Name": "People" }, { "Confidence": 99.29136657714844, "Name": "Person" }, ……
- 22. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Rekognition API example aws rekognition detect-faces --image '{"S3Object":{"Bucket":"adhorn-reko","Name":"horse.jpg"}}' --attributes "ALL” { "FaceDetails": [ { "BoundingBox": { "Width": 0.05462963134050369, "Top": 0.2880098819732666, "Left": 0.4722222089767456, "Height": 0.07292954623699188 }, "Landmarks": [ { "Y": 0.31606796383857727, "X": 0.48852023482322693, "Type": "eyeLeft" ………
- 23. http://www.marinusanalytics.com/articles/2017/10/17/amazon-rekognition-helps-marinus-analytics-fight-human-trafficking Amazon Rekognition Helps Marinus Analytics Fight Human Trafficking
- 24. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Rekognition Video Deep learning-based visual analysis service (GA)
- 25. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Video in. People, activities, and details out. Objects, scenes, and activities Person detection and recognition Person tracking Celebrity recognition Inappropriate content detection Amazon Rekognition Video
- 26. Rekognition Video Analysis Service
- 27. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.http://timescapes.org/trailers/
- 28. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.http://timescapes.org/trailers/
- 29. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Rekognition Video API example aws rekognition start-label-detection --video '{"S3Object":{"Bucket":"adhorn-reko","Name":"bourne.mp4"}}’ { "JobId": "a89eeae89ec38d8579a3a0bfc2bbf522ea5a939cdf751df4b3872d04e8394496” } aws rekognition get-label-detection --jobId "a89eeae89ec38d8579a3a0bfc2bbf522ea5a939cdf751df4b3872d04e8394496”
- 30. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Launch customers https://aws.amazon.com/rekognition/customers/
- 31. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Polly Deep learning-based Text-to-Speech service
- 32. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Polly “Hoi! mijn naam is Ruben. Ik lees elke tekst voor die je hier invoert.” Amazon Polly: Text In, Life-like Speech Out
- 33. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. <speak xml:lang="en-US"> The price of this book is <prosody rate="60%">€45</prosody> </speak> A Focus On Voice Quality & Pronunciation Support for Speech Synthesis Markup Language (SSML) Version 1.0 https://www.w3.org/TR/speech-synthesis
- 34. Polly API example aws polly synthesize-speech --text "It was nice to live such a wonderful live show" --output-format mp3 --voice-id Joanna --text-type text johanna.mp3 aws polly synthesize-speech --text-type ssml --text file://ssml_polly --output-format mp3 --voice-id Joanna speech.mp3
- 35. “With Amazon Polly our users benefit from the most lifelike Text-to-Speech voices available on the market.” Severin Hacker CTO, Duolingo
- 36. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
- 37. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Translate Neural Machine Translation Service (Preview Today)
- 38. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. “Hello, what’s up? Do you want to go see a movie tonight?” Amazon Translate Natural and fluent language translation "Bonjour, quoi de neuf ? Tu veux aller voir un film ce soir ?" Amazon Translate
- 39. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Automatically translates text between languages Real-time translation Powered by deep learning 12 Language pairs (more to come) Language detection
- 40. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Translate API example aws translate translate-text --endpoint-url https://translate.us-east-1.amazonaws.com --region us-east-1 --text "hello, what’s up? Do you want to go see a movie tonight?" --source-language-code "en" --target-language-code "fr” { "TargetLanguageCode": "fr”, "TranslatedText": "Bonjour, quoi de neuf ? Tu veux aller voir un film ce soir ?”, "SourceLanguageCode": "en” }
- 41. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Translate API example aws translate translate-text --endpoint-url https://translate.us-east-1.amazonaws.com --region us-east-1 --text "hello, what’s up? Do you want to go see a movie tonight?" --source-language-code "en" --target-language-code "fr” { "TargetLanguageCode": "fr”, "TranslatedText": "Bonjour, quoi de neuf ? Tu veux aller voir un film ce soir ?”, "SourceLanguageCode": "en” } Context Awareness
- 42. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. DEMO – Translation service
- 44. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Transcribe Automatic speech recognition service (Preview Today)
- 45. “Hello, this is Allan speaking” Automatic speech recognition service Amazon Transcribe
- 46. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Available in preview today Support for telephony audio Timestamp generation Intelligent punctuation and formatting Recognize multiple speakers Custom vocabulary Multiple languages Automatic speech recognition service
- 47. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Launch customers End-to-end communications platform for sales teams. Analyze and monitor the media coverage for brands. https://aws.amazon.com/transcribe/customers/
- 48. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Comprehend Natural Language Processing (GA)
- 49. Fully managed natural language processing Discover valuable insights from text Entities Key Phrases Language Sentiment Amazon Comprehend
- 50. Support for large data sets and topic modeling STORM WORLD SERIES STOCK MARKET WASHINGTON LIBRARY OF NEW S ARTICLES * Amazon Comprehend * Integrated with Amazon S3 and AWS Glue
- 53. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Comprehend API example aws comprehend detect-sentiment --text "I love you" --language-code "en” { "SentimentScore": { "Mixed": 0.005664939060807228, "Positive": 0.9262985587120056, "Neutral": 0.06511948257684708, "Negative": 0.0029170133639127016 }, "Sentiment": "POSITIVE” }
- 55. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Lex Conversational Interfaces
- 56. Intents A particular goal that the user wants to achieve Utterances Spoken or typed phrases that invoke your intent Slots Data the user must provide to fulfill the intent Prompts Questions that ask the user to input data Fulfillment The business logic required to fulfill the user’s intent BookHotel
- 57. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Lex Bots Salesforce Microsoft Dynamics Marketo Zendesk Web Devices Apps Facebook Messenger, Slack, Amazon Connect Mobile Mobile Hub integration Quickbooks Amazon Lex: Conversational Chatbots
- 58. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Platform Services AWS ML Stack Deploy machine learning models with high-performance machine learning algorithms, broad framework support, and one-click training, tuning, and inference.
- 59. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon EMR Easily Run and Scale Apache Hadoop, Spark, HBase, Presto, Hive, and other Big Data Frameworks
- 60. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ML Applications on Amazon EMR Amazon EMR (Elastic MapReduce)
- 62. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon SageMaker A fully managed service to quickly and easily build machine-learning based models (GA)
- 63. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. End-to-End Machine Learning Platform Zero setup Flexible Model Training Pay by the second $ Amazon SageMaker Build, train, and deploy machine learning models at scale
- 64. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Highly-optimized machine learning algorithms BuildPre-built notebook instances Amazon SageMaker
- 65. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Highly-optimized machine learning algorithms One-click training for ML, DL, and custom algorithms BuildPre-built notebook instances Easier training with hyperparameter optimization Train Amazon SageMaker
- 66. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. One-click training for ML, DL, and custom algorithms Easier training with hyperparameter optimization Highly-optimized machine learning algorithms Deployment without engineering effort Fully-managed hosting at scale BuildPre-built notebook instances Deploy Train Amazon SageMaker
- 67. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Launch Customers
- 68. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS DeepLens Deep learning enabled video camera for developers (Pre-order Today)
- 69. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. A new way to learn Custom built for deep learning Broad Framework Support Deploy models from Amazon SageMaker Integrated with AWS Full programmable with AWS Lambda AWS DeepLens W o r l d ’ s f i r s t d e e p l e a r n i n g e n a b l e d v i d e o c a m e r a f o r d e v e l o p e r s
- 70. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. 10 minutes to your first deep learning project 1 Choose your deep learning model from the AWS DeepLens pre-trained model library, or your own models trained with Amazon SageMaker. 2 Deploy your model to the device with a single click. 3 Watch the results in real time in the AWS Management Console .
- 71. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Frameworks & Infrastructure AWS ML Stack Develop sophisticated models with any framework, create managed, auto- scaling clusters of GPUs for large scale training, or run inference on trained models.
- 72. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon EC2 P3 Instances (October 2017) • Up to eight NVIDIA Tesla V100 GPUs • 1 PetaFLOPs of computational performance – 14x better than P2 • 300 GB/s GPU-to-GPU communication (NVLink) – 9X better than P2 • 16GB GPU memory with 900 GB/sec peak GPU memory bandwidth T h e f a s t e s t , m o s t p o w e r f u l G P U i n s t a n c e s i n t h e c l o u d
- 73. AWS Deep Learning AMI • Easy-to-launch tutorials • Hassle-free setup and configuration • Pay only for what you use • Accelerate your model training and deployment • Support for popular deep learning frameworks
- 74. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon ML Lab Provides the missing ML expertise
- 75. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon ML Lab Lots of companies doing Machine Learning Unable to unlock business potential Brainstorming Modeling Teaching Lack ML expertise Leverage Amazon experts with decades of ML experience with technologies like Amazon Echo, Amazon Alexa, Prime Air and Amazon Go Amazon ML Lab provides the missing ML expertise
- 76. Amazon ML Lab Customers
- 77. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Summary
- 78. FRAMEWORKS AND INTERFACES PLATFORM SERVICES APPLICATION SERVICES Amazon Rekognition Amazon Polly Amazon Lex Democratization of AI Amazon Rekognition Video Amazon Transcribe Amazon Comprehend Amazon SageMaker AWS DeepLens Amazon EMR Deep Learning AMI Amazon Translate
- 79. Model Training Inference in the Cloud Inference at the Edge Infrastructure to support model build and deploy
- 80. G O B U I L D
Hinweis der Redaktion
- Alexa is fueled by Natural Language Understanding and Automated Speech Recognition deep learning;
- as is our drone initiative, Prime Air, and the computer vision technology in our new retail experience, Amazon Go. We have thousands of engineers at Amazon committed to machine learning and deep learning, and it’s a big part of our heritage.
- as is our drone initiative, Prime Air, and the computer vision technology in our new retail experience, Amazon Go
- From A to Z – Artfinder to Zillow Duolingo Cspan Slactwilio Mapbox Pinterest finra
- Amazon Rekognition currently supports the JPEG and PNG image formats. You can submit images either as an S3 object or as a byte array. Amazon Rekognition supports image file sizes up to 15MB when passed as an S3 object, and up to 5MB when submitted as an image byte array. Amazon Rekognition is currently available in US East (Northern Virginia), US West (Oregon) and EU (Ireland) regions. Mxnet convolutional deep neural networks (CNNs),
- You can use the ‘MinConfidence’ parameter in your API requests to balance detection of content (recall) vs the accuracy of detection (precision).
- You can use the ‘MinConfidence’ parameter in your API requests to balance detection of content (recall) vs the accuracy of detection (precision).
- …Amazon Rekognition Video, a new video recognition service powered by deep learning. 1/ Video Rek lets you pass videos to us using our APIs or SDK and will detect all sorts of things in the video 2/ Will detect, objects, faces, scenes (like delivering a pkg so app can take action on that), celebs, inappropriate content 3/ Person tracking a unique feature and powerful…lets you track person even if their face becomes blocked or leaves the frame and returns…do this through Skeleton Modeling…can tell when still in the scene and even the direction the person is heading…useful for apps that give system access when person in a room and shut down when out. 1/ Service really easy to use 2/ Can handle missions of videos you have stored in S3 via batch processing 3/ Can process real time video (NO OTHER SERVICE CAN DO)…enables a lot of apps where you want to take action on what’s happening now 4/ Service automatically time-stamps everything it identifies 5/ Service will keep getting better b/c of sheer vol of data we have with internal and public datasets 6/ Very cost effective …Amazon Kinesis Video Streams, a new service to securely ingest and store video, audio and other time-encoded data <PAUSE FOR CLAPPING> 1/ Just like Kinesis for data that lets you ingest and store data, Kinesis Video Stream does same for video and other time-encoded data like radar 2/ Provides SDKs for device mfrs to install on devices to make easy to stream video to AWS 3/ Durably, stores, encrypts and indexes data streams along with easy to use API so that apps can access and retrieve video fragments based on tags or timestamps 4/ Integrated with Video Rekognition so can ingest data and then do analytics
- "Amazon Rekognition's new video analytic features are impressive. They can, for example, help with search of historical and real time video for persons-of-interest, providing efficiencies and awareness by automating this typically human task." Dan Law, Chief Data Scientist "The City of Orlando is excited to work with Amazon to pilot the latest in public safety software through a unique, first-of-it's-kind public-private partnership. Through the pilot, Orlando will utilize Amazon’s Rekognition Video and Amazon Kinesis Video Streams technology in a way that will use existing City resources to provide real-time detection and notification of persons-of-interests, further increasing public safety, and operational efficiency opportunities for the City of Orlando and other cities across the nation. John Mina Police Chief, City of Orlando
- Polly also support Speech Synthesis Markup Language (SSML) Version 1.0 The Voice Browser Working Group has sought to develop standards to enable access to the Web using spoken interaction.
- Spoken language crucial for language learning Accurate pronunciation matters Faster iteration thanks to TTS As good as natural human speech When teaching a foreign language, accurate pronunciation matters. If exposed to incorrect pronunciation, learners develop their listening and speaking skills poorly, which compromises their ability to communicate effectively. Duolingo uses text-to-speech (TTS) to provide high-quality language education. To some, this approach might seem counterintuitive: shouldn’t people learn by listening to a native speaker? Find a company that records audio in the language: The company must find a voice actor who not only speaks the language, but also who speaks with good pronunciation and clarity. Find someone to evaluate the quality of pronunciation: We need an independent party from the recording company to create a small sample of sentences, which this party uses to evaluate pronunciation quality of the recordings. Record and evaluate the quality of the sample sentences. Set up a contract with the recording company. Record all sentences. Evaluate recordings, providing a data quality assurance check. For example, we need to check if all files are in the proper format and correctly separated. This step is necessary because the industry standard is to record all sentences in a single session and separate them later.
- “Providing locally relevant personalized travel experiences is the goal at Hotels.com. Hence helping our customers find the right experience is crucial. Amazon Comprehend helps us analyze the key sentiments, objects, and geos in our 30 million plus reviews & testimonies. Now we are able to discover new insights into the unique experiences available at each property, so our customers can make the best decision possible for their travel.” – Matt Fryer, VP and Chief Data Science Officer of Hotels.com and Expedia Affiliate Network
- “RingDNA is an end-to-end communications platform for sales teams. Hundreds of enterprise organizations use RingDNA to dramatically increase productivity, engage in smarter sales conversations, gain predictive sales insights, improve their win rate and coach reps to success faster than ever before. A critical component of RingDNA’s Conversation AI requires best of breed speech-to-text to deliver transcriptions of every phone call. RingDNA is excited about Amazon Transcribe since it provides high-quality speech recognition at scale, helping us to better transcribe every call to text.”Howard Brown – CEO & Founder, RingDNA “At Isentia, we enable customers to analyze and monitor the media coverage for their brands. We create more than 13K summaries per day from radio and TV content. With Amazon Transcribe, we can transcribe all the audio/video content that we monitor and analyze the text data with Amazon Comprehend. Features like timestamps and punctuation make it very easy for us to search through the data and drill down and present key insights for our customers to review."Andrea Walsh - CIO, Isentia
- …Amazon Comprehend, a Natural Language Processing service that enables customers to discover insights from text. 1/ Without provisioning a server, Comprehend can understand documents, social network posts, articles, and any other data in AWS 2/ Simply provide text stored in data lake in S3 via Comprehend API, and Comprehend uses NLP to give you highly accurate info about what it contains in 4 categories: a/ entities (people, places, dates, brands, qtys) b/ key phrases that provide significance to the text c/ language being used d/ sentiment
- 1/ Comprehend also has the unique ability to not just look at a single document at a time but to look at millions in order to identify the topics within these docs—we call this TOPIC MODELING 2/ Publisher org articles by subject matter; healthcare by symptom or diagnosis 3/ Comprehend does this in an incredibly efficient manner…For ex, for 300 docs, each around 1MB in size, Comprehend can build a custom topic model in 45 mins for $1.80 4/ Makes it much easier and cost effective to build more intelligent models and actions out of all this data sitting in text 1/ Comprehend also has the unique ability to not just look at a single document at a time but to look at millions in order to identify the topics within these docs—we call this TOPIC MODELING 2/ Publisher org articles by subject matter; healthcare by symptom or diagnosis 3/ Comprehend does this in an incredibly efficient manner…For ex, for 300 docs, each around 1MB in size, Comprehend can build a custom topic model in 45 mins for $1.80 4/ Makes it much easier and cost effective to build more intelligent models and actions out of all this data sitting in text
- Providing locally relevant personalized travel experiences is the goal at Hotels.com. Hence helping our customers find the right experience is crucial. Amazon Comprehend helps us analyze the key sentiments, objects, and geos in our 30 million plus reviews & testimonies. Now we are able to discover new insights into the unique experiences available at each property, so our customers can make the best decision possible for their travel.” – Matt Fryer, VP and Chief Data Science Officer of Hotels.com and Expedia Affiliate Network “Building intelligent applications to help customers drive their businesses is our entire focus. Amazon Comprehend allows us to analyze unstructured text within search, chat, and documents to understand intent and sentiment. This capability enables us to train our Coleman AI skillset, and also provide a truly focused and tailored search experience for our customers.” – Manjunath Ganimasty, V.P. Software Development with Infor “The Post strives to give its nearly 100 million readers the best experience possible and relevant content recommendations are a key part of that mission. With Amazon Comprehend, we can leverage the continuously-trained NLP capabilities like Keyphrase and Topic APIs to potentially allow us to provide even better content personalization, SEO, and ad targeting capabilities.” The insight that lies in unstructured text - blogs, social media posts and comments, provides an enormous resource for businesses. This intelligence can be used by our clients to better connect with their customers. For Isentia, using Amazon Comprehend in conjunction with the diverse range of AWS analytics services has enabled us to provide rich information to our clients who can, in turn, develop tailored messages that resonate with customers and deliver results.” – Andrea Walsh, CIO, Isentia
- Apache Spark and Spark ML overview Running Spark ML on Amazon EMR Interactive notebook options Building recommendation engines at Zillow Group
- Zillow Group uses machine-learning to deliver near-real-time home-valuation data to customers using AWS. The company houses a portfolio of the largest online real-estate and home-related brands. Zillow Group runs the Zestimate, its machine learning–based home-valuation tool, on Amazon Kinesis and Apache Spark on Amazon EMR.
- Pre-built Notebook Instances For training data exploration and preprocessing, Amazon SageMaker provides fully managed notebook instances running Jupyter notebooks that include example code for common model training and hosting exercises. These notebook instances are pre-loaded with Anaconda packages, and popular deep learning libraries like TensorFlow, and Apache MXNet. Highly-optimized Machine Learning Algorithms Amazon SageMaker installs high-performance, scalable machine learning algorithms optimized for speed, scale, and accuracy, to run on extremely large training datasets. Based on the type of learning that you are undertaking, you can choose from supervised algorithms, such as linear/logistic regression or classification; as well as unsupervised learning, such as with k-means clustering.
- TRAIN One-click Training When you’re ready to train in Amazon SageMaker, simply indicate the type and quantity of instances you need and initiate training with a single click. SageMaker sets up the distributed compute cluster, performs the training, and tears down the cluster when complete. SageMaker seamlessly scales to tens of nodes with hundreds of GPUs, so you no longer need to worry about all the complexity and lost time involved in making distributed training architectures work. Built-in Automatic Hyperparameter Optimization (in Preview) Using built-in hyperparameter optimization (HPO), SageMaker can automatically tune your algorithm by adjusting hundreds of different combinations of parameters, to quickly arrive at the best solution for your machine learning problem. HPO lets you easily optimize an ML model on SageMaker by exploring lots of variations of the same algorithm with varying hyperparameters to pick the one with the best performance on your data.
- DEPLOY Deployment without Engineering Effort After training, SageMaker provides the model artifacts and scoring images to you for deployment to Amazon EC2 or anywhere else. When you’re ready to deploy your model, you can launch into a secure and elastically scalable environment, with one-click deployment from the SageMaker console. Fully Managed Amazon SageMaker handles all of the compute infrastructure on your behalf, with built-in Amazon CloudWatch monitoring and logging, to perform health checks, apply security patches, and other routine maintenance, as well as ensure updates to the supported deep learning frameworks as they become available.
- Tons of companies across industries doing Machine Learning on their own; but it’s still very very early, and most companies don’t yet have deep knowledge or experienced practitioners on board. Customers are coming to us with: “Can Amazon bring their experience in ML to quickly help our company unlock business value via routine use of ML?” and “Can Amazon impart hands-on knowledge in ML to our developers?” Amazon ML Lab unites machine learning experts from Amazon with our customers wanting help with: Problem Solving – via brainstorming, data preparation, annotation, custom modeling, application services (Lex, Polly, Rekognition) Education – via workshops and tutorials These ML experts are the brains behind innovative, machine learning based products and technologies of the future at Amazon such as Amazon Echo, Amazon Alexa, autonomous delivery through Prime Air, or Amazon Go Who can use the Amazon AI Lab? The Amazon AI Lab is available to customers with AWS Business Support or AWS Enterprise Support. Is this a professional services engagement? Yes, in part. An Amazon AI Lab partnership also includes a significant amount of education and training, to allow developers to take what they have learned through the process and use it elsewhere in their organization. We will also provide guidance on change management for ML, establishing ‘centers of excellence’ for machine learning, and we will provide materials for further on-site training. Similar to a professional services agreement, AI Lab engagements will require a contract and will have defined deliverables (such as a completed proof of concept or trained model integrated with a production system). What is AI Lab Express? AI Lab Express is a four-week accelerated program which brings enterprise developers on-site with Amazon machine learning experts for an intensive boot camp (typically one week), followed by guidance and hands-on implementation with custom modeling and production deployment advice. It’s designed for customers who have already established a relevant data lake and data catalog, and who already have a large volume of high quality, trusted, labeled data available for modeling. The primary goal with AI Lab Express is to work with the customer on feature engineering, and to build models quickly through Amazon SageMaker. How long is the usual AI Lab engagement? Amazon AI Lab partnerships typically last from 3 to 6 months.
- So far, we've discussed the bottom and middle layers of the machine learning stack – first we talked about the frameworks and the deep learning AMI for expert practitioners. Then, SageMaker and DeepLens in the middle layer to bring ML capabilities to all developers. Now, at the top of the stack, we serve developers and companies who want to add solution-oriented intelligence to their applications through an API call rather than developing and training their own models. These are services that exhibit artificial intelligence that emulates a human’s cognitive skills. Last year, we announced three services in this area: Amazon Rekognition (image analysis), Amazon Polly (text-to-speech), and Amazon Lex (conversational applications).