More Related Content
Similar to Amazon SageMaker 紹介 & ハンズオン(2018/07/03 実施) (20)
More from Amazon Web Services Japan (20)
Amazon SageMaker 紹介 & ハンズオン(2018/07/03 実施)
- 2. 7/3/2018 Amazon SageMaker
16:00-17:00
Amazon SageMaker
-
- Amazon SageMaker 3
- Amazon SageMaker
- Build-in Algorithm
- Native Framework (TF/MXNet/Chainer)
- Bring your own Algorithm
- Amazon SageMaker
- Amazon SageMaker
- Greengrass
17:30-19:00
Amazon SageMaker
- Build-in Algorithm
- Chainer
17:00- Q&A and Break
19:00-19:30
Q&A | Close
- 18. / :
SageMaker Tensorflow / MXNet / Chainer
github
• SageMaker pull /
•
instance_type ’local’
https://github.com /aw s/sagem aker-python-sdk#local-m ode
https://github.com /aw s/sagem aker-tensorflow -containers
https://github.com /aw s/sagem aker-m xnet-containers
https://github.com /aw s/sagem aker-chainer-container
- 19. CreateEndpoint API Docker
• AB
•
•
https://docs.aw s.am azon.com /sagem aker/latest/dg/API_CreateEndpointConfig.htm l
https://docs.aw s.am azon.com /sagem aker/latest/dg/API_CreateEndpoint.htm l
https://docs.aw s.am azon.com /ja_jp/sagem aker/latest/dg/API_UpdateEndpoint.htm l
https://docs.aw s.am azon.com /ja_jp/sagem aker/latest/dg/API_UpdateEndpointW eightsAndCapacities.htm l
- 22. SageMaker 2
AWS SDK
•
•
SageMaker SDK
•
• AWS SDK SageMaker SDK AWS SDK
scikit-learn
• Python Spark
• Jupyter Notebook
https://github.com/aws/sagemaker-python-sdk
https://github.com/aws/sagemaker-spark
- 23. SageMaker 2
AWS SDK
•
•
SageMaker SDK
•
• AWS SDK SageMaker SDK AWS SDK
scikit-learn
• Python Spark
• Jupyter Notebook
https://github.com/aws/sagemaker-python-sdk
https://github.com/aws/sagemaker-spark
- 28. • Linear Learner
• Factorization Machines
• XGBoost
• Image Classification
• seq2seq
• K-means
• PCA
• LDA
• Neural Topic Model
• DeepAR Forecasting
• BlazingText (word2vec)
• Random Cut Forest
New!
New!
https://docs.aws.amazon.com/sagemaker/latest/dg/algos.html
New!
- 29. Image Classification
ResNet
• ResNet CNN
• ILSVRC 2015 1
• ImageNet
• use_pretrained_model
1 0
https://github.com/awslabs/amazon-sagemaker-examples/blob/master/introduction_to_amazon_algorithms/imageclassification_caltech/Image-classification-transfer-learning.ipynb
https://www.cv-foundation.org/openaccess/content_cvpr_2016/papers/He_Deep_Residual_Learning_CVPR_2016_paper.pdf
https://docs.aws.amazon.com/ja_jp/sagemaker/latest/dg/image-classification.html
https://docs.aws.amazon.com/ja_jp/sagemaker/latest/dg/IC-Hyperparameter.html
- 37. Tensorflow
• model_fn
• estimator_fn tensorflow.estimator
• keras_model_fn tf.keras
• train_input_fn
• eval_input_fn
• serving_input_fn
• input_fn
• output_fn
https://docs.aws.amazon.com/sagemaker/latest/dg/tf-training-inference-code-template.html
- 38. MXNet
• train
• save
• model_fn:
• transform_fn:
•
https://docs.aws.amazon.com/sagemaker/latest/dg/mxnet-training-inference-code-template.html
- 51. AWS SDK SageMaker SDK
• SageMaker SDK
Jupyter Notebook
• AWS SDK
SageMaker SDK AWS SDK
- 53. 3
SageMaker Example Notebooks
• https://github.com/awslabs/amazon-sagemaker-examples
SageMaker SDK
• https://github.com/aws/sagemaker-python-sdk
(Doc : https://readthedocs.org/projects/sagemaker/)
SageMaker
• https://docs.aws.amazon.com/ja_jp/sagemaker/latest/dg/whatis.html
- 56. • scikit-learn SageMaker
SageMaker
• https://github.com /aw slabs/am azon-sagem aker-
exam ples/blob/m aster/advanced_functionality/scikit_bring_your_ow n/scikit_bring_your_ow n.ipynb
• SageMaker R
• https://github.com /aw slabs/am azon-sagem aker-
exam ples/blob/m aster/advanced_functionality/install_r_kernel/exam ple_r_notebook.ipynb
• SageMaker
• https://github.com /aw slabs/am azon-sagem aker-
exam ples/blob/m aster/advanced_functionality/handling_km s_encrypted_data/handling_km s_encrypted_data.ipynb
• XGBoost SageMaker
• https://github.com /aw slabs/am azon-sagem aker-
exam ples/blob/m aster/advanced_functionality/xgboost_bring_your_ow n_m odel/xgboost_bring_your_ow n_m odel.ipynb
• Tensorflow Sagemaker
• https://github.com /aw slabs/am azon-sagem aker-
exam ples/blob/m aster/advanced_functionality/tensorflow _iris_byom /tensorflow _BYO M _iris.ipynb
• Redshift MXNet R
• https://github.com /aw slabs/am azon-sagem aker-exam ples/tree/m aster/advanced_functionality