[DL輪読会]AdaShare: Learning What To Share For Efficient Deep Multi-Task Learning
1. 1
DEEP LEARNING JP
[DL Papers]
http://deeplearning.jp/
AdaShare: LearningWhatTo Share For Efficient
Deep Multi-Task Learning
Present Square Co.,Ltd. 小林 範久
2. 書誌情報
2
AdaShare: Learning What To Share For Efficient Deep Multi-Task Learning
(https://arxiv.org/abs/1911.12423)
タイトル:
著者: Ximeng Sun, Rameswar Panda, Rogerio Feris
( Boston University, IBM Research & MIT-IBM Watson AI Lab)
• 効率的なマルチタスク学習のための新しいアプローチを提案。
• マルチタスクネットワークにおいて、与えられたタスクに対してどの層を実行するかを選択するポリシー
を通して、共有パターンを学習する。
• 3つのベンチマークデータセットでSOTA。
概要:
22. Appendix
参考文献
22
• [4] Yoshua Bengio, Jérôme Louradour, Ronan Collobert, and Jason Weston. Curriculum learning. In
Proceedings of the 26th annual international conference on machine learning, pages 41–48. ACM, 2009.
• [10] Marius Cordts, Mohamed Omran, Sebastian Ramos, Timo Rehfeld, Markus Enzweiler, Rodrigo Benenson,
Uwe Franke, Stefan Roth, and Bernt Schiele. The cityscapes dataset for semantic urban scene
understanding. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages
3213–3223, 2016.
• [15] Yuan Gao, Jiayi Ma, Mingbo Zhao, Wei Liu, and Alan L Yuille. Nddr-cnn: Layerwise feature fusing in
multi-task cnns by neural discriminative dimensionality reduction. In CVPR, 2019.
• [20] Laurent Jacob, Jean-philippe Vert, and Francis R Bach. Clustered multi-task learning: A convex
formulation. In NIPS, 2009.
• [23] Zhuoliang Kang, Kristen Grauman, and Fei Sha. Learning with whom to share in multi-task feature
learning. In ICML, 2011.
• [31] Shikun Liu, Edward Johns, and Andrew J Davison. End-to-end multi-task learning with attention. In
CVPR, 2019.
• [37] Pushmeet Kohli Nathan Silberman, Derek Hoiem and Rob Fergus. Indoor segmentation and support
inference from rgbd images. In ECCV, 2012.
• [47] Trevor Standley, Amir R Zamir, Dawn Chen, Leonidas Guibas, Jitendra Malik, and Silvio Savarese.
Which tasks should be learned together in multi-task learning? arXiv preprint arXiv:1905.07553, 2019.
• [60] Amir R Zamir, Alexander Sax, William Shen, Leonidas J Guibas, Jitendra Malik, and Silvio Savarese.
Taskonomy: Disentangling task transfer learning. In CVPR, 2018.