30. • For health, for life-log, for entertainment
• FoodLog App by our lab. and foo.log Inc. [1]
• Food record with smartphone
食事画像認識
31
[1] http://app.foodlog.jp/
3. 認識
31. Problem Definition
• Detection
• Classification
• Estimation
32
Where is a food region?
What is this food?
What amount is this food?
What calorie does this food have?
3. 認識
49. Problem
一般食事画像認識を考えると・・
問題点は何か?
1. number of categories is supermassive
• FoodLogに登録されている(ユニーク)料理数: 68,566
• Cookpad投稿数: 200万超 (11/19現在)
2. intra-class variance is very high
3. inter-class variance is low
3. 認識
54. 参考文献
• [Narumi+ 2011] Takuji Narumi, Shinya Nishizaka, Takashi Kajinami, Tomohiro Tanikawa
and Michitaka Hirose, "MetaCookie+", IEEE VR 2011 Research Demo, pp.265-266, Mar.
2011.
• [Narumi+ 2012] Takji Narumi, Yuki Ban,Takashi Kajinami, Tomohiro Tanikawa and
Michitaka Hirose, “Augmented Perception of Satiety: Controlling Food Consumption by
Changing Apparent Size of Food with Augmented Reality”, CHI 2012 Proceedings of the
2012 ACM annual conference on Human Factors in Computing Systems, pp.109-118,
Austin Teaxs, USA, May 5-10, (2012)
• [Joutou+ 09] Taichi Joutou and Keiji Yanai: A Food Image Recognition System with
Multiple Kernel Learning, International Conference on Image Processing (ICIP), (2009).
• [Matsuda+ 2012] Yuji Matsuda and Keiji Yanai: Multiple-Food Recognition Considering Co-
occurrence Employing Manifold Ranking, IAPR International Conference on Pattern
Recognition (ICPR), (2012)
• [Bosch+ 2011] M. Bosch, F. Zhu, N. Khanna, C.J. Boushey, and E.J. Delp, "Combining
Global and Local Features for Food Identification and Dietary Assessment," Proceedings of
the International Conference on Image Processing,pp. 1789-1792, September 2011,
Brussels, Belgium. DOI: 10.1109/ICIP.2011.6115809
• [Branson+ 2010] S. Branson et al., “Visual Recognition with Human in the Loop”, ECCV
2010
• [Nakamata+ 2014] Nakamata, A., Asami, T., Wei, W., & Kawahara, Y. (2014, September).
Feature optimization for recognizing food using power leakage from microwave oven. In
Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous
Computing: Adjunct Publication (pp. 537-546). ACM.
55. 参考文献
• [Cuong+ 2013] Cuong, P., SCHOENING, J., Tom, B., Thomas, P., & Patrick, O. (2013).
FoodBoard: Surface Contact Imaging for Food Recognition.
• [Chen+ 2009] Chen, M., Dhingra, K., Wu, W., Yang, L., Sukthankar, R., & Yang, J. (2009,
November). PFID: Pittsburgh fast-food image dataset. In Image Processing (ICIP), 2009
16th IEEE International Conference on (pp. 289-292). IEEE.
• [Bossard+ 2014] Bossard, L., Guillaumin, M., & Van Gool, L. (2014). Food-101–Mining
Discriminative Components with Random Forests. In Computer Vision–ECCV 2014 (pp.
446-461). Springer International Publishing.
• [Kawano+ 2014] Kawano, Y., & Yanai, K. (2014, November). FoodCam-256: A Large-
scale Real-time Mobile Food RecognitionSystem employing High-Dimensional Features and
Compression of Classifier Weights. In Proceedings of the ACM International Conference on
Multimedia (pp. 761-762). ACM.
• [Kagaya+ 2014] Kagaya, H., Aizawa, K., & Ogawa, M. (2014, November). Food Detection
and Recognition Using Convolutional Neural Network. In Proceedings of the ACM
International Conference on Multimedia (pp. 1085-1088). ACM.
• [Chae+ 2011] J. Chae, I. Woo, S. Kim, R. Maciejewski, F. Zhu, E.J. Delp, C.J. Boushey,
and D.S. Ebert, "Volume Estimation Using Food Specific Shape Templates in Mobile
Image-Based Dietary Assessment," Proceedings of the IS&T/SPIE Conference on
Computational Imaging IX, Vol. 7873, pp. 1-8, January 2011
• [Noronha+ 2011] Jon Noronha, Eric Hysen, Haoqi Zhang, and Krzysztof Z. Gajos.
Platemate: Crowdsourcing nutrition analysis from food photographs. In Proceedings of the
24th annual ACM symposium on User interface software and technology, UIST ’11, pp. 1–
12. ACM, 2011.
56. 参考文献
• [Toko 98] Toko, K. (1998). RETRACTED: Electronic tongue. Biosensors and Bioelectronics,
13(6), 701-709.
• [Liu+ 2013] Liu, S., Feng, J., Song, Z., Zhang, T., Lu, H., Xu, C., & Yan, S. (2012,
October). Hi, magic closet, tell me what to wear!. In Proceedings of the 20th ACM
international conference on Multimedia (pp. 619-628). ACM.
• [永田ら 2014] 永田ら, スマートフォンによる短時間睡眠支援に向けた入眠時刻の推定, 情報処理
学会研究報告高度交通システムとスマートコミュニティ, 2014