Abstract
This paper aims firstly to provide a flexible framework for developing recipe guiding system that displays information step-by-step along to events recognized in user’s activity, and secondly to introduce an example of our implementation on the proposed framework. Those who are working on a task requiring high concentration can be easily distracted by the interactive systems that require any kind of explicit manipulations. In such situation, recognizing events in the task is helpful as an alternative of the manipulations. The framework allows a system designer to incorporate his/her own recognizer to the guiding system. Based on this framework, we implemented a system working with user’s grabbing and releasing objects. A grabbed object tells the user’s intention of what is about to do next, and releasing the object indicates its completion. In the experiments using the WOZ method, we confirmed that these actions worked well as switches for the interface. We also summarize some of our efforts for automating the system.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Norman, D.A.: The design of everyday things. Basic Books (2002)
FormatData: The Recipe Markup Landuage (RecipeML) (2006), http://www.formatdata.com/recipeml/
Hamada, R., Okabe, J., Ide, I., Sakai, S., Tanaka, H.: Cooking navi: assistant for daily cooking in kitchen. In: Proc. of the 13th ACM International Conf. on Multimedia, pp. 371–374 (2005)
Matsushima, Y., Funabiki, N., Zhang, Y., Nakanishi, T., Watanabe, K.: Extensions of cooking guidance function on android tablet for homemade cooking assistance system. In: IEEE 2nd Global Conf. on Consumer Electronics, pp. 397–401 (2013)
Nakauchi, Y., Fukuda, T., Noguchi, K., Matsubara, T.: Time sequence data mining for cooking support robot. In: Proc. of International Symposium on Computational Intelligence in Robotics and Automation, pp. 481–486 (2005)
Siltanen, S., Hakkarainen, M., Korkalo, O., Salonen, T., Saaski, J., Woodward, C., Kannetis, T., Perakakis, M., Potamianos, A.: Multimodal user interface for augmented assembly. In: IEEE 9th Workshop on Multimedia Signal Processing, MMSP 2007, pp. 78–81. IEEE (2007)
Ueda, M., Funatomi, T., Hashimoto, A., Watanabe, T., Minoh, M.: Developing a real-time system for measuring the consumption of seasoning. In: IEEE International Symposium on Multimedia, pp. 393–398. IEEE (2011)
Prasad, V.S.N., Kellokumpu, V., Davis, L.S.: Ballistic hand movements. In: Perales, F.J., Fisher, R.B. (eds.) AMDO 2006. LNCS, vol. 4069, pp. 153–164. Springer, Heidelberg (2006)
Hashimoto, A., Mori, N., Funatomi, T., Mukunoki, M., Kakusho, K., Minoh, M.: Tracking food materials with changing their appearance in food preparing. In: IEEE International Symposium on Multimedia, pp. 248–253 (2010)
Schmidt, A., Strohbach, M., Van Laerhoven, K., Friday, A., Gellersen, H.: Context acquisition based on load sensing. In: Borriello, G., Holmquist, L.E. (eds.) UbiComp 2002. LNCS, vol. 2498, pp. 333–350. Springer, Heidelberg (2002)
Chi, P.-Y.(P.), Chen, J.-H., Chu, H.-H., Lo, J.-L.: Enabling calorie-aware cooking in a smart kitchen. In: Oinas-Kukkonen, H., Hasle, P., Harjumaa, M., Segerståhl, K., Øhrstrøm, P. (eds.) PERSUASIVE 2008. LNCS, vol. 5033, pp. 116–127. Springer, Heidelberg (2008)
Yilmaz, A., Javed, O., Shah, M.: Object tracking: A survey. ACM Computing Surveys 38(4), 1–45 (2006)
Grabner, H., Matas, J., Van Gool, L., Cattin, P.: Tracking the invisible: Learning where the object might be. In: IEEE Conf. on Computer Vision and Pattern Recognition, pp. 1285–1292 (2010)
Yasuoka, R., Hashimoto, A., Funatomi, T., Minoh, M.: Detecting start and end times of object-handlings on a table by fusion of camera and load sensors. In: Proc. of the 5th International Workshop on Multimedia for Cooking and Eating Activities, pp. 51–56 (2013)
Jafri, R., Ali, S.A., Arabnia, H.R., Fatima, S.: Computer vision-based object recognition for the visually impaired in an indoors environment: a survey. The Visual Computer, 1–26 (2013)
Bolle, R.M., Connell, J., Haas, N., Mohan, R., Taubin, G.: Veggievision: A produce recognition system. In: Proc. of IEEE Workshop on Applications of Computer Vision, pp. 244–251 (1996)
Faria, F.A., dos Santos, J.A., Rocha, A., Torres, R.S.: Automatic classifier fusion for produce recognition. In: Proc. of the 25th Conf. on Graphics, Patterns and Images, pp. 252–259 (2012)
Arivazhagan, S., Shebiah, R.N., Nidhyanandhan, S., Ganesan, L.: Fruit recognition using color and texture features. Journal of Emerging Trends in Computing and Information Sciences 1(2), 90–94 (2010)
Yamakata, Y., Kakusho, K., Minoh, M.: Object recognition based on object’s identity for cooking recognition task. In: 2010 IEEE International Symposium on Multimedia, pp. 278–283. IEEE (2010)
Hashimoto, A., Inoue, J., Nakamura, K., Funatomi, T., Ueda, M., Yamakata, Y., Minoh, M.: Recognizing ingredients at cutting process by integrating multimodal features. In: Proc. of the ACM Multimedia 2012 Workshop on Multimedia for Cooking and Eating Activities, pp. 13–18 (2012)
Zauner, J., Haller, M., Brandl, A., Hartmann, W.: Authoring of a mixed reality assembly instructor for hierarchical structures. In: ACM International Symp. on Mixed and Augmented Reality, vol. 1, pp. 237–246 (2003)
Yuan, M.L., Ong, S.K., Nee, A.Y.C.: Assembly guidance in augmented reality environments using a virtual interactive tool. In: Innovation in Manufacturing Systems and Technology (2005)
Tang, A., Owen, C., Biocca, F., Mou, W.: Comparative effectiveness of augmented reality in object assembly. In: Proc. of the SIGCHI Conf. on Human Factors in Computing Systems, pp. 73–80 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Hashimoto, A., Inoue, J., Funatomi, T., Minoh, M. (2014). How Does User’s Access to Object Make HCI Smooth in Recipe Guidance?. In: Rau, P.L.P. (eds) Cross-Cultural Design. CCD 2014. Lecture Notes in Computer Science, vol 8528. Springer, Cham. https://doi.org/10.1007/978-3-319-07308-8_15
Download citation
DOI: https://doi.org/10.1007/978-3-319-07308-8_15
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07307-1
Online ISBN: 978-3-319-07308-8
eBook Packages: Computer ScienceComputer Science (R0)