More Web Proxy on the site http://driver.im/

research-article

Multi-sensorial virtual reality and augmented human food interaction

Author:

Takuji NarumiAuthors Info & Claims

MHFI '16: Proceedings of the 1st Workshop on Multi-sensorial Approaches to Human-Food Interaction

Article No.: 1, Pages 1 - 6

https://doi.org/10.1145/3007577.3007587

Published: 16 November 2016 Publication History

Abstract

In the field of virtual reality (VR) research, media technologies to create a realistic feeling of being present in a real/virtual world by duplicating multi-sensory information have been studied over a long period. Recently, technologies for multi-sensory feedbacks achieved a major breakthrough by utilizing cross-modal interactions. By changing sensory stimuli through only one modality using these technologies, the impression from our experience can be modified significantly. These novel technologies have a great potential in changing our food consumption experience and behavior. For example, "MetaCookie" is a flavor augmentation system that enables us to change the perceived taste of a cookie by overlaying visual and olfactory information onto a real cookie. "Augmented Satiety" is a system that enables us to control the perception of satiety and food intake implicitly by changing the apparent volume of food with augmented reality and computer vision techniques. This paper introduces such novel techniques that augment our eating experience by using multimodal VR techniques and discusses the future of Human Food Interaction.

References

[1]

S. Shimojo S and L. Shams: Sensory modalities are not separate modalities: plasticity and interactions, Current Opinion in Neurobiology 2001 Aug;11(4):505--9, 2001.

[2]

B. Wansink, K.V. Ittersum and J.E. Painter: How descriptive food names bias sensory perceptions in restaurants. Food Quality and Preference, Vol.16, No.5, pp.393--400, 2005.

[3]

R.I. Allison and K.P. Uhl: Influence of beer brand identification on taste perception. Journal of Marketing Research, pp.36--39, 1964.

[4]

P. Rozin: Family resemblance in food and other domains: the family paradox and the role of parental congruence. Appetite, Vol. 16, No. 2, pp. 93--102, 1991.

[5]

Y. Matsushita, M. Ohta, M Sato, N. Mishima, S. Sasaki, A. Nanri, Y Kimura and T. Mizoue: Dietary patterns and depressive symptoms among Japanese men and women. European Journal of Clinical Nutrition, 64(8), pp.832--839, 2010.

[6]

D. Maynes-Aminzade: Edible Bits: Seamless Interfaces between People, Data and Food, ACM CHI 2005 Extended Abstracts, pp.2207--2210, 2005.

[7]

A. Zoran and M. Coelho: Cornucopia: The Concept of Digital Gastronomy, in Leonardo: Journal of the International Society for the Arts, Sciences and Technology, Volume 44, Number 5, pp. 425--431, 2011.

[8]

M. Auvray and C. Spence: The multisensory perception of flavor, Consciousness and Cognition. 17(2008), pp. 1016--1031, 2008.

[9]

H. Iwata, H. Yano, T. Uemura and T. Moriya: "Food Simulator: A Haptic Interface for Biting", Proceedings of IEEE Virtual Reality 2004, pp.51--57, 2004.

Digital Library

[10]

Y. Hashimoto, M. Inami and H. Kajimoto: Straw-like User Interface (II): a new method of presenting auditory sensations for a more natural experience, Euro Haptics 2008, pp.484--493, 2008.

Digital Library

[11]

N. Koizumi, H. Tanaka, Y. Uema, and M. Inami: Chewing jockey: augmented food texture by using sound based on the cross-modal effect, In Proc. of the 8th International Conference on Advances in Computer Entertainment Technology (ACE '11), 21:1--4, 2011.

Digital Library

[12]

C. Spence, C.A. Levitan, M.U. Shankar, and M. Zampini. Does food color influence taste and flavor perception in humans? Chemosensory Perception, Vol. 3, No. 1, pp. 68--84, 2010.

[13]

C.N. DuBose, A.V. Cardello, O. Maller: Effects of Colorants And Flavorants on Identification, Perceived Flavor Intensity, And Hedonic Quality of Fruit-Flavored Beverages and Cake, Journal of Food Science, Volume 45, Issue 5, pp. 1393--1399, 1980.

[14]

T. Narumi, M. Sato, T. Tanikawa and M. Hirose: Evaluating Cross-Sensory Perception of Superimposing Virtual Color onto Real Drink: Toward Realization of Pseudo-Gustatory Displays, ACM the 1st Augmented Human International Conference, 18:1--6, 2010.

Digital Library

[15]

T. Narumi, T. Kajinami, S. Nishizaka, T. Tanikawa and M. Hirose: Pseudo-gustatory display system based on cross-modal integration of vision, olfaction and gustation, In Proc. of IEEE Virtual Reality Conference (VR) 2011, pp.127--130, 2011.

Digital Library

[16]

A. Nambu, T. Narumi, K. Nishimura, T. Tanikawa, and M. Hirose: Visual-olfactory display using olfactory sensory map. In Proc. of IEEE Virtual Reality 2010, pp. 39--42, 2010.

Digital Library

[17]

T. Narumi, M. Miyaura, T. Tanikawa, and M. Hirose: Simplification of olfactory stimuli in pseudo-gustatory displays. IEEE transactions on visualization and computer graphics, 20(4), pp. 504--512, 2014.

Digital Library

[18]

M. Imaizumi, M. Takeda, S.Sawano and T. Fushiki: Opioidergic contribution to conditioned place preference induced by corn oil in mice. Behavioural brain research, Vol.121, No.1, pp.129--136, 2001.

[19]

H. Asano, T. Mizuno, A. Nozawa and H. Ide: Comparison with Amount of Gustatory Sense and Nasal Skin Temperature. Journal of Robotics and Mechatronics 21.1, pp.81, 2009.

[20]

W. James: The principles of psychology, New York, Dover Publications, Vol.2, 1950.

[21]

S. Yoshida, S. Sakurai, T. Narumi, T. Tanikawa and M. Hirose: Manipulation of an Emotional Experience by Realtime Deformed Facial Feedback, Augmented Human 2013, pp.35--42, Mar. 2013.

Digital Library

[22]

C. Suzuki, T. Narumi, T. Tanikawa, and M. Hirose: Affecting tumbler: affecting our flavor perception with thermal feedback. In Proceedings of the 11th Conference on Advances in Computer Entertainment Technology, 19, 2014.

Digital Library

[23]

H. Nakamura, and H. Miyashita: Augmented gustation using electricity. In Proceedings of the 2nd Augmented Human International Conference, p. 34, 2011.

Digital Library

[24]

N. Ranasinghe, K. Karunanayaka, A.D. Cheok, O.N.N. Fernando, H. Nii, and P. Gopalakrishnakone: Digital taste and smell communication. In Proceedings of the 6th International Conference on Body Area Networks, pp. 78--84, 2011.

Digital Library

[25]

S. Sakurai, K. Aoyama, N. Miyamoto, M. Mizukami, M. Furukawa, T. Maeda, and H. Ando: Mechanism of inhibitory effect of cathodal current tongue stimulation on five basic tastes. In Virtual Reality (VR), 2016 IEEE, pp. 279--280, 2016.

[26]

J. Mankoff, G. Hsieh, HC. Hung, S. Lee and E. Nitao: Using Low-Cost Sensing to Support Nutritional Awareness. In Proceedings of Ubicomp 2002, pp. 371--378, 2002.

Digital Library

[27]

J. Noronha, E. Hysen, H. Zhang and KZ. Gajos: Platemate: crowdsourcing nutritional analysis from food photographs. In Proceedings of the 24th annual ACM symposium on User interface software and technology (UIST '11), pp. 1--12, 2011.

Digital Library

[28]

B. Lyman: A Psychology of Food. More Than a Matter of Taste. Van Nostrand-Reinhold, 1989.

[29]

R. Bell and PL. Pliner: Time to eat: the relationship between the number of people eating and meal duration in three lunch settings. Appetite 41:215--218, 2003.

[30]

BJ. Rolls, EL. Morris and LS. Roe: Portion size of food affects energy intake in normal-weight and overweight men and women, American Journal of Clinical Nutrition, Vol. 76, No. 6, pp.1207--1213, December 2002

[31]

BJ. Rolls, LS. Roe, TVE. Kral, JS, Meengs and DE. Wall: Increasing the portion size of a packaged snack increases energy intake in men and women, Appetite, Vol. 42 Issue 1, pp. 63--69, 2004.

[32]

E. Suzui, T. Narumi, S. Ssakurai, T. Tanikawa, and M. Hirose: Illusion Cup: Interactive Controlling of Beverage Consumption Based on an Illusion of Volume Perception, Augmented Human 2014, Article.41:8, Mar. 2014.

Digital Library

[33]

Y. Ban, T. Narumi, T. Tanikawa, M. Hirose: Modifying perceived size of a handled object through hand image deformation. Presence: Teleoperators and Virtual Environments, 22(3), 255--270, 2013.

Digital Library

[34]

S. Sakurai, T. Narumi, Y. Ban, T. Tanikawa, M. Hirose: CalibraTable: tabletop system for influencing eating behavior. In SIGGRAPH Asia 2015 Emerging Technologies, 4, 2015.

Digital Library

[35]

S. Sakurai, T. Narumi, Y. Ban, T. Tanikawa, M. Hirose: Affecting our perception of satiety by changing the size of virtual dishes displayed with a tabletop display. In International Conference on Virtual, Augmented and Mixed Reality, pp. 90--99, 2013.

[36]

Y. Mejova, H. Haddadi, A. Noulas, and I. Weber: # FoodPorn: Obesity patterns in culinary interactions. In Proceedings of the 5th International Conference on Digital Health 2015, pp. 51--58, 2015.

Digital Library

[37]

B. Wansink, Mindless eating: Why we eat more than we think, Bantam, 2007.

[38]

T. Takeuchi, T. Fujii, K. Ogawa, T. Narumi, T. Tanikawa, and M. Hirose, "Using Social Media to Change Eating Habits Without Conscious Effort," in Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication, 2014, pp. 527--535.

Digital Library

[39]

T. Takeuchi, T. Fujii, T. Narumi, T. Tanikawa, and M. Hirose: Considering individual taste in social feedback to improve eating habits. In 2015 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), pp. 1--6, 2015.

Cited By

Wang LLi YZhang YZheng B(2025)Artificial Taste: Advances and Innovative Applications in HealthcareApplied Sciences10.3390/app1502054515:2(545)Online publication date: 8-Jan-2025
https://doi.org/10.3390/app15020545
Shin HDawes CXue JObrist M(2024)How does red taste?: Exploring how colour-taste associations affect our experience of food In Real Life and Extended RealityCompanion Proceedings of the 26th International Conference on Multimodal Interaction10.1145/3686215.3686222(134-137)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3686215.3686222
Amarasinghe CRanasinghe N(2024)Digital Food Sensing and Ingredient Analysis Techniques to Facilitate Human-Food Interface DesignsACM Computing Surveys10.1145/368567557:1(1-39)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3685675
Show More Cited By

Index Terms

Multi-sensorial virtual reality and augmented human food interaction
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Virtual reality

Recommendations

Extending Virtual Reality Display Wall Environments Using Augmented Reality
SUI '19: Symposium on Spatial User Interaction

Two major form factors for virtual reality are head-mounted displays and large display environments such as CAVE®and the LCD-based successor CAVE2®. Each of these has distinct advantages and limitations based on how they’re used. This work explores ...
Speed reading on virtual reality and augmented reality
Abstract
Many virtual reality (VR) and augmented reality (AR) applications in education require speed reading. The current study aimed to explore whether the reading performance on VR and AR is different from that on traditional desktop display,...
Highlights
- We explored performance of speed reading on virtual and augmented reality.
- ...
Haptics in Augmented Reality
ICMCS '99: Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2

An augmented reality system merges synthetic sensory information into a user's perception of a three-dimensional environment. An important performance goal for an augmented reality system is that the user perceives a single seamless environment. In most ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

MHFI '16: Proceedings of the 1st Workshop on Multi-sensorial Approaches to Human-Food Interaction

November 2016

48 pages

ISBN:9781450345613

DOI:10.1145/3007577

Editors:
Anton Nijholt
HMI, University of Twente, Netherlands, and Imagineering Institute, Malaysia
,
Carlos Velasco
BI Norwegian Business School, Norway, and University of Oxford, UK
,
Gijs Huisman
HMI, University of Twente, Netherlands
,
Kasun Karunanayaka
Imagineering Institute, Malaysia

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 November 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICMI '16

ICMI '16: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION

November 16, 2016

Tokyo, Japan

Acceptance Rates

MHFI '16 Paper Acceptance Rate 6 of 8 submissions, 75%;

Overall Acceptance Rate 6 of 8 submissions, 75%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

55
Total Citations
View Citations
1,324
Total Downloads

Downloads (Last 12 months)180
Downloads (Last 6 weeks)18

Reflects downloads up to 16 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wang LLi YZhang YZheng B(2025)Artificial Taste: Advances and Innovative Applications in HealthcareApplied Sciences10.3390/app1502054515:2(545)Online publication date: 8-Jan-2025
https://doi.org/10.3390/app15020545
Shin HDawes CXue JObrist M(2024)How does red taste?: Exploring how colour-taste associations affect our experience of food In Real Life and Extended RealityCompanion Proceedings of the 26th International Conference on Multimodal Interaction10.1145/3686215.3686222(134-137)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3686215.3686222
Amarasinghe CRanasinghe N(2024)Digital Food Sensing and Ingredient Analysis Techniques to Facilitate Human-Food Interface DesignsACM Computing Surveys10.1145/368567557:1(1-39)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3685675
Choi EKang Y(2024)A Multi-sensory Kiosk Interface to Familiarize Users with New FoodsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435458:1(1-26)Online publication date: 6-Mar-2024
https://dl.acm.org/doi/10.1145/3643545
Song KTung SKim APaulos E(2024)Füpop: "Real Food" Flavor Delivery via Focused UltrasoundProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642709(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642709
Or EMaidenbaum S(2024)When Vision Lies - Navigating Virtual Environments with Unreliable Visual Information2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00112(935-944)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00112
Restrepo GPrakash EDashti SCastillo S. AGómez JOviedo LFloyd JAycardi JTrejos JGonzález JSierra MNavarro-Newball A(2024)Extended Realities for Sensorially Diverse ChildrenIEEE Computer Graphics and Applications10.1109/MCG.2024.341969944:4(26-39)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1109/MCG.2024.3419699
Karhu NRantala JFarooq ASand APennanen KLappi JNayak MSozer NRaisamo R(2024)The effects of haptic, visual and olfactory augmentations on food consumed while wearing an extended reality headsetJournal on Multimodal User Interfaces10.1007/s12193-024-00447-8Online publication date: 11-Dec-2024
https://doi.org/10.1007/s12193-024-00447-8
Ogata KGakumi RHashimoto AUshiku YYoshida S(2023)The influence of Bouba- and Kiki-like shape on perceived taste of chocolate piecesFrontiers in Psychology10.3389/fpsyg.2023.117067414Online publication date: 15-Jun-2023
https://doi.org/10.3389/fpsyg.2023.1170674
Cui RChen WPeng DMinamizawa KPai Y(2023)FoodMorph: Changing Food Appearance Towards Less Unhealthy Food IntakeSIGGRAPH Asia 2023 Posters10.1145/3610542.3626149(1-2)Online publication date: 12-Dec-2023
https://dl.acm.org/doi/10.1145/3610542.3626149
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents