GustoGear: A Cross-Modal Interface Emphasizing Tactile and Flavor Communication for Extended Reality
Pages 402 - 407
Abstract
This study introduces a cross-modal, tongue-involved interface designed to enrich taste and touch perception within Mixed Reality (MR) environments. It features a novel gear-like mechanism loaded with various flavored conductive jellies, forming a cross-modal platform. This interface enables the gear to present different flavor units to the user’s tongue, activated by specific virtual events. This setup fosters mutual communication and a playful experience between the physical and virtual worlds, leveraging the synesthesia of taste and tactile perceptions.
References
[1]
Jas Brooks, Noor Amin, and Pedro Lopes. 2023. Taste Retargeting via Chemical Taste Modulators. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (, San Francisco, CA, USA,) (UIST ’23). Association for Computing Machinery, New York, NY, USA, Article 106, 15 pages. https://doi.org/10.1145/3586183.3606818
[2]
Jialin Deng, Ferran Altarriba Bertran, Lining Yao, Marianna Obrist, Koya Narumi, Humphrey Yang, Mako Miyatake, and Florian Mueller. 2022. Mapping FoodHCI Futures. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI EA ’22). Association for Computing Machinery, New York, NY, USA, Article 166, 5 pages. https://doi.org/10.1145/3491101.3516401
[3]
Takekazu Kitagishi, Yuichi Hiroi, Yuna Watanabe, Yuta Itoh, and Jun Rekimoto. 2023. Telextiles: End-to-end Remote Transmission of Fabric Tactile Sensation. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (, San Francisco, CA, USA, ) (UIST ’23). Association for Computing Machinery, New York, NY, USA, Article 67, 10 pages. https://doi.org/10.1145/3586183.3606764
[4]
Signe Lund Mathiesen, Derek Victor Byrne, and Qian Janice Wang. 2019. Sonic Mug: A Sonic Seasoning System. In Proceedings of the 14th International Audio Mostly Conference: A Journey in Sound (Nottingham, United Kingdom) (AM ’19). Association for Computing Machinery, New York, NY, USA, 264–267. https://doi.org/10.1145/3356590.3356634
[5]
Manan Mehta. 2015. ESP8266: A Breakthrough in wireless sensor networks and internet of things. International Journal of Electronics and Communication Engineering & Technology 6, 8 (2015), 7–11.
[6]
Homei Miyashita. 2020. Taste Display that Reproduces Tastes Measured by a Taste Sensor. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’20). Association for Computing Machinery, New York, NY, USA, 1085–1093. https://doi.org/10.1145/3379337.3415852
[7]
Dinmukhammed Mukashev, Nimesha Ranasinghe, and Aditya Shekhar Nittala. 2023. TactTongue: Prototyping ElectroTactile Stimulations on the Tongue. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (, San Francisco, CA, USA, ) (UIST ’23). Association for Computing Machinery, New York, NY, USA, Article 105, 14 pages. https://doi.org/10.1145/3586183.3606829
[8]
OpenAI. 2022. ChatGPT: Optimizing Language Models for Dialogue. https://openai.com/blog/chatgpt. Accessed: 2024-03-14.
[9]
Nimesha Ranasinghe and Ellen Yi-Luen Do. 2016. Digital Lollipop: Studying Electrical Stimulation on the Human Tongue to Simulate Taste Sensations. ACM Trans. Multimedia Comput. Commun. Appl. 13, 1, Article 5 (oct 2016), 22 pages. https://doi.org/10.1145/2996462
[10]
Nimesha Ranasinghe, Thi Ngoc Tram Nguyen, Yan Liangkun, Lien-Ya Lin, David Tolley, and Ellen Yi-Luen Do. 2017. Vocktail: A Virtual Cocktail for Pairing Digital Taste, Smell, and Color Sensations. In Proceedings of the 25th ACM International Conference on Multimedia (Mountain View, California, USA) (MM ’17). Association for Computing Machinery, New York, NY, USA, 1139–1147. https://doi.org/10.1145/3123266.3123440
[11]
Freescale Semiconductor. 2010. Proximity capacitive touch sensor controller. reescale Semiconductor. Retrieved May 8,2024 from https://www.nxp.com/docs/en/data-sheet/MPR121.pdf
[12]
Chi Thanh Vi, Damien Ablart, Daniel Arthur, and Marianna Obrist. 2017. Gustatory interface: the challenges of ‘how’ to stimulate the sense of taste. In Proceedings of the 2nd ACM SIGCHI International Workshop on Multisensory Approaches to Human-Food Interaction (Glasgow, UK) (MHFI 2017). Association for Computing Machinery, New York, NY, USA, 29–33. https://doi.org/10.1145/3141788.3141794
[13]
Chi Thanh Vi, Daniel Arthur, and Marianna Obrist. 2018. TasteBud: Bring Taste Back into the Game. In Proceedings of the 3rd International Workshop on Multisensory Approaches to Human-Food Interaction (Boulder, CO, USA) (MHFI’18). Association for Computing Machinery, New York, NY, USA, Article 1, 5 pages. https://doi.org/10.1145/3279954.3279955
[14]
Yan Wang, Zhuying Li, Robert Jarvis, Rohit Ashok Khot, and Florian ’Floyd’ Mueller. 2018. The Singing Carrot: Designing Playful Experiences with Food Sounds. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts (, Melbourne, VIC, Australia, ) (CHI PLAY ’18 Extended Abstracts). Association for Computing Machinery, New York, NY, USA, 669–676. https://doi.org/10.1145/3270316.3271512
[15]
Yan Wang, Zhuying Li, Robert S. Jarvis, Angelina Russo, Rohit Ashok Khot, and Florian ’Floyd’ Mueller. 2019. Towards Understanding the Design of Playful Gustosonic Experiences with Ice Cream. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play (, Barcelona, Spain, ) (CHI PLAY ’19). Association for Computing Machinery, New York, NY, USA, 239–251. https://doi.org/10.1145/3311350.3347194
[16]
Zhen Wu, Rongkai Shi, Ziming Li, Mengqi Jiang, Yue Li, Lingyun Yu, and Hai-Ning Liang. 2022. Examining cross-modal correspondence between ambient color and taste perception in virtual reality. Frontiers in Virtual Reality 3 (2022), 1056782.
Index Terms
- GustoGear: A Cross-Modal Interface Emphasizing Tactile and Flavor Communication for Extended Reality
Recommendations
Shared Reconstructed Environments in Extended Reality
SVR '24: Proceedings of the 26th Symposium on Virtual and Augmented RealityModern extended reality headsets can identify the geometry of the physical surrounding space, which can be shared and synchronized with remote users, allowing them to view the space through their own extended reality headsets from different points of ...
A brain-computer interface for extended reality interfaces
SIGGRAPH '17: ACM SIGGRAPH 2017 VR VillageExtended reality (XR) technologies, such as augmented reality (AR) and virtual reality (VR), remain limited in their interaction modalities. Prevailing interaction methods such as hand gestures and voice recognition prove awkward in XR environments, ...
User Experience Guidelines for Designing HMD Extended Reality Applications
Human-Computer Interaction – INTERACT 2019AbstractWith the rise of Extended Reality (XR) technologies, such as head mounted displays (HMD) for Virtual Reality (VR), Mixed Reality (MR), and Augmented Reality (AR), designers are presented with many unique challenges and opportunities when creating ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
June 2024
465 pages
ISBN:9798400705038
DOI:10.1145/3639701
Copyright © 2024 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 07 June 2024
Check for updates
Author Tags
Qualifiers
- Work in progress
- Research
- Refereed limited
Conference
IMX '24: ACM International Conference on Interactive Media Experiences
June 12 - 14, 2024
Stockholm, Sweden
Acceptance Rates
Overall Acceptance Rate 69 of 245 submissions, 28%
Upcoming Conference
IMX '25
- Sponsor:
- sigchi
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 63Total Downloads
- Downloads (Last 12 months)63
- Downloads (Last 6 weeks)9
Reflects downloads up to 25 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format