More Web Proxy on the site http://driver.im/

abstract

Touch, Taste, & Smell User Interfaces: The Future of Multisensory HCI

Authors:

Marianna Obrist,

Carlos Velasco,

Nimesha Ranasinghe,

Adrian D. Cheok,

Charles Spence,

Ponnampalam GopalakrishnakoneAuthors Info & Claims

CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

Pages 3285 - 3292

https://doi.org/10.1145/2851581.2856462

Published: 07 May 2016 Publication History

Abstract

The senses we call upon when interacting with technology are very restricted. We mostly rely on vision and audition, increasingly harnessing touch, whilst taste and smell remain largely underexploited. In spite of our current knowledge about sensory systems and sensory devices, the biggest stumbling block for progress concerns the need for a deeper understanding of people's multisensory experiences in HCI. It is essential to determine what tactile, gustatory, and olfactory experiences we can design for, and how we can meaningfully stimulate such experiences when interacting with technology. Importantly, we need to determine the contribution of the different senses along with their interactions in order to design more effective and engaging digital multisensory experiences. Finally, it is vital to understand what the limitations are that come into play when users need to monitor more than one sense at a time. The aim of this workshop is to deepen and expand the discussion on touch, taste, and smell within the CHI community and promote the relevance of multisensory experience design and research in HCI.

References

[1]

Andrew J. Bremner, David J. Lewkowicz, and Charles Spence (Eds.). 2012. Multisensory development. Oxford: Oxford University Press.

[2]

Caroline Bushdid, Marcelo O. Magnasco, Leslie B. Vosshall, and Andreas Keller 2014. Humans can Discriminate more than one Trillion Olfactory Stimuli. Science (New York, N.Y.), 343(6177), 1370-137

[3]

Gemma A. Calvert, Charles Spence, and Barry E. Stein 2004. The handbook of multisensory processes. Cambridge, MA: MIT Press.

[4]

Martin Murer, Ilhan Aslan, and Manfred Tscheligi. 2013. LOLLio: exploring taste as playful modality. In Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction (TEI '13). ACM, New York, NY, USA, 299--302.

Digital Library

[5]

Takuji Narumi, Shinya Nishizaka, Takashi Kajinami, Tomohiro Tanikawa, and Michitaka Hirose. 2011. Augmented reality flavors: gustatory display based on edible marker and cross-modal interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 93--102.

Digital Library

[6]

Marianna Obrist, Rob Comber, Sriram Subramanian, Betina Piqueras-Fiszman, Carlos Velasco, and Charles Spence. 2014. Temporal, affective, and embodied characteristics of taste experiences: a framework for design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 2853--2862.

Digital Library

[7]

Marianna Obrist, Alexandre N. Tuch, and Kasper Hornbaek. 2014. Opportunities for odor: experiences with smell and implications for technology. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 2843--2852.

Digital Library

[8]

Marianna Obrist, Sriram Subramanian, Elia Gatti, Benjamin Long, and Thomas Carter. 2015. Emotions Mediated Through Mid-Air Haptics. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2053--2062.

Digital Library

[9]

Marianna Obrist, Sue Ann Seah, and Sriram Subramanian. 2013. Talking about tactile experiences. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 1659--1668.

Digital Library

[10]

John Prescott. 1999. Flavor as a psychological construct: implications for perceiving and measuring the sensory qualities of foods. Food Quality and Preference, 10(4), 349--356.

[11]

Nimesha Ranasinghe, Kasun Karunanayaka, Adrian David Cheok, Owen Noel Newton Fernando, Hideaki Nii, and Ponnampalam Gopalakrishnakone. 20 Digital taste and smell communication. In Proceedings of the 6th International Conference on Body Area Networks (BodyNets '11). ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), ICST, Brussels, Belgium, Belgium, 78--84.

Digital Library

[12]

Nimesha Ranasinghe, Kuan-Yi Lee, Gajan Suthokumar, and Ellen Yi-Luen Do. 2014. Taste+: Digitally Enhancing Taste Sensations of Food and Beverages. In Proceedings of the 22nd ACM international conference on Multimedia (MM '14). ACM, New York, NY, USA, 737--738.

Digital Library

[13]

Charles Spence. 2015. Multisensory flavor perception. Cell, 161(1), 24--35.

[14]

Charles Spence, Barry Smith, and Malika Auvray. 2015. Confusing tastes and flavors. In D. Stokes, M. Matthen & S. Biggs (Eds.), Perception and its modalities (pp. 247--274). Oxford, UK: Oxford University Press.

[15]

Barry E. Stein (Ed.). 2012. The new handbook of multisensory processing. Cambridge, MA: MIT Press.

[16]

Siyan Zhao, Oliver Schneider, Roberta Klatzky, Jill Lehman, and Ali Israr. 2014. FeelCraft: crafting tactile experiences for media using a feel effect library. In Proceedings of the adjunct publication of the 27th annual ACM symposium on User interface software and technology (UIST'14 Adjunct). ACM, New York, NY, USA, 51--52.

Digital Library

Cited By

Spence CGao Y(2024)Augmenting home entertainment with digitally delivered touchi-Perception10.1177/2041669524128147415:5Online publication date: 17-Oct-2024
https://doi.org/10.1177/20416695241281474
Dawes CXue JBrianza GCornelio PMontano Murillo RMaggioni EObrist M(2024)ScentHaptics: Augmenting the Haptic Experiences of Digital Mid-Air Textiles with ScentProceedings of the 26th International Conference on Multimodal Interaction10.1145/3678957.3685715(47-56)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3678957.3685715
Neves P(2024)Environmental Multisensory HCI Design Strategies: Molecules as StorytellersHuman-Computer Interaction10.1007/978-3-031-60441-6_6(79-97)Online publication date: 29-Jun-2024
https://dl.acm.org/doi/10.1007/978-3-031-60441-6_6
Show More Cited By

Index Terms

Touch, Taste, & Smell User Interfaces: The Future of Multisensory HCI
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Mastering the Senses in HCI: Towards Multisensory Interfaces
CHItaly '17: Proceedings of the 12th Biannual Conference on Italian SIGCHI Chapter

With the proliferation of sensory technologies that do not only stimulate the sense of vision and hearing, but also our sense of touch, smell, and taste, we are confronted with the challenge of mastering those "new" senses in the design of interactive ...
Don't just Look -- Smell, Taste, and Feel the Interaction
MM '18: Proceedings of the 26th ACM international conference on Multimedia

While our understanding of the sensory modalities for human-computer interaction (HCI) is advancing, there is still a huge gap in our understanding of 'how' to best integrate different modalities into the interaction with technology. While we have ...
Integration of Touch and Taste with Interactive Media
TVX '17 Adjunct: Adjunct Publication of the 2017 ACM International Conference on Interactive Experiences for TV and Online Video

My PhD (started in Nov. 2015) focuses on the integration of touch and taste with interactive media. While technology, in particular haptic technology, is developing fast, there is a lack of understanding on what kind of experiences we can design when ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

May 2016

3954 pages

ISBN:9781450340823

DOI:10.1145/2851581

General Chairs:
Jofish Kaye
Yahoo
,
Allison Druin
University of Maryland / National Park Service
,
Program Chairs:
Cliff Lampe
University of Michigan
,
Dan Morris
Microsoft
,
Juan Pablo Hourcade
University of Iowa

Copyright © 2016 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2016

Check for updates

Author Tags

Qualifiers

Abstract

Funding Sources

European Research Council

Conference

CHI'16

Sponsor:

SIGCHI

CHI'16: CHI Conference on Human Factors in Computing Systems

May 7 - 12, 2016

California, San Jose, USA

Acceptance Rates

CHI EA '16 Paper Acceptance Rate 1,000 of 5,000 submissions, 20%;

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

47
Total Citations
View Citations
1,640
Total Downloads

Downloads (Last 12 months)136
Downloads (Last 6 weeks)17

Reflects downloads up to 12 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Spence CGao Y(2024)Augmenting home entertainment with digitally delivered touchi-Perception10.1177/2041669524128147415:5Online publication date: 17-Oct-2024
https://doi.org/10.1177/20416695241281474
Dawes CXue JBrianza GCornelio PMontano Murillo RMaggioni EObrist M(2024)ScentHaptics: Augmenting the Haptic Experiences of Digital Mid-Air Textiles with ScentProceedings of the 26th International Conference on Multimodal Interaction10.1145/3678957.3685715(47-56)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3678957.3685715
Neves P(2024)Environmental Multisensory HCI Design Strategies: Molecules as StorytellersHuman-Computer Interaction10.1007/978-3-031-60441-6_6(79-97)Online publication date: 29-Jun-2024
https://dl.acm.org/doi/10.1007/978-3-031-60441-6_6
Wang ZBarker NWu YFjeld M(2023)Substituting Animals with Biohybrid Robots: Speculative Interactions with Animal-Robot HybridsCompanion Publication of the 2023 ACM Designing Interactive Systems Conference10.1145/3563703.3596641(173-178)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563703.3596641
Tzanidou AAbosaleh ALindsay SDurrant AVlachokyriakos V(2023)From Inclusive Theatre to inclusive technologies: Lessons learnt from co-designing Touch Tours with an Inclusive Theatre groupProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596094(1367-1382)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596094
Brombacher HNikolov VVos SHouben S(2023)Scent as a Sensory Modality for Data Physicalisation for Office Well-beingExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585866(1-8)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585866
Brooks JLopes PObrist MAmores Fernandez JKaye J(2023)Third Wave or Winter? The Past and Future of Smell in HCIExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3583749(1-4)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3583749
Karunanayaka KCheok AVedadi S(2023)Digital Smell: Toward Electrically Reproducing Artificial Smell SensationsIEEE Access10.1109/ACCESS.2023.327809311(50659-50670)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3278093
Niedenthal SFredborg WLundén PEhrndal MOlofsson J(2023)A graspable olfactory display for virtual realityInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2022.102928169:COnline publication date: 1-Jan-2023
https://dl.acm.org/doi/10.1016/j.ijhcs.2022.102928
Amini Gougeh RFalk T(2023)Towards instrumental quality assessment of multisensory immersive experiences using a biosensor-equipped head-mounted displayQuality and User Experience10.1007/s41233-023-00062-78:1Online publication date: 15-Oct-2023
https://doi.org/10.1007/s41233-023-00062-7
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents