More Web Proxy on the site http://driver.im/

research-article

TactTongue: Prototyping ElectroTactile Stimulations on the Tongue

Authors:

Dinmukhammed Mukashev,

Nimesha Ranasinghe,

Aditya Shekhar NittalaAuthors Info & Claims

UIST '23: Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology

Article No.: 105, Pages 1 - 14

https://doi.org/10.1145/3586183.3606829

Published: 29 October 2023 Publication History

Abstract

The tongue is a remarkable human organ with a high concentration of taste receptors and an exceptional ability to sense touch. This work uses electro-tactile stimulation to explore the intricate interplay between tactile perception and taste rendering on the tongue. To facilitate this exploration, we utilized a flexible, high-resolution electro-tactile prototyping platform that can be administered in the mouth. We have created a design tool that abstracts users from the low-level stimulation parameters, enabling them to focus on higher-level design objectives. Through this platform, we present the results of three studies. Our first study evaluates the design tool’s qualitative and formative aspects. In contrast, the second study measures the qualitative attributes of the sensations produced by our device, including tactile sensations and taste. In the third study, we demonstrate the ability of our device to sense touch input through the tongue when placed on the hard palate region in the mouth. Finally, we present a range of application demonstrators that span diverse domains, including accessibility, medical surgeries, and extended reality. These demonstrators showcase the versatility and potential of our platform, highlighting its ability to enable researchers and practitioners to explore new ways of leveraging the tongue’s unique capabilities. Overall, this work presents new opportunities to deploy tongue interfaces and has broad implications for designing interfaces that incorporate the tongue as a sensory organ.

Supplemental Material

ZIP File

Supplemental File

Download
210.00 MB

References

[1]

Gaetano L Aiello. 1998. Multidimensional electrocutaneous stimulation. IEEE Transactions on Rehabilitation Engineering 6, 1 (1998), 95–101.

[2]

Aadeel Akhtar, Joseph Sombeck, Brandon Boyce, and Timothy Bretl. 2018. Controlling sensation intensity for electrotactile stimulation in human-machine interfaces. Science robotics 3, 17 (2018), eaap9770.

[3]

Helmut Altner, Josef Dudel, Otto-Joachim Grüsser, Ursula Grüsser-Cornehls, Rainer Klinke, and Manfred Zimmermann. 2012. Fundamentals of sensory physiology. Springer Science & Business Media.

[4]

Judith Amores, Robert Richer, Nan Zhao, Pattie Maes, and Bjoern M Eskofier. 2018. Promoting relaxation using virtual reality, olfactory interfaces and wearable EEG. In 2018 IEEE 15th international conference on wearable and implantable body sensor networks (BSN). IEEE, 98–101.

[5]

Paul Bach-y Rita. 2004. Tactile sensory substitution studies. Annals of the New York Academy of Sciences 1013, 1 (2004), 83–91.

[6]

Paul Bach-y Rita, Kurt A. Kaczmarek, Mitchell E. Tyler, and Jorge Garcia-Lara. 1998. Form perception with a 49-point electrotactile stimulus array on the tongue: A technical note. Journal of Rehabilitation Research and Development 35, 4 (1998), 427–430.

[7]

Paul Bach-y Rita, Kurt A Kaczmarek, Mitchell E Tyler, Jorge Garcia-Lara, 1998. Form perception with a 49-point electrotactile stimulus array on the tongue: a technical note. Journal of rehabilitation research and development 35 (1998), 427–430.

[8]

Scott P Breen, Nicole M Etter, Gregory R Ziegler, and John E Hayes. 2019. Oral somatosensatory acuity is related to particle size perception in chocolate. Scientific Reports 9, 1 (2019), 1–10.

[9]

Héctor A Caltenco, Björn Breidegard, and Lotte NS Andreasen Struijk. 2014. On the tip of the tongue: Learning typing and pointing with an intra-oral computer interface. Disability and Rehabilitation: Assistive Technology 9, 4 (2014), 307–317.

[10]

Héctor A Caltenco, Lotte NS Andreasen Struijk, and Björn Breidegard. 2010. TongueWise: Tongue-computer interface software for people with tetraplegia. In 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology. IEEE, 4534–4537.

[11]

Victor Chen, Xuhai Xu, Richard Li, Yuanchun Shi, Shwetak Patel, and Yuntao Wang. 2021. Understanding the Design Space of Mouth Microgestures. In Designing Interactive Systems Conference 2021 (Virtual Event, USA) (DIS ’21). Association for Computing Machinery, New York, NY, USA, 1068–1081. https://doi.org/10.1145/3461778.3462004

Digital Library

[12]

Burke Davison. 2010. Techniques for robust touch sensing design. AN1334 Microchip Technology Inc (2010), 53.

[13]

Donald Degraen, Bruno Fruchard, Frederik Smolders, Emmanouil Potetsianakis, Seref Güngör, Antonio Krüger, and Jürgen Steimle. 2021. Weirding Haptics: In-Situ Prototyping of Vibrotactile Feedback in Virtual Reality through Vocalization. In The 34th Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’21). Association for Computing Machinery, New York, NY, USA, 936–953. https://doi.org/10.1145/3472749.3474797

Digital Library

[14]

Bruce Denby and Maureen Stone. 2004. Speech synthesis from real time ultrasound images of the tongue. In 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing, Vol. 1. IEEE, I–685.

[15]

Aritra Dhar, Aditya Nittala, and Kuldeep Yadav. 2016. TactBack: VibroTactile Braille Output Using Smartphone and Smartwatch for Visually Impaired. In Proceedings of the 13th International Web for All Conference (Montreal, Canada) (W4A ’16). Association for Computing Machinery, New York, NY, USA, Article 13, 2 pages. https://doi.org/10.1145/2899475.2899514

Digital Library

[16]

Gershon Dublon and Joseph A Paradiso. 2012. Tongueduino: hackable, high-bandwidth sensory augmentation. In CHI’12 Extended Abstracts on Human Factors in Computing Systems. 1453–1454.

[17]

Pablo Gallego Cascón, Denys J.C. Matthies, Sachith Muthukumarana, and Suranga Nanayakkara. 2019. ChewIt. An Intraoral Interface for Discreet Interactions. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300556

Digital Library

[18]

Robert H Gibson. 1968. Electrical stimulation of pain and touch. The Skin Secses (1968).

[19]

Saul Greenberg. 2007. Toolkits and interface creativity. Multimedia Tools and Applications 32 (2007), 139–159.

Digital Library

[20]

Saul Greenberg and Chester Fitchett. 2001. Phidgets: Easy Development of Physical Interfaces through Physical Widgets. In Proceedings of the 14th Annual ACM Symposium on User Interface Software and Technology (Orlando, Florida) (UIST ’01). Association for Computing Machinery, New York, NY, USA, 209–218. https://doi.org/10.1145/502348.502388

Digital Library

[21]

Warren M Grill and J Thomas Mortimer. 1995. Stimulus waveforms for selective neural stimulation. IEEE Engineering in Medicine and Biology Magazine 14, 4 (1995), 375–385.

[22]

Daniel Groeger, Martin Feick, Anusha Withana, and Jürgen Steimle. 2019. Tactlets: Adding Tactile Feedback to 3D Objects Using Custom Printed Controls. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19). Association for Computing Machinery, New York, NY, USA, 923–936. https://doi.org/10.1145/3332165.3347937

Digital Library

[23]

Steven J Haase and Kurt A Kaczmarek. 2005. Electrotactile perception of scatterplots on the fingertips and abdomen. Medical and Biological Engineering and Computing 43 (2005), 283–289.

[24]

Steve Hodges, James Scott, Sue Sentance, Colin Miller, Nicolas Villar, Scarlet Schwiderski-Grosche, Kerry Hammil, and Steven Johnston. 2013...NET Gadgeteer: A New Platform for K-12 Computer Science Education. In Proceeding of the 44th ACM Technical Symposium on Computer Science Education (Denver, Colorado, USA) (SIGCSE ’13). Association for Computing Machinery, New York, NY, USA, 391–396. https://doi.org/10.1145/2445196.2445315

Digital Library

[25]

Steven Houben and Nicolai Marquardt. 2015. WatchConnect: A Toolkit for Prototyping Smartwatch-Centric Cross-Device Applications. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 1247–1256. https://doi.org/10.1145/2702123.2702215

Digital Library

[26]

Xueliang Huo, Jia Wang, and Maysam Ghovanloo. 2008. A magneto-inductive sensor based wireless tongue-computer interface. IEEE transactions on neural systems and rehabilitation engineering 16, 5 (2008), 497–504.

[27]

Arata Jingu, Takaaki Kamigaki, Masahiro Fujiwara, Yasutoshi Makino, and Hiroyuki Shinoda. 2021. LipNotif: use of lips as a non-contact tactile notification interface based on ultrasonic tactile presentation. In The 34th annual ACM symposium on user interface software and technology. 13–23.

[28]

Kurt A Kaczmarek. 2011. The tongue display unit (TDU) for electrotactile spatiotemporal pattern presentation. Scientia Iranica 18, 6 (2011), 1476–1485.

[29]

Kurt A Kaczmarek and Steven J Haase. 2003. Pattern identification and perceived stimulus quality as a function of stimulation waveform on a fingertip-scanned electrotactile display. IEEE Transactions on Neural Systems and Rehabilitation Engineering 11, 1 (2003), 9–16.

[30]

Kurt A Kaczmarek and Mitchell E Tyler. 2000. Effect of electrode geometry and intensity control method on comfort of electrotactile stimulation on the tongue. In ASME International Mechanical Engineering Congress and Exposition, Vol. 26652. American Society of Mechanical Engineers, 1239–1243.

[31]

Kurt A Kaczmarek, J. G. Webster, P Bach-y Rita, and W. J. Tompkins. 1991. Electrotactile and Vibrotactile Displays for Sensory Substitution Systems. IEEE Trans. Biomed. Eng 38, 1 (1991), 1–16.

[32]

Kurt A Kaczmarek, John G Webster, and Robert G Radwin. 1992. Maximal dynamic range electrotactile stimulation waveforms. IEEE Transactions on Biomedical Engineering 39, 7 (1992), 701–715.

[33]

Hiroyuki Kajimoto, Naoki Kawakami, Taro Maeda, and Susumu Tachi. 2002. Electrocutaneous display with receptor selective stimulations. Electronics and Communications in Japan (Part II: Electronics) 85, 6 (2002), 40–49.

[34]

Hsin-Liu (Cindy) Kao, Christian Holz, Asta Roseway, Andres Calvo, and Chris Schmandt. 2016. DuoSkin. In Proceedings of the 2016 ACM International Symposium on Wearable Computers - ISWC ’16. ACM Press, New York, New York, USA, 16–23. https://doi.org/10.1145/2971763.2971777

Digital Library

[35]

Jeonghee Kim, Hangue Park, Joy Bruce, Erica Sutton, Diane Rowles, Deborah Pucci, Jaimee Holbrook, Julia Minocha, Beatrice Nardone, Dennis West, 2013. The tongue enables computer and wheelchair control for people with spinal cord injury. Science translational medicine 5, 213 (2013), 213ra166–213ra166.

[36]

Marion Koelle, Madalina Nicolae, Aditya Shekhar Nittala, Marc Teyssier, and Jürgen Steimle. 2022. Prototyping Soft Devices with Interactive Bioplastics. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology (Bend, OR, USA) (UIST ’22). Association for Computing Machinery, New York, NY, USA, Article 19, 16 pages. https://doi.org/10.1145/3526113.3545623

Digital Library

[37]

Enrica Laneve, Bruna Raddato, Mario Dioguardi, Giovanni Di Gioia, Giuseppe Troiano, Lorenzo Lo Muzio, 2019. Sterilisation in dentistry: a review of the literature. International journal of dentistry 2019 (2019).

[38]

David Ledo, Steven Houben, Jo Vermeulen, Nicolai Marquardt, Lora Oehlberg, and Saul Greenberg. 2018. Evaluation Strategies for HCI Toolkit Research. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–17. https://doi.org/10.1145/3173574.3173610

Digital Library

[39]

Richard Li, Jason Wu, and Thad Starner. 2019. TongueBoard: An Oral Interface for Subtle Input. In Proceedings of the 10th Augmented Human International Conference 2019 (Reims, France) (AH2019). Association for Computing Machinery, New York, NY, USA, Article 1, 9 pages. https://doi.org/10.1145/3311823.3311831

Digital Library

[40]

Joanne Lo, Doris Jung Lin Lee, Nathan Wong, David Bui, and Eric Paulos. 2016. Skintillates. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems - DIS ’16. ACM Press, New York, New York, USA, 853–864. https://doi.org/10.1145/2901790.2901885

Digital Library

[41]

Eugen R Lontis and Lotte NS Andreasen Struijk. 2013. Mapping sensor activation time for typing tasks performed with a tongue controlled oral interface. In 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE, 5911–5913.

[42]

Jasmine Lu, Ziwei Liu, Jas Brooks, and Pedro Lopes. 2021. Chemical Haptics: Rendering Haptic Sensations via Topical Stimulants. In The 34th Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’21). Association for Computing Machinery, New York, NY, USA, 239–257. https://doi.org/10.1145/3472749.3474747

Digital Library

[43]

Morten Enemark Lund, Henrik Vie Christiensen, Héctor A Caltenco, Eugen Romulus Lontis, Bo Bentsen, and Lotte NS Andreasen Struijk. 2010. Inductive tongue control of powered wheelchairs. In 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology. IEEE, 3361–3364.

[44]

Homei Miyashita. 2020. Taste Display That Reproduces Tastes Measured by a Taste Sensor. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’20). Association for Computing Machinery, New York, NY, USA, 1085–1093. https://doi.org/10.1145/3379337.3415852

Digital Library

[45]

Joel Moritz Jr, Philip Turk, John D. Williams, and Leslie M. Stone-Roy. 2017. Perceived Intensity and Discrimination Ability for Lingual Electrotactile Stimulation Depends on Location and Orientation of Electrodes. Frontiers in Human Neuroscience 11, 186 (2017).

[46]

Joel Adrian Moritz Jr. 2016. Evaluation of electrical tongue stimulation for communication of audio information to the brain. Ph. D. Dissertation. Colorado State University.

[47]

Phuc Nguyen, Nam Bui, Anh Nguyen, Hoang Truong, Abhijit Suresh, Matt Whitlock, Duy Pham, Thang Dinh, and Tam Vu. 2018. Tyth-typing on your teeth: Tongue-teeth localization for human-computer interface. In Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services. 269–282.

Digital Library

[48]

Aditya Shekhar Nittala, Andreas Karrenbauer, Arshad Khan, Tobias Kraus, and Jürgen Steimle. 2021. Computational design and optimization of electro-physiological sensors. Nature Communications 12, 1 (2021), 1–14.

[49]

Aditya Shekhar Nittala, Arshad Khan, Klaus Kruttwig, Tobias Kraus, and Jürgen Steimle. 2020. PhysioSkin: Rapid Fabrication of Skin-Conformal Physiological Interfaces. Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/3313831.3376366

Digital Library

[50]

Aditya Shekhar Nittala, Nico Li, Stephen Cartwright, Kazuki Takashima, Ehud Sharlin, and Mario Costa Sousa. 2015. PLANWELL: Spatial User Interface for Collaborative Petroleum Well-Planning. In SIGGRAPH Asia 2015 Mobile Graphics and Interactive Applications (Kobe, Japan) (SA ’15). Association for Computing Machinery, New York, NY, USA, Article 19, 8 pages. https://doi.org/10.1145/2818427.2818443

Digital Library

[51]

Aditya Shekhar Nittala and Jürgen Steimle. 2022. Next Steps in Epidermal Computing: Opportunities and Challenges for Soft On-Skin Devices. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 389, 22 pages. https://doi.org/10.1145/3491102.3517668

Digital Library

[52]

Aditya Shekhar Nittala, Anusha Withana, Narjes Pourjafarian, and Jürgen Steimle. 2018. Multi-Touch Skin: A Thin and Flexible Multi-Touch Sensor for On-Skin Input. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). ACM, New York, NY, USA, Article 33, 12 pages. https://doi.org/10.1145/3173574.3173607

Digital Library

[53]

Shuo Niu, Li Liu, and D Scott McCrickard. 2019. Tongue-able interfaces: Prototyping and evaluating camera based tongue gesture input system. Smart Health 11 (2019), 16–28.

[54]

Lotte NS Andreasen Struijk, Eugen R Lontis, Michael Gaihede, Hector A Caltenco, Morten Enemark Lund, Henrik Schioeler, and Bo Bentsen. 2017. Development and functional demonstration of a wireless intraoral inductive tongue computer interface for severely disabled persons. Disability and Rehabilitation: Assistive Technology 12, 6 (2017), 631–640.

[55]

Zahide Pamir, M Umut Canoluk, Jae-Hyun Jung, and Eli Peli. 2020. Poor resolution at the back of the tongue is the bottleneck for spatial pattern recognition. Scientific reports 10, 1 (2020), 1–13.

[56]

Alvaro Pascual-Leone and Roy Hamilton. 2001. The metamodal organization of the brain. Progress in brain research 134 (2001), 427–445.

[57]

Evan Pezent, Brandon Cambio, and Marcia K O’Malley. 2020. Syntacts: Open-source software and hardware for audio-controlled haptics. IEEE Transactions on Haptics 14, 1 (2020), 225–233.

[58]

Max Pfeiffer, Tim Duente, and Michael Rohs. 2016. Let Your Body Move: A Prototyping Toolkit for Wearable Force Feedback with Electrical Muscle Stimulation. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (Florence, Italy) (MobileHCI ’16). Association for Computing Machinery, New York, NY, USA, 418–427. https://doi.org/10.1145/2935334.2935348

Digital Library

[59]

Henning Pohl and Kasper Hornbæk. 2018. ElectricItch: Skin Irritation as a Feedback Modality. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST ’18). Association for Computing Machinery, New York, NY, USA, 765–778. https://doi.org/10.1145/3242587.3242647

Digital Library

[60]

Narjes Pourjafarian, Anusha Withana, Joseph A. Paradiso, and Jürgen Steimle. 2019. Multi-Touch Kit: A Do-It-Yourself Technique for Capacitive Multi-Touch Sensing Using a Commodity Microcontroller. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19). Association for Computing Machinery, New York, NY, USA, 1071–1083. https://doi.org/10.1145/3332165.3347895

Digital Library

[61]

Michael J Proulx, David J Brown, Achille Pasqualotto, and Peter Meijer. 2014. Multisensory perceptual learning and sensory substitution. Neuroscience & Biobehavioral Reviews 41 (2014), 16–25.

[62]

Nimesha Ranasinghe and Ellen Yi-Luen Do. 2016. Digital Lollipop: Studying Electrical Stimulation on the Human Tongue to Simulate Taste Sensations. ACM Trans. Multimedia Comput. Commun. Appl. 13, 1, Article 5 (oct 2016), 22 pages. https://doi.org/10.1145/2996462

Digital Library

[63]

Nimesha Ranasinghe, Ryohei Nakatsu, Hideaki Nii, and Ponnampalam Gopalakrishnakone. 2012. Tongue mounted interface for digitally actuating the sense of taste. In 2012 16th international symposium on wearable computers. IEEE, 80–87.

Digital Library

[64]

J Patrick Reilly. 2012. Applied bioelectricity: from electrical stimulation to electropathology. Springer Science & Business Media.

[65]

Mike Richardson, Karin Petrini, and Michael Proulx. 2022. Climb-o-Vision: A Computer Vision Driven Sensory Substitution Device for Rock Climbing. In CHI Conference on Human Factors in Computing Systems Extended Abstracts. 1–7.

[66]

Mike Richardson, Karin Petrini, and Michael J Proulx. 2022. Orientation of tactile attention on the surface of the tongue.Journal of Experimental Psychology: Human Perception and Performance (2022).

[67]

Mike L Richardson, Tayfun Lloyd-Esenkaya, Karin Petrini, and Michael J Proulx. 2020. Reading with the tongue: Individual differences affect the perception of ambiguous stimuli with the BrainPort. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–10.

Digital Library

[68]

Fabien Robineau, Frdric Boy, Jean-Pierre Orliaguet, Jacques Demongeot, and Yohan Payan. 2007. Guiding the surgical gesture using an electro-tactile stimulus array on the tongue: A feasibility study. IEEE transactions on biomedical engineering 54, 4 (2007), 711–717.

[69]

Gary B Rollman. 1974. Electrocutaneous stimulation. (1974).

[70]

Jonghyun Ryu and Seungmoon Choi. 2008. posVibEditor: Graphical authoring tool of vibrotactile patterns. In 2008 IEEE International Workshop on Haptic Audio visual Environments and Games. IEEE, 120–125.

[71]

Eliana Sampaio, Stéphane Maris, and Paul Bach-y Rita. 2001. Brain plasticity:‘visual’acuity of blind persons via the tongue. Brain research 908, 2 (2001), 204–207.

[72]

Frank A Saunders. 1974. Electrocutaneous displays. Cutaneous communication systems and devices (1974), 20–26.

[73]

Valkyrie Savage, Xiaohan Zhang, and Björn Hartmann. 2012. Midas: Fabricating Custom Capacitive Touch Sensors to Prototype Interactive Objects. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (Cambridge, Massachusetts, USA) (UIST ’12). Association for Computing Machinery, New York, NY, USA, 579–588. https://doi.org/10.1145/2380116.2380189

Digital Library

[74]

Oliver Schneider, Karon MacLean, Colin Swindells, and Kellogg Booth. 2017. Haptic experience design: What hapticians do and where they need help. International Journal of Human-Computer Studies 107 (2017), 5–21.

Digital Library

[75]

Oliver Schneider, Siyan Zhao, and Ali Israr. 2015. FeelCraft: User-crafted tactile content. Haptic Interaction: Perception, Devices and Applications (2015), 253–259.

[76]

Oliver S. Schneider, Ali Israr, and Karon E. MacLean. 2015. Tactile Animation by Direct Manipulation of Grid Displays. In Proceedings of the 28th Annual ACM Symposium on User Interface Software &; Technology (Charlotte, NC, USA) (UIST ’15). Association for Computing Machinery, New York, NY, USA, 21–30. https://doi.org/10.1145/2807442.2807470

Digital Library

[77]

Oliver S Schneider and Karon E MacLean. 2014. Improvising design with a haptic instrument. In 2014 IEEE Haptics Symposium (HAPTICS). IEEE, 327–332.

[78]

Oliver S. Schneider, Hasti Seifi, Salma Kashani, Matthew Chun, and Karon E. MacLean. 2016. HapTurk: Crowdsourcing Affective Ratings of Vibrotactile Icons. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 3248–3260. https://doi.org/10.1145/2858036.2858279

Digital Library

[79]

Vivian Shen, Craig Shultz, and Chris Harrison. 2022. Mouth Haptics in VR using a headset ultrasound phased array. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–14.

Digital Library

[80]

Ronit Slyper, Jill Lehman, Jodi Forlizzi, and Jessica Hodgins. 2011. A tongue input device for creating conversations. In Proceedings of the 24th annual ACM symposium on User interface software and technology. 117–126.

Digital Library

[81]

Paul Strohmeier, Seref Güngör, Luis Herres, Dennis Gudea, Bruno Fruchard, and Jürgen Steimle. 2020. BARefoot: Generating Virtual Materials Using Motion Coupled Vibration in Shoes. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’20). Association for Computing Machinery, New York, NY, USA, 579–593. https://doi.org/10.1145/3379337.3415828

Digital Library

[82]

Lotte NS Andreasen Struijk, Bo Bentsen, Michael Gaihede, and Eugen R Lontis. 2017. Error-free text typing performance of an inductive intra-oral tongue computer interface for severely disabled individuals. IEEE Transactions on Neural Systems and Rehabilitation Engineering 25, 11 (2017), 2094–2104.

[83]

Lotte NS Andreasen Struijk, Eugen Romulus Lontis, Bo Bentsen, Henrik Vie Christensen, Hector A Caltenco, and Morten Enemark Lund. 2009. Fully integrated wireless inductive tongue computer interface for disabled people. In 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE, 547–550.

[84]

Shan-Yuan Teng, Pengyu Li, Romain Nith, Joshua Fonseca, and Pedro Lopes. 2021. Touch & Fold: A Foldable Haptic Actuator for Rendering Touch in Mixed Reality. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 736, 14 pages. https://doi.org/10.1145/3411764.3445099

Digital Library

[85]

Peter Khoa Duc Tran, Purna Valli Anusha Gadepalli, Jaeyeon Lee, and Aditya Shekhar Nittala. 2023. Augmenting On-Body Touch Input with Tactile Feedback Through Fingernail Haptics. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 79, 13 pages. https://doi.org/10.1145/3544548.3581473

Digital Library

[86]

Mats Trulsson and Gregory K Essick. 1997. Low-threshold mechanoreceptive afferents in the human lingual nerve. Journal of neurophysiology 77, 2 (1997), 737–748.

[87]

Mitchell E Tyler, Jacquelin G Braun, and Yuri P Danilov. 2009. Spatial mapping of electrotactile sensation threshold and intensity range on the human tongue: Initial results. In 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE, 559–562.

[88]

Nicolas Villar, Kiel Mark Gilleade, Devina Ramdunyellis, and Hans Gellersen. 2007. The VoodooIO Gaming Kit: A Real-Time Adaptable Gaming Controller. Comput. Entertain. 5, 3, Article 7 (jul 2007), 16 pages. https://doi.org/10.1145/1316511.1316518

Digital Library

[89]

Nicolas Vuillerme, Olivier Chenu, Jacques Demongeot, and Yohan Payan. 2007. Controlling posture using a plantar pressure-based, tongue-placed tactile biofeedback system. Experimental brain research 179 (2007), 409–414.

[90]

Nicolas Vuillerme and Rémy Cuisinier. 2008. Head position-based electrotactile tongue biofeedback affects postural responses to Achilles tendon vibration in humans. Experimental brain research 186 (2008), 503–508.

[91]

Nicolas Vuillerme, Nicolas Pinsault, Olivier Chenu, Anthony Fleury, Yohan Payan, and Jacques Demongeot. 2009. A wireless embedded tongue tactile biofeedback system for balance control. Pervasive and Mobile Computing 5, 3 (2009), 268–275.

Digital Library

[92]

Martin Weigel, Tong Lu, Gilles Bailly, Antti Oulasvirta, Carmel Majidi, and Jürgen Steimle. 2015. iSkin. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI ’15. ACM Press, New York, New York, USA, 2991–3000. https://doi.org/10.1145/2702123.2702391

Digital Library

[93]

Martin Weigel, Aditya Shekhar Nittala, Alex Olwal, and Jürgen Steimle. 2017. SkinMarks: Enabling Interactions on Body Landmarks Using Conformal Skin Electronics. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). ACM, New York, NY, USA, 3095–3105. https://doi.org/10.1145/3025453.3025704

Digital Library

[94]

Anusha Withana, Daniel Groeger, and Jürgen Steimle. 2018. Tacttoo: A Thin and Feel-Through Tattoo for On-Skin Tactile Output. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST ’18). ACM, New York, NY, USA, 365–378. https://doi.org/10.1145/3242587.3242645

Digital Library

[95]

Dennis Wittchen, Katta Spiel, Bruno Fruchard, Donald Degraen, Oliver Schneider, Georg Freitag, and Paul Strohmeier. 2022. TactJam: An End-to-End Prototyping Suite for Collaborative Design of On-Body Vibrotactile Feedback. In Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction (Daejeon, Republic of Korea) (TEI ’22). Association for Computing Machinery, New York, NY, USA, Article 1, 13 pages. https://doi.org/10.1145/3490149.3501307

Digital Library

[96]

Siyan Zhao, Zachary Schwemler, Adam Fritz, and Ali Israr. 2016. Stereo Haptics: Designing Haptic Interactions Using Audio Tools. In Proceedings of the TEI ’16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction (Eindhoven, Netherlands) (TEI ’16). Association for Computing Machinery, New York, NY, USA, 778–781. https://doi.org/10.1145/2839462.2854120

Digital Library

Cited By

Roy SChowdhury MNoim JPandey RNittala A(2024)HoloChemie - Sustainable Fabrication of Soft Biochemical Holographic Devices for Ubiquitous SensingProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676448(1-19)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676448
Jiang YKleinau JEckroth THoggan EMueller SWessely M(2024)MouthIO: Fabricating Customizable Oral User Interfaces with Integrated Sensing and ActuationProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676443(1-16)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676443
Chen PKo YWang J(2024)GustoGear: A Cross-Modal Interface Emphasizing Tactile and Flavor Communication for Extended RealityProceedings of the 2024 ACM International Conference on Interactive Media Experiences10.1145/3639701.3663644(402-407)Online publication date: 7-Jun-2024
https://dl.acm.org/doi/10.1145/3639701.3663644
Show More Cited By

Index Terms

TactTongue: Prototyping ElectroTactile Stimulations on the Tongue
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

FeetThrough: Electrotactile Foot Interface that Preserves Real-World Sensations
UIST '23: Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology

Haptic interfaces have been extended to the feet to enhance foot-based activities, such as guidance while walking or stepping on virtual textures. Most feet haptics use mechanical actuators, namely vibration motors. However, we argue that vibration ...
Augmenting On-Body Touch Input with Tactile Feedback Through Fingernail Haptics
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

The key assumption attributed to on-body touch input is that the skin being touched provides natural tactile feedback. In this paper, we for the first time systematically explore augmenting on-body touch input with computer-generated tactile feedback. ...
Explorations of Wrist Haptic Feedback for AR/VR Interactions with Tasbi
CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems

Most widespread haptic feedback devices for augmented and virtual reality (AR/VR) fall into one of two categories: simple hand-held controllers with a single vibration actuator, or complex glove systems with several embedded actuators. In this work, we ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '23: Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology

October 2023

1825 pages

ISBN:9798400701320

DOI:10.1145/3586183

Editors:
Sean Follmer
Stanford University, USA
,
Jeff Han,
Jürgen Steimle
Saarland University, Germany
,
Nathalie Henry Riche
Microsoft Research, USA

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 October 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

NSERC

Conference

UIST '23

Sponsor:

UIST '23: The 36th Annual ACM Symposium on User Interface Software and Technology

October 29 - November 1, 2023

CA, San Francisco, USA

Acceptance Rates

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
675
Total Downloads

Downloads (Last 12 months)363
Downloads (Last 6 weeks)44

Reflects downloads up to 24 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Roy SChowdhury MNoim JPandey RNittala A(2024)HoloChemie - Sustainable Fabrication of Soft Biochemical Holographic Devices for Ubiquitous SensingProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676448(1-19)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676448
Jiang YKleinau JEckroth THoggan EMueller SWessely M(2024)MouthIO: Fabricating Customizable Oral User Interfaces with Integrated Sensing and ActuationProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676443(1-16)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676443
Chen PKo YWang J(2024)GustoGear: A Cross-Modal Interface Emphasizing Tactile and Flavor Communication for Extended RealityProceedings of the 2024 ACM International Conference on Interactive Media Experiences10.1145/3639701.3663644(402-407)Online publication date: 7-Jun-2024
https://dl.acm.org/doi/10.1145/3639701.3663644
Panigrahy SLee CNagoria VJanghorban MPandey RNittala A(2024)ecSkin: Low-Cost Fabrication of Epidermal Electrochemical Sensors for Detecting Biomarkers in SweatProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642232(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642232
Jingu ASabnis NStrohmeier PSteimle J(2024)Shaping Compliance: Inducing Haptic Illusion of Compliance in Different Shapes with Electrotactile GrainsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641907(1-13)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641907
Cao CLiu HZhang YJia WZhang LBao H(2024)A Seamless, Large‐Area Silk‐based Interface for Immersive On‐Palm Tactile FeedbackAdvanced Materials Technologies10.1002/admt.2023015999:8Online publication date: 20-Feb-2024
https://doi.org/10.1002/admt.202301599

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents