More Web Proxy on the site http://driver.im/

research-article

Masque: Exploring Lateral Skin Stretch Feedback on the Face with Head-Mounted Displays

Authors:

Ruei-Che Chang,

Bing-Yu ChenAuthors Info & Claims

UIST '19: Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology

Pages 439 - 451

https://doi.org/10.1145/3332165.3347898

Published: 17 October 2019 Publication History

Abstract

We propose integrating an array of skin stretch modules with an head-mounted display (HMD) to provide two-dimensional skin stretch feedback on the user's face. Skin stretch has been found effective to induce the perception of force (e.g. weight or inertia) and to enable directional haptic cues. However, its potential as an HMD output for virtual reality (VR) remains to be exploited. Our explorative study firstly investigated the design of shear tactors. Based on our results, Masque has been implemented as an HMD prototype actuating six shear tactors positioned on the HMD's face interface. A comfort study was conducted to ensure that skin stretches generated by Masque are acceptable to all participants. The following two perception-based studies examined the minimum changes in skin stretch distance and stretch angles that are detectable by participants. The results help us to design haptic profiles as well as our prototype applications. Finally, the user evaluation indicates that participants welcomed Masque and regarded skin stretch feedback as a worthwhile addition to HMD output.

Supplementary Material

MP4 File (ufp4218pv.mp4)

Preview video

Download
15.07 MB

MP4 File (ufp4218vf.mp4)

Supplemental video

Download
134.36 MB

MP4 File (p439-wang.mp4)

Download
271.80 MB

References

[1]

Ahmed Al Maimani and Anne Roudaut. 2017. Frozen Suit: Designing a Changeable Stiffness Suit and Its Ap- plication to Haptic Games. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Sys- tems (CHI '17). ACM, New York, NY, USA, 2440--2448.

Digital Library

[2]

Kazuma Aoyama, Daiki Higuchi, Kenta Sakurai, Taro Maeda, and Hideyuki Ando. 2017. GVS RIDE: Provid- ing a Novel Experience Using a Head Mounted Display and Four-pole Galvanic Vestibular Stimulation. In ACM SIGGRAPH 2017 Emerging Technologies (SIGGRAPH 17). ACM, New York, NY, USA, Article 9, 2 pages.

Digital Library

[3]

Karlin Bark, Jason W Wheeler, Sunthar Premakumar, and Mark R Cutkosky. 2008. Comparison of skin stretch and vibrotactile stimulation for feedback of propriocep- tive information. In 2008 Symposium on Haptic Inter- faces for Virtual Environment and Teleoperator Systems. IEEE, 71--78.

Digital Library

[4]

Nathaniel A Caswell, Ryan T Yardley, Markus N Mon- tandon, and William R Provancher. 2012. Design of a forearm-mounted directional skin stretch device. In Haptics Symposium (HAPTICS), 2012 IEEE. IEEE, 365-- 370.

[5]

Hong-Yu Chang, Wen-Jie Tseng, Chia-En Tsai, Hsin-Yu Chen, Roshan Lalintha Peiris, and Liwei Chan. 2018. FacePush: Introducing Normal Force on Face with Head- Mounted Displays. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Tech- nology (UIST '18). ACM, New York, NY, USA, 927--935.

Digital Library

[6]

Zikun Chen, Wei Peng, Roshan Peiris, and Kouta Mi- namizawa. 2017. ThermoReality: Thermally Enriched Head Mounted Displays for Virtual Reality. In ACM SIGGRAPH 2017 Posters (SIGGRAPH '17). ACM, New York, NY, USA, Article 32, 2 pages. org/10.1145/3102163.3102222

[7]

Francesco Chinello, Claudio Pacchierotti, Nikos G Tsagarakis, and Domenico Prattichizzo. 2016a. Design of a wearable skin stretch cutaneous device for the up- per limb. In Haptics Symposium (HAPTICS), 2016 IEEE. IEEE, 14--20.

[8]

Francesco Chinello, Claudio Pacchierotti, Nikos G Tsagarakis, and Domenico Prattichizzo. 2016b. Design of a wearable skin stretch cutaneous device for the up- per limb. In Haptics Symposium (HAPTICS), 2016 IEEE. IEEE, 14--20.

[9]

Heather Culbertson, Samuel B Schorr, and Allison M Okamura. 2018. Haptics: The present and future of artificial touch sensation. Annual Review of Control, Robotics, and Autonomous Systems 1 (2018), 385--409.

[10]

Victor Adriel de Jesus Oliveira, Luca Brayda, Luciana Nedel, and Anderson Maciel. 2017. Experiencing guid- ance in 3D spaces with a vibrotactile head-mounted dis- play. In 2017 IEEE Virtual Reality (VR). IEEE, 453--454.

[11]

Adrien Girard, Maud Marchal, Florian Gosselin, An- thony Chabrier, Francois Louveau, and Anatole Lecuyer. 2016. Haptip: Displaying haptic shear forces at the fingertips for multi-finger interaction in virtual environ- ments. Frontiers in ICT 3 (2016), 6.

[12]

Brian T Gleeson, Scott K Horschel, and William R Provancher. 2009. Communication of direction through lateral skin stretch at the fingertip. In EuroHaptics con- ference, 2009 and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics 2009. Third Joint. IEEE, 172--177.

Digital Library

[13]

Brian T Gleeson, Scott K Horschel, and William R Provancher. 2010. Perception of direction for applied tangential skin displacement: Effects of speed, displace- ment, and repetition. IEEE transactions on haptics 3, 3 (2010), 177--188.

[14]

Brian T Gleeson, Charles A Stewart, and William R Provancher. 2011. Improved tactile shear feedback: Tac- tor design and an aperture-based restraint. IEEE Trans- actions on Haptics 4, 4 (2011), 253--262.

Digital Library

[15]

Jan Gugenheimer, Dennis Wolf, Eythor R. Eiriksson, Pattie Maes, and Enrico Rukzio. 2016. GyroVR: Sim- ulating Inertia in Virtual Reality Using Head Worn Flywheels. In Proceedings of the 29th Annual Sym- posium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 227--232.

Digital Library

[16]

Ahmet Guzererler, William R Provancher, and Cagatay Basdogan. 2016. Perception of skin stretch applied to palm: Effects of speed and displacement. In Interna- tional Conference on Human Haptic Sensing and Touch Enabled Computer Applications. Springer, 180--189.

[17]

Da-Yuan Huang, Liwei Chan, Xiao-Feng Jian, Chiun- Yao Chang, Mu-Hsuan Chen, De-Nian Yang, Yi-Ping Hung, and Bing-Yu Chen. 2016. Vibroplay: Author- ing Three-dimensional Spatial-temporal Tactile Effects with Direct Manipulation. In SIGGRAPH ASIA 2016 Emerging Technologies (SA '16). ACM, New York, NY, USA, Article 3, 2 pages. 1145/2988240.2988250

Digital Library

[18]

Alexandra Ion, Edward Jay Wang, and Patrick Baudisch. 2015. Skin Drag Displays: Dragging a Physical Tactor Across the User's Skin Produces a Stronger Tactile Stimu- lus Than Vibrotactile. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Sys- tems (CHI '15). ACM, New York, NY, USA, 2501--2504.

Digital Library

[19]

Takayuki Kameoka, Yuki Kon, Takuto Nakamura, and Hiroyuki Kajimoto. 2018. Haptopus: Haptic VR Expe- rience Using Suction Mechanism Embedded in Head- mounted Display. In The 31st Annual ACM Sympo- sium on User Interface Software and Technology Ad- junct Proceedings (UIST '18 Adjunct). ACM, New York, NY, USA, 154--156. 3266037.3271634

[20]

Oliver Beren Kaul and Michael Rohs. 2017. Haptic- Head: A Spherical Vibrotactile Grid Around the Head for 3D Guidance in Virtual and Augmented Reality. In Proceedings of the 2017 CHI Conference on Human Fac- tors in Computing Systems (CHI '17). ACM, New York, NY, USA, 3729--3740. 3025453.3025684

Digital Library

[21]

Yuki Kon, Takuto Nakamura, and Hiroyuki Kajimoto. 2017. HangerOVER: HMD-embedded Haptics Display with Hanger Reflex. In ACM SIGGRAPH 2017 Emerging Technologies (SIGGRAPH '17). ACM, New York, NY, USA, Article 11, 2 pages. 1145/3084822.3084842

Digital Library

[22]

Michinari Kono, Takashi Miyaki, and Jun Rekimoto. 2018. In-pulse: Inducing Fear and Pain in Virtual Ex- periences. In Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology (VRST '18). ACM, New York, NY, USA, Article 40, 5 pages.

Digital Library

[23]

Daniele Leonardis, Massimiliano Solazzi, Ilaria Bortone, and Antonio Frisoli. 2015. A wearable fingertip haptic device with 3 DoF asymmetric 3-RSR kinematics. In 2015 IEEE World Haptics Conference (WHC). IEEE, 388--393.

[24]

Daniele Leonardis, Massimiliano Solazzi, Ilaria Bortone, and Antonio Frisoli. 2017. A 3-RSR haptic wearable device for rendering fingertip contact forces. IEEE trans- actions on haptics 10, 3 (2017), 305--316.

Digital Library

[25]

Jo-Yu Lo, Da-Yuan Huang, Chen-Kuo Sun, Chu-En Hou, and Bing-Yu Chen. 2018. RollingStone: Using Single Slip Taxel for Enhancing Active Finger Exploration with a Virtual Reality Controller. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST '18). ACM, New York, NY, USA, 839-- 851.

Digital Library

[26]

Kouta Minamizawa, Souichiro Fukamachi, Hiroyuki Kajimoto, Naoki Kawakami, and Susumu Tachi. 2007. Gravity grabber: wearable haptic display to present vir- tual mass sensation. In ACM SIGGRAPH 2007 emerging technologies. ACM, 8.

[27]

C. Pacchierotti, S. Sinclair, M. Solazzi, A. Frisoli, V. Hayward, and D. Prattichizzo. 2017. Wearable Haptic Systems for the Fingertip and the Hand: Taxonomy, Re- view, and Perspectives. IEEE Transactions on Haptics 10, 4 (Oct 2017), 580--600. 1109/TOH.2017.2689006

Digital Library

[28]

Roshan Lalintha Peiris, Liwei Chan, and Kouta Mi- namizawa. 2018. LiquidReality: Wetness Sensations on the Face for Virtual Reality. In International Con- ference on Human Haptic Sensing and Touch Enabled Computer Applications. Springer, 366--378.

[29]

Roshan Lalintha Peiris, Wei Peng, Zikun Chen, Liwei Chan, and Kouta Minamizawa. 2017. ThermoVR: Ex- ploring Integrated Thermal Haptic Feedback with Head Mounted Displays. In Proceedings of the 2017 CHI Con- ference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 5452--5456.

Digital Library

[30]

William R Provancher and Nicholas D Sylvester. 2009. Fingerpad skin stretch increases the perception of virtual friction. IEEE Transactions on Haptics 2, 4 (2009), 212-- 223.

Digital Library

[31]

Zhan Fan Quek, Samuel B Schorr, Ilana Nisky, Al- lison M Okamura, and William R Provancher. 2014. Augmentation of stiffness perception with a 1-degree- of-freedom skin stretch device. IEEE Transactions on Human-Machine Systems 44, 6 (2014), 731--742.

[32]

Zhan Fan Quek, Samuel B Schorr, Ilana Nisky, William R Provancher, and Allison M Okamura. 2015a. Sensory substitution and augmentation using 3-degree-of- freedom skin deformation feedback. IEEE transactions on haptics 8, 2 (2015), 209--221.

Digital Library

[33]

Zhan Fan Quek, Samuel B Schorr, Ilana Nisky, William R Provancher, and Allison M Okamura. 2015b. Sensory substitution of force and torque using 6-DoF tan- gential and normal skin deformation feedback. In 2015 IEEE International Conference on Robotics and Automa- tion (ICRA). IEEE, 264--271.

[34]

Nimesha Ranasinghe, Pravar Jain, Shienny Karwita, David Tolley, and Ellen Yi-Luen Do. 2017. Ambio- therm: Enhancing Sense of Presence in Virtual Reality by Simulating Real-World Environmental Conditions. In Proceedings of the 2017 CHI Conference on Human Fac- tors in Computing Systems (CHI '17). ACM, New York, NY, USA, 1731--1742. 3025453.3025723

Digital Library

[35]

MHD Yamen Saraiji, Roshan Lalintha Peiris, Lichao Shen, Kouta Minamizawa, and Susumu Tachi. 2018. Ambient: Facial Thermal Feedback in Remotely Op- erated Applications. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Sys- tems (CHI EA '18). ACM, New York, NY, USA, Article D321, 4 pages. 3186483

[36]

Michi Sato, Rika Matsue, Yuki Hashimoto, and Hiroyuki Kajimoto. 2009. Development of a head rotation inter- face by using hanger reflex. In Robot and Human Inter- active Communication, 2009. RO-MAN 2009. The 18th IEEE International Symposium on. IEEE, 534--538.

[37]

Samuel B Schorr and Allison M Okamura. 2017a. Fin- gertip tactile devices for virtual object manipulation and exploration. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 3115-- 3119.

Digital Library

[38]

SamuelBenjaminSchorrandAllisonMOkamura.2017b. Three-dimensional skin deformation as force substitu- tion: Wearable device design and performance during haptic exploration of virtual environments. IEEE Trans- actions on Haptics 10, 3 (2017), 418--430.

Digital Library

[39]

Massimiliano Solazzi, William R Provancher, Antonio Frisoli, and Massimo Bergamasco. 2011. Design of a SMA actuated 2-DoF tactile device for displaying tan- gential skin displacement. In World Haptics Conference (WHC), 2011 IEEE. IEEE, 31--36.

[40]

Andrew A Stanley and Katherine J Kuchenbecker. 2012. Evaluation of tactile feedback methods for wrist rotation guidance. IEEE Transactions on Haptics 5, 3 (2012), 240--251.

Digital Library

[41]

Dzmitry Tsetserukou, Shotaro Hosokawa, and Kazuhiko Terashima. 2014. LinkTouch: A wearable haptic de- vice with five-bar linkage mechanism for presentation of two-DOF force feedback at the fingerpad. In 2014 IEEE Haptics Symposium (HAPTICS). IEEE, 307--312.

[42]

Jason Wheeler, Karlin Bark, Joan Savall, and Mark Cutkosky. 2010. Investigation of rotational skin stretch for proprioceptive feedback with application to myoelec- tric systems. IEEE Transactions on Neural Systems and Rehabilitation Engineering 18, 1 (2010), 58--66.

[43]

Eric Whitmire, Hrvoje Benko, Christian Holz, Eyal Ofek, and Mike Sinclair. 2018. Haptic Revolver: Touch, Shear, Texture, and Shape Rendering on a Reconfig- urable Virtual Reality Controller. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 86, 12 pages. 3173660

Digital Library

Cited By

Lin YZhang POfek EJe S(2024)ArmDeformation: Inducing the Sensation of Arm Deformation in Virtual Reality Using Skin-StretchingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642518(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642518
Kim TShim YKim YKim SLee JLee G(2024)QuadStretcher: A Forearm-Worn Skin Stretch Display for Bare-Hand Interaction in AR/VRProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642067(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642067
Yu NMa SLin CFan CTaglialatela LHuang TYu CCheng YLiao YChen M(2023)DrivingVibe: Enhancing VR Driving Experience using Inertia-based Vibrotactile Feedback around the HeadProceedings of the ACM on Human-Computer Interaction10.1145/36042537:MHCI(1-22)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604253
Show More Cited By

Index Terms

Masque: Exploring Lateral Skin Stretch Feedback on the Face with Head-Mounted Displays
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Haptic devices
    2. Interaction paradigms
      1. Virtual reality

Recommendations

Haptic around: multiple tactile sensations for immersive environment and interaction in virtual reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology

In this paper, we present Haptic Around, a hybrid-haptic feedback system, which utilizes fan, hot air blower, mist creator and heat light to recreate multiple tactile sensations in virtual reality for enhancing the immersive environment and interaction. ...
GravityCup: a liquid-based haptics for simulating dynamic weight in virtual reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology

During interaction in a virtual environment, haptic displays provide users with sensations such as vibration, texture simulation, and electrical muscle stimulation. However, as humans perceive object weights naturally in daily life, objects picked up in ...
Enabling Reusable Haptic Props for Virtual Reality by Hand Displacement
MuC '21: Proceedings of Mensch und Computer 2021

Virtual Reality (VR) enables compelling visual experiences. However, providing haptic feedback is still challenging. Previous work suggests utilizing haptic props to overcome such limitations and presents evidence that props could function as a single ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '19: Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology

October 2019

1229 pages

ISBN:9781450368162

DOI:10.1145/3332165

General Chair:
François Guimbretière
Cornell University, USA
,
Program Chairs:
Michael Bernstein
Stanford University, USA
,
Katharina Reinecke
University of Washington, USA

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 October 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UIST '19

Sponsor:

UIST '19: The 32nd Annual ACM Symposium on User Interface Software and Technology

October 20 - 23, 2019

LA, New Orleans, USA

Acceptance Rates

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

22
Total Citations
View Citations
1,008
Total Downloads

Downloads (Last 12 months)76
Downloads (Last 6 weeks)20

Reflects downloads up to 09 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Lin YZhang POfek EJe S(2024)ArmDeformation: Inducing the Sensation of Arm Deformation in Virtual Reality Using Skin-StretchingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642518(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642518
Kim TShim YKim YKim SLee JLee G(2024)QuadStretcher: A Forearm-Worn Skin Stretch Display for Bare-Hand Interaction in AR/VRProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642067(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642067
Yu NMa SLin CFan CTaglialatela LHuang TYu CCheng YLiao YChen M(2023)DrivingVibe: Enhancing VR Driving Experience using Inertia-based Vibrotactile Feedback around the HeadProceedings of the ACM on Human-Computer Interaction10.1145/36042537:MHCI(1-22)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604253
Ke BLi MChen YCheng CChang CLi YWang SFang CChen M(2023)TurnAhead: Designing 3-DoF Rotational Haptic Cues to Improve First-person Viewing (FPV) ExperiencesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581443(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581443
Han SPark JChoi S(2023)Generating Haptic Motion Effects for Multiple Articulated Bodies for Improved 4D Experiences: A Camera Space ApproachProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580727(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580727
Yamazaki YHasegawa S(2023)Providing 3D Guidance and Improving the Music-Listening Experience in Virtual Reality Shooting Games Using Musical Vibrotactile Feedback2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR55154.2023.00043(276-285)Online publication date: Mar-2023
https://doi.org/10.1109/VR55154.2023.00043
Clark JO'Malley M(2023)Defining Allowable Stimulus Ranges for Position and Force Controlled Cutaneous CuesIEEE Transactions on Haptics10.1109/TOH.2023.328630616:3(353-364)Online publication date: 1-Jul-2023
https://doi.org/10.1109/TOH.2023.3286306
Costes ALécuyer A(2023)Inducing Self-Motion Sensations With Haptic Feedback: State-of-The-Art and Perspectives on “Haptic Motion”IEEE Transactions on Haptics10.1109/TOH.2023.327926716:2(171-181)Online publication date: Apr-2023
https://doi.org/10.1109/TOH.2023.3279267
Kent J(2023)Biomechanically-Consistent Skin Stretch as an Intuitive Mechanism for Sensory Feedback: A Preliminary Investigation in the Lower LimbIEEE Transactions on Haptics10.1109/TOH.2023.323852516:1(106-111)Online publication date: 1-Jan-2023
https://doi.org/10.1109/TOH.2023.3238525
Nakamura FVerhulst ASakurada KFukuoka MSugimoto M(2022)Evaluation of Spatial Directional Guidance Using Cheek Haptic Stimulation in a Virtual EnvironmentFrontiers in Computer Science10.3389/fcomp.2022.7338444Online publication date: 12-May-2022
https://doi.org/10.3389/fcomp.2022.733844
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents