More Web Proxy on the site http://driver.im/

research-article

PaCaPa: A Handheld VR Device for Rendering Size, Shape, and Stiffness of Virtual Objects in Tool-based Interactions

Authors:

Shigeo Yoshida,

Michitaka HiroseAuthors Info & Claims

CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

Paper No.: 452, Pages 1 - 12

https://doi.org/10.1145/3290605.3300682

Published: 02 May 2019 Publication History

Abstract

We present PaCaPa, a handheld device that renders haptics on a user's palm when the user interacts with virtual objects using virtual tools such as a stick. PaCaPa is a cuboid device with two wings that open and close. As the user's stick makes contact with a virtual object, the wings open by a specific degree to dynamically change the pressure on the palm and fingers. The open angle of the wings is calculated from the angle between the virtual stick and hand direction. As the stick bites into the target object, a large force is generated. Our device enables three kinds of renderings: size, shape, and stiffness. We conducted user studies to evaluate the performance of our device. We also evaluated our device in two application scenarios. User feedback and qualitative ratings indicated that our device can make indirect interaction with handheld tools more realistic.

Supplementary Material

MP4 File (paper452p.mp4)

Preview video

Download
3.74 MB

MP4 File (pn5968.mp4)

Supplemental video

Download
187.54 MB

References

[1]

Merwan Achibet, Maud Marchal, Ferran Argelaguet, and Anatole Lécuyer. 2014. The Virtual Mitten: A novel interaction paradigm for visuo-haptic manipulation of objects using grip force. In 3D User Interfaces (3DUI), 2014 IEEE Symposium on. IEEE, 59--66.

[2]

M Osama Alhalabi, Vytautas Daniulaitis, Haruhisa Kawasaki, Yuji Tanaka, and Takumi Hori. 2004. Haptic interaction rendering technique for HIRO: An opposite human hand haptic interface robot. In Proceedings of EuroHaptics, Vol. 459. 462.

[3]

Tomohiro Amemiya, Hideyuki Ando, and Taro Maeda. 2008. Leadme interface for a pulling sensation from hand-held devices. ACM Transactions on Applied Perception (TAP) 5, 3 (2008), 15.

Digital Library

[4]

Hrvoje Benko, Christian Holz, Mike Sinclair, and Eyal Ofek. 2016. Normaltouch and texturetouch: High-fidelity 3d haptic shape rendering on handheld virtual reality controllers. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM, 717--728.

Digital Library

[5]

Mourad Bouzit, Grigore Burdea, George Popescu, and Rares Boian. 2002. The Rutgers Master II-new design force-feedback glove. IEEE/ASME Transactions on mechatronics 7, 2 (2002), 256--263.

[6]

Tom Carter, Sue Ann Seah, Benjamin Long, Bruce Drinkwater, and Sriram Subramanian. 2013. UltraHaptics: multi-point mid-air haptic feedback for touch surfaces. In Proceedings of the 26th annual ACM symposium on User interface software and technology. ACM, 505--514.

Digital Library

[7]

Li-Te Cheng, Rick Kazman, and John Robinson. 1997. Vibrotactile feedback in delicate virtual reality operations. In Proceedings of the fourth ACM international conference on multimedia. ACM, 243--251.

Digital Library

[8]

Inrak Choi, Heather Culbertson, Mark R Miller, Alex Olwal, and Sean Follmer. 2017. Grabity: A Wearable Haptic Interface for Simulating Weight and Grasping in Virtual Reality. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. ACM, 119--130.

Digital Library

[9]

Inrak Choi, Elliot W Hawkes, David L Christensen, Christopher J Ploch, and Sean Follmer. 2016. Wolverine: A wearable haptic interface for grasping in virtual reality. In Intelligent Robots and Systems (IROS), 2016 IEEE/RSJ International Conference on. IEEE, 986--993.

Digital Library

[10]

Inrak Choi, Eyal Ofek, Hrvoje Benko, Mike Sinclair, and Christian Holz. 2018. CLAW: A Multifunctional Handheld Haptic Controller for Grasping, Touching, and Triggering in Virtual Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 654.

Digital Library

[11]

Jasper Flick. 2018. Mesh Deformation, a Unity C# Tutorial. Retrieved Dec 21, 2018 from https://catlikecoding.com/unity/tutorials/ mesh-deformation/

[12]

Venkatraghavan Gourishankar, Govindarajan Srimathveeravalli, and Thenkurussi Kesavadas. 2007. Hapstick: a high fidelity haptic simulation for billiards. In EuroHaptics Conference, 2007 and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics 2007. Second Joint. IEEE, 494--500.

Digital Library

[13]

Xiaochi Gu, Yifei Zhang, Weize Sun, Yuanzhe Bian, Dao Zhou, and Per Ola Kristensson. 2016. Dexmo: An inexpensive and lightweight mechanical exoskeleton for motion capture and force feedback in VR. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 1991--1995.

Digital Library

[14]

Taku Hachisu, Michi Sato, Shogo Fukushima, and Hiroyuki Kajimoto. 2011. HaCHIStick: simulating haptic sensation on tablet pc for musical instruments application. In Proceedings of the 24th annual ACM symposium adjunct on User interface software and technology. ACM, 73--74.

Digital Library

[15]

Koichi Hirota and Michitaka Hirose. 1998. Implementation of partial surface display. Presence 7, 6 (1998), 638--649.

Digital Library

[16]

Yuki Imamura, Hironori Arakawa, Sho Kamuro, Kouta Minamizawa, and Susumu Tachi. 2011. HAPMAP: Haptic walking navigation system with support by the sense of handrail. In ACM SIGGRAPH 2011 Emerging Technologies. ACM, 6.

Digital Library

[17]

Ginga Kato, Yoshihiro Kuroda, Ilana Nisky, Kiyoshi Kiyokawa, and Haruo Takemura. 2015. HapSticks: A novel method to present vertical forces in tool-mediated interactions by a non-grounded rotation mechanism. In World Haptics Conference (WHC), 2015 IEEE. IEEE, 400--407.

[18]

Yoshio Kohno, Somsak Walairacht, Shoichi Hasegawa, Yasuharu Koike, and Makoto Sato. 2001. Evaluation of two-handed multi-finger haptic device SPIDAR-8. ICAT2001 12 (2001), 2001.

[19]

G Michael Lemole Jr, P Pat Banerjee, Cristian Luciano, Sergey Neckrysh, and Fady T Charbel. 2007. Virtual reality in neurosurgical education: part-task ventriculostomy simulation with dynamic visual and haptic feedback. Neurosurgery 61, 1 (2007), 142--149.

[20]

Benjamin C Mac Murray, Bryan N Peele, Patricia Xu, Josef Spjut, Omer Shapira, David Luebke, and Robert F Shepherd. 2018. A variable shape and variable stiffness controller for haptic virtual interactions. In 2018 IEEE International Conference on Soft Robotics (RoboSoft). IEEE, 264-- 269.

[21]

Thomas H Massie, J Kenneth Salisbury, et al. 1994. The phantom haptic interface: A device for probing virtual objects. In Proceedings of the ASME winter annual meeting, symposium on haptic interfaces for virtual environment and teleoperator systems, Vol. 55. Citeseer, 295--300.

[22]

Shuhei Nakagawara, Hiroyuki Kajimoto, Naoki Kawakami, Susumu Tachi, and Ichiro Kawabuchi. 2005. An encounter-type multi-fingered master hand using circuitous joints. In Robotics and Automation, 2005. ICRA 2005. Proceedings of the 2005 IEEE International Conference on. IEEE, 2667--2672.

[23]

William Provancher. 2014. Creating greater VR immersion by emulating force feedback with ungrounded tactile feedback. IQT Quarterly 6, 2 (2014), 18--21.

[24]

Samuel B Schorr and Allison M Okamura. 2017. Fingertip tactile devices for virtual object manipulation and exploration. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 3115--3119.

Digital Library

[25]

Chi Wang Chi-huang Chiang Da-Yuan Huang Liwei Chan BingYu Chen Shan-Yuan Teng, Tzu-Sheng Kuo. 2018. PuPoP: Pop-up Prop on Palm for Virtual Reality. In Proceedings of the 31th Annual Symposium on User Interface Software and Technology. ACM.

Digital Library

[26]

Alexa F Siu, Eric J Gonzalez, Shenli Yuan, Jason B Ginsberg, and Sean Follmer. 2018. shapeShift: 2D Spatial Manipulation and Self-Actuation of Tabletop Shape Displays for Tangible and Haptic Interaction. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 291.

Digital Library

[27]

CyberGlove Systems. {n. d.}. CyberGrasp. Retrieved Sep 18, 2018 from http://www.cyberglovesystems.com/cybergrasp/

[28]

Dzmitry Tsetserukou, Katsunari Sato, and Susumu Tachi. 2010. ExoInterfaces: novel exosceleton haptic interfaces for virtual reality, augmented sport and rehabilitation. In Proceedings of the 1st Augmented Human International Conference. ACM, 1.

Digital Library

[29]

Eric Whitmire, Hrvoje Benko, Christian Holz, Eyal Ofek, and Mike Sinclair. 2018. Haptic Revolver: Touch, Shear, Texture, and Shape Rendering on a Reconfigurable Virtual Reality Controller. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 86.

Digital Library

[30]

Kyle N Winfree, Jamie Gewirtz, Thomas Mather, Jonathan Fiene, and Katherine J Kuchenbecker. 2009. A high fidelity ungrounded torque feedback device: The iTorqU 2.0. In EuroHaptics conference, 2009 and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics 2009. Third Joint. IEEE, 261--266.

Digital Library

[31]

Kotaro Yamaguchi, Ginga Kato, Yoshihiro Kuroda, Kiyoshi Kiyokawa, and Haruo Takemura. 2016. A Non-grounded and Encountered-type Haptic Display Using a Drone. In Proceedings of the 2016 Symposium on Spatial User Interaction. ACM, 43--46.

Digital Library

[32]

Vibol Yem, Ryuta Okazaki, and Hiroyuki Kajimoto. 2016. FinGAR: combination of electrical and mechanical stimulation for high-fidelity tactile presentation. In ACM SIGGRAPH 2016 Emerging Technologies. ACM, 7.

Digital Library

[33]

Andre Zenner and Antonio Krüger. 2017. Shifty: A Weight-Shifting Dynamic Passive Haptic Proxy to Enhance Object Perception in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics 23, 4 (2017), 1285--1294.

Digital Library

[34]

Craig B Zilles and J Kenneth Salisbury. 1995. A constraint-based godobject method for haptic display. In Intelligent Robots and Systems 95.'Human Robot Interaction and Cooperative Robots', Proceedings. 1995 IEEE/RSJ International Conference on, Vol. 3. IEEE, 146--151.

Digital Library

Cited By

Berna Moya Jvan Oosterhout AMarshall MMartinez Plasencia D(2024)HapticWhirl, a Flywheel-Gimbal Handheld Haptic Controller for Exploring Multimodal Haptic FeedbackSensors10.3390/s2403093524:3(935)Online publication date: 31-Jan-2024
https://doi.org/10.3390/s24030935
Olaya-Figueroa JChaffangeon Caillet AWillms JKurzweg MDarwiche NDann DStreicher FWolf K(2024)MorphGrip: Haptic Guidance Using a Shape-Changing GripProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701573(196-209)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1145/3701571.3701573
Kang SKim GHwang SPark JElsharkawy AKim S(2024)Flip-Pelt: Motor-Driven Peltier Elements for Rapid Thermal Stimulation and Congruent Pressure Feedback in Virtual RealityProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676363(1-15)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676363
Show More Cited By

Index Terms

PaCaPa: A Handheld VR Device for Rendering Size, Shape, and Stiffness of Virtual Objects in Tool-based Interactions
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Haptic devices

Recommendations

Haptic Revolver: Touch, Shear, Texture, and Shape Rendering on a Reconfigurable Virtual Reality Controller
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

We present Haptic Revolver, a handheld virtual reality controller that renders fingertip haptics when interacting with virtual surfaces. Haptic Revolver's core haptic element is an actuated wheel that raises and lowers underneath the finger to render ...
Grabity: A Wearable Haptic Interface for Simulating Weight and Grasping in Virtual Reality
UIST '17: Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology

Ungrounded haptic devices for virtual reality (VR) applications lack the ability to convincingly render the sensations of a grasped virtual object's rigidity and weight. We present Grabity, a wearable haptic device designed to simulate kinesthetic pad ...
Handheld Haptic Interface for Rendering Size, Shape, and Stiffness of Virtual Objects
ISS '18: Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces

PaCaPa is a handheld device that presents haptic stimuli on a user's palm when the user interacts with virtual objects using virtual tools. It is a box-shaped device and has two wings. This device can present the contact force and contact angle by ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

May 2019

9077 pages

ISBN:9781450359702

DOI:10.1145/3290605

General Chairs:
Stephen Brewster
University of Glasgow, Scotland, UK
,
Geraldine Fitzpatrick
TU Wien, Austria
,
Program Chairs:
Anna Cox
University College London, UK
,
Vassilis Kostakos
University of Melbourne, Australia

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '19

Sponsor:

SIGCHI

CHI '19: CHI Conference on Human Factors in Computing Systems

May 4 - 9, 2019

Glasgow, Scotland Uk

Acceptance Rates

CHI '19 Paper Acceptance Rate 703 of 2,958 submissions, 24%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

45
Total Citations
View Citations
1,377
Total Downloads

Downloads (Last 12 months)176
Downloads (Last 6 weeks)22

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Berna Moya Jvan Oosterhout AMarshall MMartinez Plasencia D(2024)HapticWhirl, a Flywheel-Gimbal Handheld Haptic Controller for Exploring Multimodal Haptic FeedbackSensors10.3390/s2403093524:3(935)Online publication date: 31-Jan-2024
https://doi.org/10.3390/s24030935
Olaya-Figueroa JChaffangeon Caillet AWillms JKurzweg MDarwiche NDann DStreicher FWolf K(2024)MorphGrip: Haptic Guidance Using a Shape-Changing GripProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701573(196-209)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1145/3701571.3701573
Kang SKim GHwang SPark JElsharkawy AKim S(2024)Flip-Pelt: Motor-Driven Peltier Elements for Rapid Thermal Stimulation and Congruent Pressure Feedback in Virtual RealityProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676363(1-15)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676363
Park CChoi S(2024)Augmenting Perceived Length of Handheld Controllers: Effects of Object Handle PropertiesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642251(1-11)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642251
Kim TShim YKim YKim SLee JLee G(2024)QuadStretcher: A Forearm-Worn Skin Stretch Display for Bare-Hand Interaction in AR/VRProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642067(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642067
Su JZuo KChua Z(2024)Three Degree-of-Freedom Soft Continuum Kinesthetic Haptic Display for Telemanipulation Via Sensory Substitution at the Finger2024 IEEE Conference on Telepresence10.1109/Telepresence63209.2024.10841502(79-86)Online publication date: 16-Nov-2024
https://doi.org/10.1109/Telepresence63209.2024.10841502
Guo YWang YTong QShan BHe LZhang YWang D(2024)Active electronic skin: an interface towards ambient haptic feedback on physical surfacesnpj Flexible Electronics10.1038/s41528-024-00311-58:1Online publication date: 2-May-2024
https://doi.org/10.1038/s41528-024-00311-5
Jingu AWithana ASteimle J(2023)Double-Sided Tactile Interactions for Grasping in Virtual RealityProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606798(1-11)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606798
Sagheb SLiu FVuong ADai SWirjadi RBao YLikamwa R(2023)Geppetteau: Enabling haptic perceptions of virtual fluids in various vessel profiles using a string-driven haptic interfaceProceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3569009.3572745(1-14)Online publication date: 26-Feb-2023
https://dl.acm.org/doi/10.1145/3569009.3572745
Chen HChiu SWen CTsai H(2023)transPAF: Rendering Omnidirectional Impact Feedback with Dynamic Point of Application of Force All Round a ControllerProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581092(1-13)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581092
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten