[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3379337.3415812acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
research-article

HapLinkage: Prototyping Haptic Proxies for Virtual Hand Tools Using Linkage Mechanism

Published: 20 October 2020 Publication History

Abstract

Haptic simulation of hand tools like wrenches, pliers, scissors and syringes are beneficial for finely detailed skill training in VR, but designing for numerous hand tools usually requires an expert-level knowledge of specific mechanism and protocol. This paper presents HapLinkage, a prototyping framework based on linkage mechanism, that provides typical motion templates and haptic renderers to facilitate proxy design of virtual hand tools. The mechanical structures can be easily modified, for example, to scale the size, or to change the range of motion by selectively changing linkage lengths. Resistant, stop, release, and restoration force feedback are generated by an actuating module as part of the structure. Additional vibration feedback can be generated with a linear actuator. HapLinkage enables easy and quick prototypting of hand tools for diverse VR scenarios, that embody both of their kinetic and haptic properties. Based on interviews with expert designers, it was confirmed that HapLinkage is expressive in designing haptic proxy of hand tools to enhance VR experiences. It also identified potentials and future development of the framework.

Supplementary Material

VTT File (ufp1003vf.vtt)
VTT File (3379337.3415812.vtt)
SRT File (ufp1003vfc.srt)
Video figure captions
MP4 File (ufp1003pv.mp4)
Preview video
MP4 File (ufp1003vf.mp4)
Video figure
MP4 File (3379337.3415812.mp4)
Presentation Video

References

[1]
Bruno Araujo, Ricardo Jota, Varun Perumal, Jia Xian Yao, Karan Singh, and Daniel Wigdor. 2016. Snake Charmer: Physically Enabling Virtual Objects. In Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '16). ACM, New York, NY, USA, 218--226. http://dx.doi.org/10.1145/2839462.2839484
[2]
Ryan Arisandi, Yusuke Takami, Mai Otsuki, Asako Kimura, Fumihisa Shibata, and Hideyuki Tamura. 2012. Enjoying Virtual Handcrafting with ToolDevice. In Adjunct Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST Adjunct Proceedings '12). Association for Computing Machinery, New York, NY, USA, 17--18. http://dx.doi.org/10.1145/2380296.2380306
[3]
Jatin Arora, Aryan Saini, Nirmita Mehra, Varnit Jain, Shwetank Shrey, and Aman Parnami. 2019. VirtualBricks: Exploring a Scalable, Modular Toolkit for Enabling Physical Manipulation in VR. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, Article 56, 12 pages. http://dx.doi.org/10.1145/3290605.3300286
[4]
Artas. 2015. SAM, Mechanism Design Software. (2015). Retrieved September 13, 2019 from https://www.artas.nl/en.
[5]
Mahdi Azmandian, Mark Hancock, Hrvoje Benko, Eyal Ofek, and Andrew D. Wilson. 2016. Haptic Retargeting: Dynamic Repurposing of Passive Haptics for Enhanced Virtual Reality Experiences. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 1968--1979. http://dx.doi.org/10.1145/2858036.2858226
[6]
Moritz B"acher, Stelian Coros, and Bernhard Thomaszewski. 2015. LinkEdit: Interactive Linkage Editing Using Symbolic Kinematics. ACM Trans. Graph. 34, 4, Article 99 (July 2015), 8 pages. http://dx.doi.org/10.1145/2766985
[7]
Lung-Pan Cheng, Li Chang, Sebastian Marwecki, and Patrick Baudisch. 2018. iTurk: Turning Passive Haptics into Active Haptics by Making Users Reconfigure Props in Virtual Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 89, 10 pages. http://dx.doi.org/10.1145/3173574.3173663
[8]
Lung-Pan Cheng, Sebastian Marwecki, and Patrick Baudisch. 2017a. Mutual Human Actuation. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 797--805. http://dx.doi.org/10.1145/3126594.3126667
[9]
Lung-Pan Cheng, Eyal Ofek, Christian Holz, Hrvoje Benko, and Andrew D. Wilson. 2017b. Sparse Haptic Proxy: Touch Feedback in Virtual Environments Using a General Passive Prop. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 3718--3728. http://dx.doi.org/10.1145/3025453.3025753
[10]
Inrak Choi, Heather Culbertson, Mark R. Miller, Alex Olwal, and Sean Follmer. 2017. Grabity: A Wearable Haptic Interface for Simulating Weight and Grasping in Virtual Reality. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 119--130. http://dx.doi.org/10.1145/3126594.3126599
[11]
Inrak Choi and Sean Follmer. 2016. Wolverine: A Wearable Haptic Interface for Grasping in VR. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16 Adjunct). ACM, New York, NY, USA, 117--119. http://dx.doi.org/10.1145/2984751.2985725
[12]
Stelian Coros, Bernhard Thomaszewski, Gioacchino Noris, Shinjiro Sueda, Moira Forberg, Robert W. Sumner, Wojciech Matusik, and Bernd Bickel. 2013. Computational Design of Mechanical Characters. ACM Trans. Graph. 32, 4, Article 83 (July 2013), 12 pages. http://dx.doi.org/10.1145/2461912.2461953
[13]
Gábor Erdös. 2005. LinkageDesigner, The Mechanism Prototyping System. (2005). Retrieved September 13, 2019 from http://www.linkagedesigner.com/.
[14]
Thomas Morris Fraser and International Labour Office. 1980. Ergonomic principles in the design of hand tools. International Labour Office Geneva, Switzerland.
[15]
Xiaochi Gu, Yifei Zhang, Weize Sun, Yuanzhe Bian, Dao Zhou, and Per Ola Kristensson. 2016. Dexmo: An Inexpensive and Lightweight Mechanical Exoskeleton for Motion Capture and Force Feedback in VR. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 1991--1995. http://dx.doi.org/10.1145/2858036.2858487
[16]
Zhenyi He, Fengyuan Zhu, and Ken Perlin. 2017. PhyShare: Sharing Physical Interaction in Virtual Reality. In Adjunct Publication of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 17--19. http://dx.doi.org/10.1145/3131785.3131795
[17]
Seongkook Heo, Christina Chung, Geehyuk Lee, and Daniel Wigdor. 2018. Thor's Hammer: An Ungrounded Force Feedback Device Utilizing Propeller-Induced Propulsive Force. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). Association for Computing Machinery, New York, NY, USA, 1--11. http://dx.doi.org/10.1145/3173574.3174099
[18]
Yunwoo Jeong, Han-Jong Kim, and Tek-Jin Nam. 2018. Mechanism Perfboard: An Augmented Reality Environment for Linkage Mechanism Design and Fabrication. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 411, 11 pages. http://dx.doi.org/10.1145/3173574.3173985
[19]
Toshiro Kashiwagi, Kaoru Sumi, Sidney Fels, Qian Zhou, and Fan Wu. 2019. Crystal Palace: Merging Virtual Objects and Physical Hand-held Tools. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 1411--1412.
[20]
Han-Jong Kim, Yunwoo Jeong, Ju-Whan Kim, and Tek-Jin Nam. 2018. A prototyping tool for kinetic mechanism design and fabrication: Developing and deploying M.Sketch for science, technology, engineering, the arts, and mathematics education. Advances in Mechanical Engineering 10, 12 (2018), 1687814018804104. http://dx.doi.org/10.1177/1687814018804104
[21]
Robert Kovacs, Alexandra Ion, Pedro Lopes, Tim Oesterreich, Johannes Filter, Philipp Otto, Tobias Arndt, Nico Ring, Melvin Witte, Anton Synytsia, and Patrick Baudisch. 2018. TrussFormer: 3D Printing Large Kinetic Structures. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST '18). ACM, New York, NY, USA, 113--125. http://dx.doi.org/10.1145/3242587.3242607
[22]
Jo-Yu Lo, Da-Yuan Huang, Chen-Kuo Sun, Chu-En Hou, and Bing-Yu Chen. 2018. RollingStone: Using Single Slip Taxel for Enhancing Active Finger Exploration with a Virtual Reality Controller. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST '18). ACM, New York, NY, USA, 839--851. http://dx.doi.org/10.1145/3242587.3242627
[23]
Karon E MacLean. 2008. Haptic interaction design for everyday interfaces. Reviews of Human Factors and Ergonomics 4, 1 (2008), 149--194.
[24]
Thomas H Massie, J Kenneth Salisbury, and others. 1994. The phantom haptic interface: A device for probing virtual objects. In Proceedings of the ASME winter annual meeting, symposium on haptic interfaces for virtual environment and teleoperator systems, Vol. 55. Citeseer, 295--300.
[25]
W. A. McNeely. 1993. Robotic graphics: a new approach to force feedback for virtual reality. In Proceedings of IEEE Virtual Reality Annual International Symposium. 336--341. http://dx.doi.org/10.1109/VRAIS.1993.380761
[26]
Vittorio Megaro, Bernhard Thomaszewski, Damien Gauge, Eitan Grinspun, Stelian Coros, and Markus Gross. 2014. ChaCra: An Interactive Design System for Rapid Character Crafting. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA '14). Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, 123--130. http://dl.acm.org/citation.cfm?id=2849517.2849538
[27]
Günter Niemeyer and Probal Mitra. 2005. 3 Dynamic Proxies and Haptic Constraints. Springer Berlin Heidelberg, Berlin, Heidelberg, 41--53. http://dx.doi.org/10.1007/11429555_3
[28]
Hyunjoo Oh, Mark D. Gross, and Michael Eisenberg. 2015. FoldMecha: Design for Linkage-Based Paper Toys. In Adjunct Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST '15 Adjunct). ACM, New York, NY, USA, 91--92. http://dx.doi.org/10.1145/2815585.2815734
[29]
Allison M. Okamura. 2019. Lecture 1: Introduction to Haptics and Course Overview. (2019). Retrieved July 31, 2019 from https://web.stanford.edu/class/me327/lectures/lecture01-intro.pdf.
[30]
Claudio Pacchierotti, Stephen Sinclair, Massimiliano Solazzi, Antonio Frisoli, Vincent Hayward, and Domenico Prattichizzo. 2017. Wearable haptic systems for the fingertip and the hand: taxonomy, review, and perspectives. IEEE transactions on haptics 10, 4 (2017), 580--600.
[31]
EJF Primrose, F Freudenstein, and B Roth. 1967. Six-bar motion I. The Watt mechanism. Archive for Rational Mechanics and Analysis 24, 1 (1967), 22--41.
[32]
David Rector. 2010. Linkage, Mechanism Designer and Simulator. (2010). Retrieved September 13, 2019 from http://blog.rectorsquid.com/linkage-mechanism-designer-and-simulator.
[33]
Lena Sperling, Sven Dahlman, Li Wikström, Åsa Kilbom, and Roland Kadefors. 1993. A cube model for the classification of work with hand tools and the formulation of functional requirements. Applied Ergonomics 24, 3 (1993), 212 -- 220. http://dx.doi.org/https://doi.org/10.1016/0003--6870(93)90009-X Special Issue Hand Tools for the 1990s.
[34]
Patrick L. Strandholt, Oana A. Dogaru, Niels C. Nilsson, Rolf Nordahl, and Stefania Serafin. 2020. Knock on Wood: Combining Redirected Touching and Physical Props for Tool-Based Interaction in Virtual Reality. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--13. http://dx.doi.org/10.1145/3313831.3376303
[35]
Evan Strasnick, Christian Holz, Eyal Ofek, Mike Sinclair, and Hrvoje Benko. 2018. Haptic Links: Bimanual Haptics for Virtual Reality Using Variable Stiffness Actuation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 644, 12 pages. http://dx.doi.org/10.1145/3173574.3174218
[36]
Yuqian Sun, Shigeo Yoshida, Takuji Narumi, and Michitaka Hirose. 2019. PaCaPa: A Handheld VR Device for Rendering Size, Shape, and Stiffness of Virtual Objects in Tool-based Interactions. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, Article 452, 12 pages. http://dx.doi.org/10.1145/3290605.3300682
[37]
Shan-Yuan Teng, Tzu-Sheng Kuo, Chi Wang, Chi-huan Chiang, Da-Yuan Huang, Liwei Chan, and Bing-Yu Chen. 2018. PuPoP: Pop-up Prop on Palm for Virtual Reality. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST '18). ACM, New York, NY, USA, 5--17. http://dx.doi.org/10.1145/3242587.3242628
[38]
Eric Whitmire, Hrvoje Benko, Christian Holz, Eyal Ofek, and Mike Sinclair. 2018. Haptic Revolver: Touch, Shear, Texture, and Shape Rendering on a Reconfigurable Virtual Reality Controller. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 86, 12 pages. http://dx.doi.org/10.1145/3173574.3173660
[39]
Wikipedia. 2016. Category:Hand Tools. (2016). Retrieved from https://en.wikipedia.org/wiki/Category:Hand_tools.
[40]
Kotaro Yamaguchi, Ginga Kato, Yoshihiro Kuroda, Kiyoshi Kiyokawa, and Haruo Takemura. 2016. A Non-grounded and Encountered-type Haptic Display Using a Drone. In Proceedings of the 2016 Symposium on Spatial User Interaction (SUI '16). ACM, New York, NY, USA, 43--46. http://dx.doi.org/10.1145/2983310.2985746
[41]
Jackie (Junrui) Yang, Hiroshi Horii, Alexander Thayer, and Rafael Ballagas. 2018. VR Grabbers: Ungrounded Haptic Retargeting for Precision Grabbing Tools. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST '18). Association for Computing Machinery, New York, NY, USA, 889--899. http://dx.doi.org/10.1145/3242587.3242643
[42]
Andre Zenner and Antonio Krüger. 2017. Shifty: A Weight-Shifting Dynamic Passive Haptic Proxy to Enhance Object Perception in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics 23, 4 (April 2017), 1285--1294. http://dx.doi.org/10.1109/TVCG.2017.2656978
[43]
André Zenner and Antonio Krüger. 2019. Drag:on: A Virtual Reality Controller Providing Haptic Feedback Based on Drag and Weight Shift. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, Article 211, 12 pages. http://dx.doi.org/10.1145/3290605.3300441
[44]
A. Zoran, R. Shilkrot, P. Goyal, P. Maes, and J. A. Paradiso. 2014. The Wise Chisel: The Rise of the Smart Handheld Tool. IEEE Pervasive Computing 13, 3 (2014), 48--57.

Cited By

View all
  • (2024)Hapstick-Figure: Investigating the Design of a Haptic Representation of Human Gestures from Theater Performances for Blind and Visually-Impaired PeopleProceedings of the ACM on Human-Computer Interaction10.1145/36981528:ISS(649-673)Online publication date: 24-Oct-2024
  • (2024)JetUnit: Rendering Diverse Force Feedback in Virtual Reality Using Water JetsProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676440(1-15)Online publication date: 13-Oct-2024
  • (2024)SnapInflatables: Designing Inflatables with Snap-through Instability for Responsive InteractionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642933(1-15)Online publication date: 11-May-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
UIST '20: Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology
October 2020
1297 pages
ISBN:9781450375146
DOI:10.1145/3379337
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 October 2020

Permissions

Request permissions for this article.

Check for updates

Badges

  • Honorable Mention

Author Tags

  1. haptic proxies
  2. linkage mechanism
  3. prototyping haptic interface
  4. virtual hand tool
  5. virtual reality

Qualifiers

  • Research-article

Funding Sources

  • National Key R&D Program of China
  • National Natural Science Foundation of China
  • Global Initiative Interdisciplinary Research Program through the KAIST College of Engineering

Conference

UIST '20

Acceptance Rates

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25
The 38th Annual ACM Symposium on User Interface Software and Technology
September 28 - October 1, 2025
Busan , Republic of Korea

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)199
  • Downloads (Last 6 weeks)15
Reflects downloads up to 10 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Hapstick-Figure: Investigating the Design of a Haptic Representation of Human Gestures from Theater Performances for Blind and Visually-Impaired PeopleProceedings of the ACM on Human-Computer Interaction10.1145/36981528:ISS(649-673)Online publication date: 24-Oct-2024
  • (2024)JetUnit: Rendering Diverse Force Feedback in Virtual Reality Using Water JetsProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676440(1-15)Online publication date: 13-Oct-2024
  • (2024)SnapInflatables: Designing Inflatables with Snap-through Instability for Responsive InteractionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642933(1-15)Online publication date: 11-May-2024
  • (2024)MobiTangibles: Enabling Physical Manipulation Experiences of Virtual Precision Hand-Held Tools' Miniature Control in VRIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345619130:11(7321-7331)Online publication date: 1-Nov-2024
  • (2024)Investigating Whether the Mass of a Tool Replica Influences Virtual Training Learning OutcomesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337204130:5(2411-2421)Online publication date: 4-Mar-2024
  • (2024)A Hybrid Haptic Device for Virtual Car Door Interactions: Design and ImplementationIEEE Robotics and Automation Letters10.1109/LRA.2024.34058139:10(8850-8857)Online publication date: Oct-2024
  • (2023)HapticCollider: Ungrounded Force Feedback for Rigid Collisions during Virtual Tool UseProceedings of Mensch und Computer 202310.1145/3603555.3603568(116-126)Online publication date: 3-Sep-2023
  • (2023)Turn-It-Up: Rendering Resistance for Knobs in Virtual Reality through Undetectable Pseudo-HapticsProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606787(1-10)Online publication date: 29-Oct-2023
  • (2023)VoxelHap: A Toolkit for Constructing Proxies Providing Tactile and Kinesthetic Haptic Feedback in Virtual RealityProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606722(1-13)Online publication date: 29-Oct-2023
  • (2023)Xs: Interactive Scissor Mechanisms as Portable and Customizable Shape-Changing InterfacesProceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3569009.3572737(1-10)Online publication date: 26-Feb-2023
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media