More Web Proxy on the site http://driver.im/

research-article

Substituting Motion Effects with Vibrotactile Effects for 4D Experiences

Authors:

Seungmoon ChoiAuthors Info & Claims

CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

Paper No.: 428, Pages 1 - 6

https://doi.org/10.1145/3173574.3174002

Published: 21 April 2018 Publication History

Abstract

In this paper, we present two methods to substitute motion effects using vibrotactile effects in order to improve the 4D experiences of viewers. This work was motivated by the needs of more affordable 4D systems for individual users. Our sensory substitution algorithms convert motion commands to vibrotactile commands to a grid display that uses multiple actuators. While one method is based on the fundamental principle of vestibular feedback, the other method makes use of intuitive visually-based mapping from motion to vibrotactile stimulation. We carried out a user study and could confirm the effectiveness of our substitution methods in improving 4D experiences. To our knowledge, this is the first study that investigated the feasibility of replacing motion effects using much simpler and less expensive vibrotactile effects.

Supplementary Material

suppl.mov (pn3585-file3.wmv)

Supplemental video

Download
10.28 MB

suppl.mov (pn3585-file5.mp4)

Supplemental video

Download
7.33 MB

References

[1]

Leandro Cancar, Alex Díaz, Antonio Barrientos, David Travieso, and David M Jacobs. 2013. Tactile-sight: A sensory substitution device based on distance-related vibrotactile flow. International Journal of Advanced Robotic Systems 10, 6 (2013), 272.

[2]

Fabien Danieau, Julien Fleureau, Philippe Guillotel, Nicolas Mollet, Marc Christie, and Anatole Lecuyer. 2012. HapSeat: Producing Motion Sensation with Multiple Force-feedback Devices Embedded in a Seat. In Proceedings of ACM Symposium on Virtual Reality Software and Technology (VRST). 69--76.

Digital Library

[3]

Thiago Silva Filgueiras, Ana Carolina Oliveira Lima, Renan Lima Baima, Gabriel Tadayoshi Rodrigues Oka, Luiz Alberto Queiroz Cordovil, and Moisés Pereira Bastos. 2016. Vibrotactile sensory substitution on personal navigation: Remotely controlled vibrotactile feedback wearable system to aid visually impaired. In Proceedings of the IEEE International Symposium on Medical Measurements and Applications (MeMeA). IEEE, 1--5.

Digital Library

[4]

Fred E. Guedry. 1974. Vestibular System Part 2: Psychophysics, Applied Aspects and General Interpretations. Springer, Chapter Psychophysics of Vestibular Sensation, 3--154.

[5]

Ali Israr and Ivan Poupyrev. 2011. Tactile brush: drawing on skin with a tactile grid display. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI). 2019--2028.

Digital Library

[6]

Ali Israr, Zachary Schwemler, John Mars, and Brian Krainer. 2016. VR360HD: A VR360° player with enhanced haptic feedback. In Proceedings of the ACM Conference on Virtual Reality Software and Technology. 183--186.

Digital Library

[7]

Ali Israr, Siyan Zhao, Kaitlyn Schwalje, Roberta Klatzky, and Jill Lehman. 2014. Feel Effects: Enriching Storytelling with Haptic Feedback. ACM Transactions on Applied Perception 11, 3 (2014), 11:1--11:17.

Digital Library

[8]

Myongchan Kim, Sungkil Lee, and Seungmoon Choi. 2014. Saliency-driven real-time video-to-tactile translation. IEEE Transactions on Haptics 7, 3 (2014), 394--404.

[9]

Yeongmi Kim, Jongeun Cha, Jeha Ryu, and Ian Oakley. 2010. A tactile glove design and authoring system for immersive multimedia. IEEE MultiMedia 17, 3 (2010), 34--45.

Digital Library

[10]

Jaebong Lee, Bohyung Han, and Seungmoon Choi. 2016a. Interactive Motion Effects Design for a Moving Object in 4D Films. In Proceedings of the ACM Conference on Virtual Reality Software and Technology (VRST). 219--228.

Digital Library

[11]

Jaebong Lee, Bohyung Han, and Seungmoon Choi. 2016b. Motion Effects Synthesis for 4D Films. IEEE Transactions on Visualization and Computer Graphics 22, 10 (2016), 2300--2314.

Digital Library

[12]

Paul Lemmens, Floris Crompvoets, Dirk Brokken, Jack Van Den Eerenbeemd, and Gert-Jan de Vries. 2009. A body-conforming tactile jacket to enrich movie viewing. In Proceedings of the World Haptics Conference. IEEE, 7--12.

Digital Library

[13]

Meyer A. Nahon and Lloyd D. Reid. 1990. Simulator Motion-Drive Algorithms: A Designer's Perspective. Journal of Guidance, Control, and Dynamics 13, 2 (1990), 356--362.

[14]

A. H. Rupert. 2000. Tactile situation awareness system: Proprioceptive prostheses for sensory deficiencies. Aviation Space & Environmental Medicine 71, 9, Suppl. (2000), A92--A99.

[15]

Oliver S Schneider, Ali Israr, and Karon E MacLean. 2015. Tactile animation by direct manipulation of grid displays. In Proceedings of the Annual ACM Symposium on User Interface Software and Technology (VRST). 21--30.

Digital Library

[16]

Suchul Shin, Byounghyun Yoo, and Soonhung Han. 2013. A Framework for Automatic Creation of Motion Effects from Theatrical Motion Pictures. Multimedia Systems 20 (2013), 327--346.

Digital Library

Cited By

Lee JKim JKang JJo EPark DChoi S(2024)Telemetry-Based Haptic Rendering for Racing Game Experience ImprovementIEEE Transactions on Haptics10.1109/TOH.2024.335788517:1(72-79)Online publication date: Jan-2024
https://doi.org/10.1109/TOH.2024.3357885
Jung KKim SOh SYoon S(2024)HapMotion: motion-to-tactile framework with wearable haptic devices for immersive VR performance experienceVirtual Reality10.1007/s10055-023-00910-z28:1Online publication date: 9-Jan-2024
https://dl.acm.org/doi/10.1007/s10055-023-00910-z
Yu NMa SLin CFan CTaglialatela LHuang TYu CCheng YLiao YChen M(2023)DrivingVibe: Enhancing VR Driving Experience using Inertia-based Vibrotactile Feedback around the HeadProceedings of the ACM on Human-Computer Interaction10.1145/36042537:MHCI(1-22)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604253
Show More Cited By

Index Terms

Substituting Motion Effects with Vibrotactile Effects for 4D Experiences
1. Human-centered computing
  1. Human computer interaction (HCI)
2. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

Generating Haptic Motion Effects for Multiple Articulated Bodies for Improved 4D Experiences: A Camera Space Approach
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

Motion effects are indispensable for improving 4D experiences in highly interactive applications, such as amusement parks, 4D theaters, and virtual reality games. Their recent emergence calls for effective algorithms generating motion effects ...
4D Experiences Enabled by Automatic Synthesis of Motion and Vibrotactile Effects
CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems

4D experiences are one of the most immersive kinds of experiences that current virtual reality technologies can offered. However, the production of 4D contents is still very labor-intensive, and it has been a major obstacle against the wider spread of ...
Image-Based Texture Styling for Motion Effect Rendering
VRST '21: Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology

A motion platform provides the vestibular stimuli that elicit the sensations of self-motion and thereby improves the immersiveness. A representative example is a 4D Ride, which presents a video of POV shots and motion effects synchronized with the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

April 2018

8489 pages

ISBN:9781450356206

DOI:10.1145/3173574

General Chairs:
Regan Mandryk
University of Saskatchewan, Canada
,
Mark Hancock
University of Waterloo, Canada
,
Program Chairs:
Mark Perry
Brunel University London, UK
,
Anna Cox
University College London, UK

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 April 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

basic science research program from NRF
convergence research program from NRF
HD haptic technology for hyper reality contents from IITP

Conference

CHI '18

Sponsor:

SIGCHI

CHI '18: CHI Conference on Human Factors in Computing Systems

April 21 - 26, 2018

Montreal QC, Canada

Acceptance Rates

CHI '18 Paper Acceptance Rate 666 of 2,590 submissions, 26%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
620
Total Downloads

Downloads (Last 12 months)46
Downloads (Last 6 weeks)2

Reflects downloads up to 16 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Lee JKim JKang JJo EPark DChoi S(2024)Telemetry-Based Haptic Rendering for Racing Game Experience ImprovementIEEE Transactions on Haptics10.1109/TOH.2024.335788517:1(72-79)Online publication date: Jan-2024
https://doi.org/10.1109/TOH.2024.3357885
Jung KKim SOh SYoon S(2024)HapMotion: motion-to-tactile framework with wearable haptic devices for immersive VR performance experienceVirtual Reality10.1007/s10055-023-00910-z28:1Online publication date: 9-Jan-2024
https://dl.acm.org/doi/10.1007/s10055-023-00910-z
Yu NMa SLin CFan CTaglialatela LHuang TYu CCheng YLiao YChen M(2023)DrivingVibe: Enhancing VR Driving Experience using Inertia-based Vibrotactile Feedback around the HeadProceedings of the ACM on Human-Computer Interaction10.1145/36042537:MHCI(1-22)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604253
Kwon DAbou Chahine RLim CSeifi HPark G(2023)Can we crowdsource Tacton similarity perception and metaphor ratings?Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581120(1-13)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581120
Yun GMun MLee JKim DTan HChoi S(2023)Generating Real-Time, Selective, and Multimodal Haptic Effects from Sound for Gaming Experience EnhancementProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580787(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580787
Han SPark JChoi S(2023)Generating Haptic Motion Effects for Multiple Articulated Bodies for Improved 4D Experiences: A Camera Space ApproachProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580727(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580727
Park JHan SChoi S(2023)Merging Camera and Object Haptic Motion Effects for Improved 4D Experiences2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00120(1036-1044)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00120
López ÁCerdán VRevuelta PPena JOrtiz TVergaz R(2023)Vibrotactile Stimulation for Emotional Elicitation During Audiovisual EventsIEEE Access10.1109/ACCESS.2023.332235711(111302-111314)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3322357
Tsai HLiao YTsai C(2022)ImpactVest: Rendering Spatio-Temporal Multilevel Impact Force Feedback on Body in VRProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501971(1-11)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501971
Lee HOh SChoi S(2022)Data-Driven Rendering of Motion Effects for Walking Sensations in Different GaitsIEEE Transactions on Haptics10.1109/TOH.2022.317696415:3(547-559)Online publication date: 1-Jul-2022
https://doi.org/10.1109/TOH.2022.3176964
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents