More Web Proxy on the site http://driver.im/

research-article

HaptDoll: an interactive device for tactile sensation with virtual companion doll

Authors:

R. P. C Janaka Rajapakse,

Yoshimasa TokuyamaAuthors Info & Claims

ICIGP '19: Proceedings of the 2nd International Conference on Image and Graphics Processing

Pages 125 - 131

https://doi.org/10.1145/3313950.3313974

Published: 23 February 2019 Publication History

Abstract

With the advance of display technology, the virtual reality technique has become more valuable than ever, which then promotes the development of VR/AR interactive contents. VR has the potential to provide experiences and deliver results that cannot be otherwise achieved. However, interacting with immersive applications is not always straightforward and it is not just about an interface for the user to reach their goals. It is also about users working in an intuitive attitude that is a comfortable experience and devoid of frustration. This work provides solutions to the issues of being too hard for the user to have intuitive experiences in the virtual scenario. For the intuitive experience, we developed a wireless wearable device which is set on the user's upper-body to detect the activities then import them into the virtual environment. For interactive and immersive VR contents, we developed a companion doll that provides haptic feedback in the real-world and six emotional expressions in the virtual world.

References

[1]

Robert Y. Wang and Jovan Popović. 2009. Real-time hand-tracking with a color glove. In ACM SIGGRAPH 2009 papers (SIGGRAPH '09), Hugues Hoppe (Ed.). ACM, New York, NY, USA, Article 63, 8 pages.

Digital Library

[2]

C. Assad, M. Wolf, A. Stoica, T. Theodoridis and K. Glette, "BioSleeve: A natural EMG-based interface for HRI," 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI), Tokyo, 2013, pp. 69--70.

Digital Library

[3]

Yamazaki, R., Christensen, L., Skov, K., Chang, C. C., Damholdt, M. F., Sumioka, H., ... Ishiguro, H. 2016. Intimacy in phone conversations: Anxiety reduction for danish seniors with hugvie. Frontiers in Psychology, 7(APR), {537}.

[4]

Amanda Lazar, Hilaire J. Thompson, Anne Marie Piper, and George Demiris. 2016. Rethinking the Design of Robotic Pets for Older Adults. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (DIS '16). ACM, New York, NY, USA, 1034--1046.

Digital Library

[5]

Sang Ho Yoon, Ansh Verma, Kylie Peppler, and Karthik Ramani. 2015. HandiMate: exploring a modular robotics kit for animating crafted toys. In Proceedings of the 14th International Conference on Interaction Design and Children (IDC '15). ACM, New York, NY, USA, 11--20.

Digital Library

[6]

Gregoire Milliez. 2018. Buddy: A Companion Robot for the Whole Family. In Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction (HRI '18). ACM, New York, NY, USA, 40--40.

Digital Library

[7]

Robert Y. Wang and Jovan Popović. 2009. Real-time hand-tracking with a color glove. In ACM SIGGRAPH 2009 papers (SIGGRAPH '09), Hugues Hoppe (Ed.). ACM, New York, NY, USA, Article 63, 8 pages.

Digital Library

[8]

John P. Granieri, Welton Becket, Barry D. Reich, Jonathan Crabtree, and Norman I. Badler. 1995. Behavioral control for real-time simulated human agents. In Proceedings of the 1995 symposium on Interactive 3D graphics (I3D '95). ACM, New York, NY, USA, 173--180.

Digital Library

[9]

Dushyant Mehta, Srinath Sridhar, Oleksandr Sotnychenko, Helge Rhodin, Mohammad Shafiei, Hans-Peter Seidel, Weipeng Xu, Dan Casas, and Christian Theobalt. 2017. VNect: real-time 3D human pose estimation with a single RGB camera. ACM Trans. Graph. 36, 4, Article 44 (July 2017), 14 pages.

Digital Library

[10]

Sarvenaz Salehi, Gabriele Bleser, Attila Reiss, and Didier Stricker. 2015. Body-IMU autocalibration for inertial hip and knee joint tracking. In Proceedings of the 10th EAI International Conference on Body Area Networks (BodyNets '15). ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), ICST, Brussels, Belgium, Belgium, 51--57.

Digital Library

[11]

Khrystyna Vasylevska, Iana Podkosova, and Hannes Kaufmann. 2017. Teaching virtual reality with HTC vive and leap motion. In SIGGRAPH Asia 2017 Symposium on Education (SA '17). ACM, New York, NY, USA, Article 2, 8 pages.

Digital Library

[12]

Jacques Foottit, Dave Brown, Stefan Marks, and Andy M. Connor. 2014. An Intuitive Tangible Game Controller. In Proceedings of the 2014 Conference on Interactive Entertainment (IE2014), Karen Blackmore, Keith Nesbitt, and Shamus P. Smith (Eds.). ACM, New York, NY, USA Article 4, 7 pages.

Digital Library

[13]

Mirko Gelsomini, Giulia Leonardi, Marzia Degiorgi, Franca Garzotto, Simone Penati, Jacopo Silvestri, Noëlie Ramuzat, and Francesco Clasadonte. 2017. Puffy - an Inflatable Mobile Interactive Companion for Children with Neurodevelopmental Disorders. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '17). ACM, New York, NY, USA, 2599~2606.

Digital Library

[14]

Sooyeon Jeong, Cynthia Breazeal, Deirdre Logan, and Peter Weinstock. 2018. Huggable: The Impact of Embodiment on Promoting Socio-emotional Interactions for Young Pediatric Inpatients. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Paper 495, 13 pages.

Digital Library

[15]

Kathika Roy, Durga Prasad Idiwal, Annapurna Agrawal, and Bani Hazra. 2015. Flex sensor based wearable gloves for robotic gripper control. In Proceedings of the 2015 Conference on Advances in Robotics (AIR '15). ACM, New York, NY, USA, Article 70, 5 pages.

Digital Library

[16]

Y. G. Iyer, S. Gandham and S. Venkatesan, "STCP: a generic transport layer protocol for wireless sensor networks," Proceedings. 14th International Conference on Computer Communications and Networks, 2005. ICCCN 2005., San Diego, CA, USA, 2005, pp. 449--454.

[17]

J. Lee, R. P. C. J. Rajapakse, Y. Hung and Y. Tokuyama, "The Development of a Virtual Doll Companion for Haptic Interaction," 2018 Nicograph International (NicoInt), Tainan, Taiwan, 2018, pp. 9292.

[18]

Darío R. Quiñones, Gonçalo Lopes, Danbee Kim, Cédric Honnet, David Moratal, and Adam Kampff. 2018. HIVE Tracker: a tiny, low-cost, and scalable device for sub-millimetric 3D positioning. In Proceedings of the 9th Augmented Human International Conference (AH '18). ACM, New York, NY, USA, Article 9, 8 pages.

Digital Library

[19]

Stanley S Stevens. 1957. On the psychophysical law. Psychological review 64, 3 (1957), 153.

[20]

Robert Pluchik- Plutchik's wheel of emotions. https://en.wikipedia.org/wiki/Robert_Plutchik

[21]

Abyarjoo, Fatemeh & Barreto, Armando & Cofino, Jonathan & Ortega, Francisco. (2012). Implementing a Sensor Fusion Algorithm for 3D Orientation Detection with Inertial/Magnetic Sensors.

Cited By

Tun LJanaka Rajapakse RHung YMiyata K(2020)Implementations of the Gesture-based Immersive Interaction and ML-driven Sound Generation for Haptic Companion Doll2020 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR)10.1109/AIVR50618.2020.00078(375-379)Online publication date: Dec-2020
https://doi.org/10.1109/AIVR50618.2020.00078

Index Terms

HaptDoll: an interactive device for tactile sensation with virtual companion doll
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Virtual reality

Recommendations

Impacto: Simulating Physical Impact by Combining Tactile Stimulation with Electrical Muscle Stimulation
UIST '15: Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology

We present impacto, a device designed to render the haptic sensation of hitting or being hit in virtual reality. The key idea that allows the small and light impacto device to simulate a strong hit is that it decomposes the stimulus: it renders the ...
Haptic around: multiple tactile sensations for immersive environment and interaction in virtual reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology

In this paper, we present Haptic Around, a hybrid-haptic feedback system, which utilizes fan, hot air blower, mist creator and heat light to recreate multiple tactile sensations in virtual reality for enhancing the immersive environment and interaction. ...
Integrating Haptics with Augmented Reality in a Femoral Palpation and Needle Insertion Training Simulation

This paper presents a virtual environment for training femoral palpation and needle insertion, the opening steps of many interventional radiology procedures. A novel augmented reality simulation called PalpSim has been developed that allows the trainees ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

ICIGP '19: Proceedings of the 2nd International Conference on Image and Graphics Processing

February 2019

151 pages

ISBN:9781450360920

DOI:10.1145/3313950

Conference Chairs:
Xudong Jiang
Nanyang Technological University, Singapore
,
Lipo Wang
Nanyang Technological University, Singapore
,
Program Chairs:
Nobuhiko Mukai
Tokyo City University, Japan
,
Lih-Shyang Chen
National Cheng Kung University, Taiwan

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 February 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICIGP 2019

ICIGP 2019: 2019 2nd International Conference on Image and Graphics Processing

February 23 - 25, 2019

Singapore, Singapore

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
253
Total Downloads

Downloads (Last 12 months)10
Downloads (Last 6 weeks)1

Reflects downloads up to 13 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Tun LJanaka Rajapakse RHung YMiyata K(2020)Implementations of the Gesture-based Immersive Interaction and ML-driven Sound Generation for Haptic Companion Doll2020 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR)10.1109/AIVR50618.2020.00078(375-379)Online publication date: Dec-2020
https://doi.org/10.1109/AIVR50618.2020.00078

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents