Virtual Physical Task Training: Comparing Shared Body, Shared View and Verbal Task Explanation
Pages 157 - 168
Abstract
While video lectures are very successful in explaining theoretical aspects, Virtual Reality (VR) also offers the possibility to teach physical skills. While a large body of research focuses on virtual teaching explaining tasks during the task completion, it remains unclear what type of task instructions work best before task execution.
In this paper, we compare three virtual teaching methods: purely verbal explanation, explanation by observing the trainer’s activity from exactly their perspective (shared-body), and explanation by observing the task execution in a shared view overlay within one’s view.
Our quantitative results show that the purely verbal explanation can result in slower task replication for some tasks, e.g., path drawing in the air. Our qualitative results indicate that shared-body and shared view techniques work well but can be improved through additional verbal explanations. Moreover, task instruction might be hard to remember, which can be avoided through in-situ instructions or splitting the tasks into sub-tasks and letting the trainees replicate shorter physical actions.
Supplementary Material
Supplementary video
- Download
- 93.32 MB
References
[1]
Judith Amores, Xavier Benavides, and Pattie Maes. 2015. ShowMe: A Remote Collaboration System That Supports Immersive Gestural Communication. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI EA ’15). Association for Computing Machinery, New York, NY, USA, 1343–1348. https://doi.org/10.1145/2702613.2732927
[2]
Amine Chellali, Isabelle Milleville-Pennel, and Cédric Dumas. 2013. Influence of Contextual Objects on Spatial Interactions and Viewpoints Sharing in Virtual Environments. Virtual Real. 17, 1 (March 2013), 1–15. https://doi.org/10.1007/s10055-012-0214-5
[3]
Philo Tan Chua, Rebecca Crivella, Bo Daly, Ning Hu, Russ Schaaf, David Ventura, Todd Camill, Jessica Hodgins, and Randy Pausch. 2003. Training for Physical Tasks in Virtual Environments: Tai Chi. In Proceedings of the IEEE Virtual Reality 2003(VR ’03). IEEE Computer Society, USA, 87.
[4]
Jane E Cole and Jeffrey B Kritzer. 2009. Strategies for success: Teaching an online course. Rural Special Education Quarterly 28, 4 (2009), 36–40.
[5]
J. C. F. de Winter, S. de Groot, J. Dankelman, P. A. Wieringa, M. M. van Paassen, and M. Mulder. 2008. Advancing Simulation-Based Driver Training: Lessons Learned and Future Perspectives. In Proceedings of the 10th International Conference on Human Computer Interaction with Mobile Devices and Services (Amsterdam, The Netherlands) (MobileHCI ’08). Association for Computing Machinery, New York, NY, USA, 459–464. https://doi.org/10.1145/1409240.1409314
[6]
Maximilian Dürr, Rebecca Weber, Ulrike Pfeil, and Harald Reiterer. 2020. EGuide: Investigating Different Visual Appearances and Guidance Techniques for Egocentric Guidance Visualizations. In Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction (Sydney NSW, Australia) (TEI ’20). Association for Computing Machinery, New York, NY, USA, 311–322. https://doi.org/10.1145/3374920.3374945
[7]
Markus Funk, Thomas Kosch, and Albrecht Schmidt. 2016. Interactive Worker Assistance: Comparing the Effects of in-Situ Projection, Head-Mounted Displays, Tablet, and Paper Instructions. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing(Heidelberg, Germany) (UbiComp ’16). Association for Computing Machinery, New York, NY, USA, 934–939. https://doi.org/10.1145/2971648.2971706
[8]
Susan R. Fussell, Leslie D. Setlock, and Robert E. Kraut. 2003. Effects of Head-Mounted and Scene-Oriented Video Systems on Remote Collaboration on Physical Tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Ft. Lauderdale, Florida, USA) (CHI ’03). Association for Computing Machinery, New York, NY, USA, 513–520. https://doi.org/10.1145/642611.642701
[9]
Ceenu George, Michael Spitzer, and Heinrich Hussmann. 2018. Training in IVR: Investigating the Effect of Instructor Design on Social Presence and Performance of the VR User. In Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology (Tokyo, Japan) (VRST ’18). Association for Computing Machinery, New York, NY, USA, Article 27, 5 pages. https://doi.org/10.1145/3281505.3281543
[10]
Sandra G. Hart. 2006. Nasa-Task Load Index (NASA-TLX); 20 Years Later. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 50, 9(2006), 904–908. https://doi.org/10.1177/154193120605000909 arXiv:https://doi.org/10.1177/154193120605000909
[11]
Thuong N. Hoang, Martin Reinoso, Frank Vetere, and Egemen Tanin. 2016. Onebody: Remote Posture Guidance System Using First Person View in Virtual Environment. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction (Gothenburg, Sweden) (NordiCHI ’16). Association for Computing Machinery, New York, NY, USA, Article 25, 10 pages. https://doi.org/10.1145/2971485.2971521
[12]
Dongsik Jo, Yongwan Kim, Ungyeon Yang, Jinsung Choi, Ki-Hong Kim, Gun A. Lee, Yeong-Do Park, and Young Whan Park. 2011. Welding Representation for Training under VR Environments. In Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry (Hong Kong, China) (VRCAI ’11). Association for Computing Machinery, New York, NY, USA, 339–342. https://doi.org/10.1145/2087756.2087809
[13]
Michael C. Jones. 2008. Simulation across the Spectrum of Submarine Training. In Proceedings of the 2008 Spring Simulation Multiconference (Ottawa, Canada) (SpringSim ’08). Society for Computer Simulation International, San Diego, CA, USA, 811–815.
[14]
David S. Kirk and Danaë Stanton Fraser. 2005. The Effects of Remote Gesturing on Distance Instruction. In Proceedings of Th 2005 Conference on Computer Support for Collaborative Learning: Learning 2005: The next 10 Years! (Taipei, Taiwan) (CSCL ’05). International Society of the Learning Sciences, 301–310.
[15]
Daisuke Kondo, Keitaro Kurosaki, Hiroyuki Iizuka, Hideyuki Ando, and Taro Maeda. 2011. View Sharing System for Motion Transmission. In Proceedings of the 2nd Augmented Human International Conference (Tokyo, Japan) (AH ’11). Association for Computing Machinery, New York, NY, USA, Article 26, 4 pages. https://doi.org/10.1145/1959826.1959852
[16]
Matthew Kyan, Guoyu Sun, Haiyan Li, Ling Zhong, Paisarn Muneesawang, Nan Dong, Bruce Elder, and Ling Guan. 2015. An Approach to Ballet Dance Training through MS Kinect and Visualization in a CAVE Virtual Reality Environment. ACM Trans. Intell. Syst. Technol. 6, 2, Article 23 (March 2015), 37 pages. https://doi.org/10.1145/2735951
[17]
G. Lee, H. Kang, J. Lee, and J. Han. 2020. A User Study on View-sharing Techniques for One-to-Many Mixed Reality Collaborations. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 343–352.
[18]
Richard Light and Rod Fawns. 2001. The thinking body: Constructivist approaches to games teaching in physical education. Critical Studies in Education 42, 2 (2001), 69–87.
[19]
Maite Lopez-Garate, Alberto Lozano-Rodero, and Luis Matey. 2008. An Adaptive and Customizable Feedback System for VR-Based Training Simulators. In Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent Systems - Volume 3 (Estoril, Portugal) (AAMAS ’08). International Foundation for Autonomous Agents and Multiagent Systems, Richland, SC, 1635–1638.
[20]
Elhassan Makled, Amal Yassien, Passant Elagroudy, Mohamed Magdy, Slim Abdennadher, and Nabila Hamdi. 2019. PathoGenius VR: VR Medical Training. In Proceedings of the 8th ACM International Symposium on Pervasive Displays (Palermo, Italy) (PerDis ’19). Association for Computing Machinery, New York, NY, USA, Article 31, 2 pages. https://doi.org/10.1145/3321335.3329694
[21]
Takayuki Nozawa, Erwin Wu, Florian Perteneder, and Hideki Koike. 2019. Visualizing Expert Motion for Guidance in a VR Ski Simulator. In ACM SIGGRAPH 2019 Posters (Los Angeles, California) (SIGGRAPH ’19). Association for Computing Machinery, New York, NY, USA, Article 64, 2 pages. https://doi.org/10.1145/3306214.3338561
[22]
Lauriane Pouliquen-Lardy, Isabelle Milleville-Pennel, François Guillaume, and Franck Mars. 2016. Remote collaboration in virtual reality: asymmetrical effects of task distribution on spatial processing and mental workload. Virtual Reality 20, 4 (01 Nov 2016), 213–220. https://doi.org/10.1007/s10055-016-0294-8
[23]
Rufat Rzayev, Gürkan Karaman, Katrin Wolf, Niels Henze, and Valentin Schwind. 2019. The Effect of Presence and Appearance of Guides in Virtual Reality Exhibitions. In Proceedings of Mensch Und Computer 2019 (Hamburg, Germany) (MuC’19). Association for Computing Machinery, New York, NY, USA, 11–20. https://doi.org/10.1145/3340764.3340802
[24]
Lim Seow San, Djasliana Binte Hussain, Lim Heng Loo, Zhuang Ronglin, Suraj Balasubramanian, Kelvin W. C. Foong, Tok Wee Wah, Muhammad Taufiq Bin Mahmud, Seah her Yuh, Lim Minmin, Emilia Joey Yim Shao’en, Jeremiah K. S. Seah, Sheryl Lim Jia Jin, Low Minghui, and Lu Zhiyin. 2008. Dental VR Application for Dental Training. In Proceedings of The 7th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry(Singapore) (VRCAI ’08). Association for Computing Machinery, New York, NY, USA, Article 33, 2 pages. https://doi.org/10.1145/1477862.1477906
[25]
M. Stefik, D. G. Bobrow, G. Foster, S. Lanning, and D. Tatar. 1987. WYSIWIS Revised: Early Experiences with Multiuser Interfaces. ACM Trans. Inf. Syst. 5, 2 (April 1987), 147–167. https://doi.org/10.1145/27636.28056
[26]
S. Valin, A. Francu, H. Trefftz, and I. Marsic. 2001. Sharing viewpoints in collaborative virtual environments. In Proceedings of the 34th Annual Hawaii International Conference on System Sciences. 12 pp.–.
[27]
Wang Xiaoling, Zheng Peng, Wei Zhifang, Sun Yan, Luo Bin, and Li Yangchun. 2004. Development an Interactive VR Training for CNC Machining. In Proceedings of the 2004 ACM SIGGRAPH International Conference on Virtual Reality Continuum and Its Applications in Industry (Singapore) (VRCAI ’04). Association for Computing Machinery, New York, NY, USA, 131–133. https://doi.org/10.1145/1044588.1044612
[28]
Ungyeon Yang and Gerard Jounghyun Kim. 2002. Implementation and Evaluation of “Just Follow Me”: An Immersive, VR-Based, Motion-Training System. Presence: Teleoperators and Virtual Environments 11, 3 (June 2002), 304–323. https://doi.org/10.1162/105474602317473240
[29]
Ahmed Mohamed Fahmy Yousef, Mohamed Amine Chatti, Ulrik Schroeder, and Marold Wosnitza. 2014. What drives a successful MOOC? An empirical examination of criteria to assure design quality of MOOCs. In 2014 IEEE 14th International Conference on Advanced Learning Technologies. IEEE, 44–48.
Recommendations
Shared Reconstructed Environments in Extended Reality
SVR '24: Proceedings of the 26th Symposium on Virtual and Augmented RealityModern extended reality headsets can identify the geometry of the physical surrounding space, which can be shared and synchronized with remote users, allowing them to view the space through their own extended reality headsets from different points of ...
Cognitive task analysis for virtual reality training: the case of CNC tool offsetting
ECCE '10: Proceedings of the 28th Annual European Conference on Cognitive ErgonomicsMotivation -- To examine if cognitive task analysis of expert machinists can be effective in developing a virtual reality based training system for CNC tool offsetting.
Research approach -- A cognitive task analysis of expert machinists was conducted ...
Positioning a virtual teacher in an MR physical task learning support system
SAC '11: Proceedings of the 2011 ACM Symposium on Applied ComputingMost of the existing physical tasks learning support systems do not show the task's physical motion in the real world. Because of this, a physical task learning support system showing a 3D virtual teacher model in the real world using mixed reality was ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
February 2021
321 pages
ISBN:9781450384285
DOI:10.1145/3458709
Copyright © 2021 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 11 July 2021
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- German Ministry of Education and Research
Conference
AHs '21
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 108Total Downloads
- Downloads (Last 12 months)19
- Downloads (Last 6 weeks)0
Reflects downloads up to 15 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format