[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3582700.3582703acmotherconferencesArticle/Chapter ViewAbstractPublication PagesahsConference Proceedingsconference-collections
research-article
Open access

Effect of Weight Adjustment in Virtual Co-embodiment During Collaborative Training

Published: 14 March 2023 Publication History

Abstract

Acquisition of motor skills plays an essential role in various contexts, such as sports, factory jobs, and nursing. For effective motor skill learning, “virtual co-embodiment” has been proposed as a novel virtual reality (VR) based method in which a virtual avatar is controlled based on the weighted average of the learner’s and teacher’s movements. Using virtual co-embodiment, a learner can learn the motor intention because they can feel a strong sense of agency in the avatar’s movements modified by the teacher. However, after the assistance of the virtual co-embodiment vanishes, there is a performance drop problem; the learner cannot move as they learned, even if they understand the correct movement or motor intention, because the difference in body positions between the co-embodied avatar and the learner requires the latter to move differently after termination of the assistance. One way to match their positions is to increase the weight assigned to the learner’s weight. However, simply assigning the learner a high weight does not allow the teacher to correct the avatar’s movements and convey the correct movement and motor intention. By allowing the teacher a greater influence in the early stages of learning, and decreasing the influence as the learning progresses, it is expected to gradually allow the student to learn to operate independently. Therefore, we propose a method to prevent performance drop by adjusting weights according to the learning performance, thereby maintaining a high learning efficiency and helping advanced learners learn to independently demonstrate their abilities. In this study, we experimented with dual task learning to evaluate the automation of movement, which is considered an essential element of motor skills. We compared the performance drop when the virtual co-embodiment assist was terminated with static or adjusted weights based on the performance. Consequently, although the learning efficiency was slightly lower, the use of adjusted weights resulted in a significantly smaller performance drop after the termination of virtual co-embodiment assistance than that after the use of static weight.

References

[1]
Bruce Abernethy. 1988. The effects of age and expertise upon perceptual skill development in a racquet sport. Research quarterly for exercise and sport 59, 3 (1988), 210–221.
[2]
John R Anderson. 1982. Acquisition of cognitive skill.Psychological review 89, 4 (1982), 369.
[3]
Ann P Bartel and Nachum Sicherman. 1998. Technological change and the skill acquisition of young workers. Journal of Labor Economics 16, 4 (1998), 718–755.
[4]
Sian L Beilock, Thomas H Carr, Clare MacMahon, and Janet L Starkes. 2002. When paying attention becomes counterproductive: impact of divided versus skill-focused attention on novice and experienced performance of sensorimotor skills.Journal of Experimental Psychology: Applied 8, 1 (2002), 6.
[5]
Sian L Beilock, Sarah A Wierenga, and Thomas H Carr. 2002. Expertise, attention, and memory in sensorimotor skill execution: Impact of novel task constraints on dual-task performance and episodic memory. The Quarterly Journal of Experimental Psychology Section A 55, 4(2002), 1211–1240.
[6]
Ida T Bjark. 1997. Changing conceptions of practical skill and skill acquisition in nursing education. Nursing Inquiry 4, 3 (1997), 184–195.
[7]
Niclas Braun, Stefan Debener, Nadine Spychala, Edith Bongartz, Peter Sörös, Helge H. O. Müller, and Alexandra Philipsen. 2018. The Senses of Agency and Ownership: A Review. Frontiers in Psychology 9 (2018). https://www.frontiersin.org/articles/10.3389/fpsyg.2018.00535
[8]
Lucilla Cardinali, Claudio Brozzoli, and Alessandro Farne. 2009. Peripersonal space and body schema: two labels for the same concept?Brain topography 21, 3 (2009), 252–260.
[9]
Lucilla Cardinali, Claudio Brozzoli, Jacques Luauté, Alice C Roy, and Alessandro Farnè. 2016. Proprioception is necessary for body schema plasticity: evidence from a deafferented patient. Frontiers in Human Neuroscience 10 (2016), 272.
[10]
Glenn Carruthers. 2012. The case for the comparator model as an explanation of the sense of agency and its breakdowns. Consciousness and cognition 21, 1 (2012), 30–45.
[11]
Umberto Castiello and Carlo Umiltà. 1988. Temporal dimensions of mental effort in different sports.International Journal of Sport Psychology(1988).
[12]
James H Cauraugh, Marcel Martin, and Karen Komer Martin. 1999. Modeling surgical expertise for motor skill acquisition. The American journal of surgery 177, 4 (1999), 331–336.
[13]
Nicole David, Albert Newen, and Kai Vogeley. 2008. The “sense of agency” and its underlying cognitive and neural mechanisms. Consciousness and cognition 17, 2 (2008), 523–534.
[14]
Frédérique De Vignemont. 2010. Body schema and body image—Pros and cons. Neuropsychologia 48, 3 (2010), 669–680.
[15]
Susan T Dumais. 1981. The development of automatism. Cognitive Skills and Their Acquisition, Hillsdale, NJ: Erlbaum (1981), 111–140.
[16]
Mariano D’Angelo, Giuseppe di Pellegrino, Stefano Seriani, Paolo Gallina, and Francesca Frassinetti. 2018. The sense of agency shapes body schema and peripersonal space. Scientific reports 8, 1 (2018), 1–11.
[17]
Harald E Ewolds, Laura Bröker, Rita F De Oliveira, Markus Raab, and Stefan Künzell. 2017. Implicit and explicit knowledge both improve dual task performance in a continuous pursuit tracking task. Frontiers in psychology 8 (2017), 2241.
[18]
Paul Morris Fitts and Michael I. Posner. 1967. Human performance.
[19]
R. Fribourg, N. Ogawa, L. Hoyet, F. Argelaguet, T. Narumi, M. Hirose, and A. Lécuyer. 2020. Virtual co-embodiment: evaluation of the sense of agency while sharing the control of a virtual body among two individuals. IEEE Transactions on Visualization and Computer Graphics (2020).
[20]
Dr Tim Gabbett, Matthew Wake, and Bruce Abernethy. 2011. Use of dual-task methodology for skill assessment and development: Examples from rugby league. Journal of Sports Sciences 29, 1 (2011), 7–18. https://doi.org/10.1080/02640414.2010.514280 arXiv:https://doi.org/10.1080/02640414.2010.514280PMID: 21086214.
[21]
Tim J Gabbett and Bruce Abernethy. 2012. Dual-task assessment of a sporting skill: influence of task complexity and relationship with competitive performances. Journal of sports sciences 30, 16 (2012), 1735–1745.
[22]
Shaun Gallagher. 1986. Body image and body schema: A conceptual clarification. The Journal of mind and behavior(1986), 541–554.
[23]
Mar Gonzalez-Franco, Eyal Ofek, Ye Pan, Angus Antley, Anthony Steed, Bernhard Spanlang, Antonella Maselli, Domna Banakou, Nuria Pelechano, Sergio Orts-Escolano, 2020. The rocketbox library and the utility of freely available rigged avatars. Frontiers in virtual reality(2020), 20.
[24]
Rob Gray. 2004. Attending to the execution of a complex sensorimotor skill: expertise differences, choking, and slumps.Journal of Experimental Psychology: Applied 10, 1 (2004), 42.
[25]
Takayoshi Hagiwara, Gowrishankar Ganesh, Maki Sugimoto, Masahiko Inami, and Michiteru Kitazaki. 2020. Individuals Prioritize the Reach Straightness and Hand Jerk of a Shared Avatar over Their Own. Iscience (2020), 101732.
[26]
Takayoshi Hagiwara, Maki Sugimoto, Masahiko Inami, and Michiteru Kitazaki. 2019. Shared body by action integration of two persons: Body ownership, sense of agency and task performance. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 954–955.
[27]
Craig Handford, Keith Davids, Simon Bennett, and Chris Button. 1997. Skill acquisition in sport: Some applications of an evolving practice ecology. Journal of sports sciences 15, 6 (1997), 621–640.
[28]
Neil A Hayes and Donald E Broadbent. 1988. Two modes of learning for interactive tasks. Cognition 28, 3 (1988), 249–276.
[29]
O Hikosaka, M Rand, K Nakamura, S Miyachi, K Kitaguchi, K Sakai, X Lu, and Y Shimo. 2002. Long-term retention of motor skill in macaque monkeys and humans. Experimental brain research 147, 4 (2002), 494–504.
[30]
Atsushi Hiyama, Yusuke Doyama, Mariko Miyashita, Eikan Ebuchi, Masazumi Seki, and Michitaka Hirose. 2011. Artisanship training using wearable egocentric display. In Proceedings of the 24th annual ACM symposium adjunct on User interface software and technology. 81–82.
[31]
Camille Jeunet, Louis Albert, Ferran Argelaguet, and Anatole Lécuyer. 2018. “Do you feel in control?”: towards novel approaches to characterise, manipulate and measure the sense of agency in virtual environments. IEEE transactions on visualization and computer graphics 24, 4(2018), 1486–1495.
[32]
Edward E Jones, Leslie Rock, Kelly G Shaver, George R Goethals, and Lawrence M Ward. 1968. Pattern of performance and ability attribution: An unexpected primacy effect.Journal of Personality and Social Psychology 10, 4(1968), 317.
[33]
Jinki Jung and Young Joong Ahn. 2018. Effects of interface on procedural skill transfer in virtual training: Lifeboat launching operation study. Computer Animation and Virtual Worlds 29, 3-4 (2018), e1812.
[34]
Elmar Kal, Rens Prosée, Marinus Winters, and John Van Der Kamp. 2018. Does implicit motor learning lead to greater automatization of motor skills compared to explicit motor learning? A systematic review. PloS one 13, 9 (2018), e0203591.
[35]
Shunichi Kasahara, Keina Konno, Richi Owaki, Tsubasa Nishi, Akiko Takeshita, Takayuki Ito, Shoko Kasuga, and Junichi Ushiba. 2017. Malleable Embodiment: Changing Sense of Embodiment by Spatial-Temporal Deformation of Virtual Human Body(CHI ’17). Association for Computing Machinery, New York, NY, USA, 6438–6448. https://doi.org/10.1145/3025453.3025962
[36]
Mitsuo Kawato, Kazunori Furukawa, and Ryoji Suzuki. 1987. A hierarchical neural-network model for control and learning of voluntary movement. Biological cybernetics 57, 3 (1987), 169–185.
[37]
Konstantina Kilteni, Raphaela Groten, and Mel Slater. 2012. The sense of embodiment in virtual reality. Presence: Teleoperators and Virtual Environments 21, 4(2012), 373–387.
[38]
Stuart T Klapp, Martin D Hill, John G Tyler, Zeke E Martin, Richard J Jagacinski, and Mari Riess Jones. 1985. On marching to two different drummers: perceptual aspects of the difficulties.Journal of Experimental Psychology: Human Perception and Performance 11, 6(1985), 814.
[39]
Daiki Kodama, Takato Mizuho, Yuji Hatada, Takuji Narumi, and Michitaka Hirose. 2022. Enhancing the Sense of Agency by Transitional Weight Control in Virtual Co-Embodiment. (2022).
[40]
Daiki Kodama, Takato Mizuho, Yuji Hatada, Takuji Narumi, and Michitaka Hirose. 2023. Effects of Collaborative Training Using Virtual Co-embodiment on Motor Skill Learning. IEEE Transactions on Visualization and Computer Graphics (2023).
[41]
Taihei Kojima, Atsushi Hiyama, Takahiro Miura, and Michitaka Hirose. 2014. Training archived physical skill through immersive virtual environment. In International Conference on Human Interface and the Management of Information. Springer, 51–58.
[42]
Katrin Linser and Thomas Goschke. 2007. Unconscious modulation of the conscious experience of voluntary control. Cognition 104, 3 (2007), 459–475.
[43]
Roberto Llorens, Adrián Borrego, Priscila Palomo, Ausiàs Cebolla, Enrique Noé, Sergi Bermúdez i Badia, and Rosa Baños. 2017. Body schema plasticity after stroke: subjective and neurophysiological correlates of the rubber hand illusion. Neuropsychologia 96(2017), 61–69.
[44]
Angelo Maravita and Atsushi Iriki. 2004. Tools for the body (schema). Trends in cognitive sciences 8, 2 (2004), 79–86.
[45]
Jamie Murphy, Charles Hofacker, and Richard Mizerski. 2006. Primacy and recency effects on clicking behavior. Journal of computer-mediated communication 11, 2 (2006), 522–535.
[46]
Jun Nishida, Yudai Tanaka, Romain Nith, and Pedro Lopes. 2022. DigituSync: A Dual-User Passive Exoskeleton Glove That Adaptively Shares Hand Gestures. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology (Bend, OR, USA) (UIST ’22). Association for Computing Machinery, New York, NY, USA, Article 59, 12 pages. https://doi.org/10.1145/3526113.3545630
[47]
Harold Pashler. 1994. Dual-task interference in simple tasks: data and theory.Psychological bulletin 116, 2 (1994), 220.
[48]
Catherine L Reed. 2002. What is the body schema?(2002).
[49]
Daniel Roth and Marc Erich Latoschik. 2020. Construction of the Virtual Embodiment Questionnaire (VEQ). IEEE Transactions on Visualization and Computer Graphics 26, 12(2020), 3546–3556. https://doi.org/10.1109/TVCG.2020.3023603
[50]
Pascal Salembier, Julien Kahn, Guillaume Calvet, Moustapha Zouinar, and Marc Relieu. 2005. “Just follow me”. Examining the use of a multimodal mobile device in natural settings. In proceedings of the HCI international conference july. Citeseer, 22–27.
[51]
Sabine Schaefer and Gianluca Amico. 2022. Table tennis expertise influences dual-task costs in timed and self-initiated tasks. Acta Psychologica 223(2022), 103501. https://doi.org/10.1016/j.actpsy.2022.103501
[52]
Walter Schneider and Arthur D Fisk. 1983. Attention theory and mechanisms for skilled performance. In Advances in psychology. Vol. 12. Elsevier, 119–143.
[53]
Thomas J Shuell. 1990. Phases of meaningful learning. Review of educational research 60, 4 (1990), 531–547.
[54]
Matthew D Smith and Craig J Chamberlin. 1992. Effect of adding cognitively demanding tasks on soccer skill performance. Perceptual and motor skills 75, 3 (1992), 955–961.
[55]
A Michael Spence. 1981. The learning curve and competition. The Bell Journal of Economics(1981), 49–70.
[56]
Michael Tombu and Pierre Jolicœur. 2003. A central capacity sharing model of dual-task performance.Journal of Experimental Psychology: Human Perception and Performance 29, 1(2003), 3.
[57]
M. Tsakiris, G. Prabhu, and P. Haggard. 2006. Having a body versus moving your body: How agency structures body-ownership. Consciousness and cognition 15, 2 (2006), 423–432.
[58]
Nicolas Vuillerme and Vincent Nougier. 2004. Attentional demand for regulating postural sway: the effect of expertise in gymnastics. Brain Research Bulletin 63, 2 (2004), 161–165.
[59]
Daniel M Wegner, Betsy Sparrow, and Lea Winerman. 2004. Vicarious agency: experiencing control over the movements of others.Journal of personality and social psychology 86, 6(2004), 838.
[60]
Wen Wen. 2019. Does delay in feedback diminish sense of agency? A review. Consciousness and cognition 73 (2019), 102759.
[61]
Wen Wen, Atsushi Yamashita, and Hajime Asama. 2015. The sense of agency during continuous action: performance is more important than action-feedback association. PLOS ONE 10, 4 (2015), e0125226.
[62]
Wen Wen, Atsushi Yamashita, and Hajime Asama. 2017. The influence of performance on action-effect integration in sense of agency. Consciousness and Cognition 53 (2017), 89–98.
[63]
Dorit Wenke, Stephen M Fleming, and Patrick Haggard. 2010. Subliminal priming of actions influences sense of control over effects of action. Cognition 115, 1 (2010), 26–38.
[64]
Daniel B Willingham. 1998. A neuropsychological theory of motor skill learning. Psychological review 105, 3 (1998), 558.
[65]
Gabriele Wulf, Charles Shea, and Rebecca Lewthwaite. 2010. Motor skill learning and performance: a review of influential factors. Medical education 44, 1 (2010), 75–84.
[66]
U Yang. 1999. Just follow me: An immersive vr-based motion training system. In Proceedings of the International Conference on Virtual Systems and Multimedia, 1999. 435–444.
[67]
Ungyeon Yang and Gerard Jounghyun Kim. 2002. Implementation and evaluation of “just follow me”: An immersive, VR-based, motion-training system. Presence: Teleoperators & Virtual Environments 11, 3(2002), 304–323.
[68]
Louis E Yelle. 1979. The learning curve: Historical review and comprehensive survey. Decision sciences 10, 2 (1979), 302–328.

Cited By

View all
  • (2024)“Together with Who?” Recognizing Partners during Collaborative Avatar ManipulationACM Transactions on Applied Perception10.1145/369823721:4(1-16)Online publication date: 1-Oct-2024
  • (2024)Towards Full Body Co-Embodiment of Human and Non-Human Avatars in Virtual Reality2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW62533.2024.00084(432-435)Online publication date: 16-Mar-2024
  • (2024)MindMeld Cyclers: Exploring New Collaborative Motion Modes Using Virtual Co-embodiment in a Serious Game2024 IEEE Conference on Games (CoG)10.1109/CoG60054.2024.10645590(1-8)Online publication date: 5-Aug-2024
  • Show More Cited By

Index Terms

  1. Effect of Weight Adjustment in Virtual Co-embodiment During Collaborative Training

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    AHs '23: Proceedings of the Augmented Humans International Conference 2023
    March 2023
    395 pages
    ISBN:9781450399845
    DOI:10.1145/3582700
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 14 March 2023

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Adjustment
    2. Collaborative Training
    3. Motor Skill Learning
    4. Virtual Co-embodiment

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    AHs '23
    AHs '23: Augmented Humans Conference
    March 12 - 14, 2023
    Glasgow, United Kingdom

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)306
    • Downloads (Last 6 weeks)64
    Reflects downloads up to 13 Dec 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)“Together with Who?” Recognizing Partners during Collaborative Avatar ManipulationACM Transactions on Applied Perception10.1145/369823721:4(1-16)Online publication date: 1-Oct-2024
    • (2024)Towards Full Body Co-Embodiment of Human and Non-Human Avatars in Virtual Reality2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW62533.2024.00084(432-435)Online publication date: 16-Mar-2024
    • (2024)MindMeld Cyclers: Exploring New Collaborative Motion Modes Using Virtual Co-embodiment in a Serious Game2024 IEEE Conference on Games (CoG)10.1109/CoG60054.2024.10645590(1-8)Online publication date: 5-Aug-2024
    • (2024)A preliminary study of a co-embodiment approach for welding training2024 IEEE 18th International Conference on Application of Information and Communication Technologies (AICT)10.1109/AICT61888.2024.10740441(1-6)Online publication date: 25-Sep-2024
    • (2024)Avatars in Immersive Virtual Reality Education: Preliminary Insights and Recommendations from a Systematic ReviewSmart Technologies for a Sustainable Future10.1007/978-3-031-61891-8_26(267-274)Online publication date: 1-Jun-2024
    • (2023)Effects of Virtual Co-embodiment on Declarative Memory-Based Motor Skill LearningACM Symposium on Applied Perception 202310.1145/3605495.3605797(1-10)Online publication date: 5-Aug-2023
    • (2023)Shared Avatar for Hand Movement Imitation: Subjective and Behavioral AnalysesIEEE Access10.1109/ACCESS.2023.331217911(96710-96717)Online publication date: 2023

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media