[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3623509.3633398acmconferencesArticle/Chapter ViewAbstractPublication PagesteiConference Proceedingsconference-collections
research-article
Open access

Augmenting Embodied Learning in Welding Training: The Co-Design of an XR- and tinyML-Enabled Welding System for Creative Arts and Manufacturing Training

Published: 11 February 2024 Publication History

Abstract

Metal welding is a craft manufacturing skill that can be unusually difficult to externalize and represent to novices. Building competency requires an apprentice to iteratively practice embodied skills and sensitize themselves to a sensorially complex practice. To explore these challenges, we organized a series of co-design workshops with a youth program in welding and fabrication. Working with eight instructors and four students, we identified opportunities for mixed reality, sensing, and tinyML processes to augment welding training and practice. This resulted in an extended reality (XR) welding helmet and torch that enhances the embodied learning of welding in three key ways: biometric sensing enhances mindfulness and stress management in sensorially challenging environments; acoustic sensing focuses learner attention on non-visual cues of weld performance; and combined motion-sensing and visual XR feedback helps improve proprioceptive and embodied learning. These features are assessed and we offer design implications for augmenting novice learning of craft-practice with XR approaches.

Supplemental Material

MP4 File
Video figure

References

[1]
Selena Chan, Lee Baglow, and Chris Lovegrove. 2019. Supporting the learning of the sociomaterial: novices’ perspectives on virtual reality welding simulatiors. In Contemporary Apprenticeship Reforms and Reconfigurations. 63–66.
[2]
Digital Transforms Physical. [n. d.]. Vuforia Studio. https://www.ptc.com/en/products/vuforia/vuforia-studio
[3]
Andrew Finke. 2019. Lake: A Digital Wizard of Oz Prototyping Tool. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, Glasgow Scotland Uk, 1–6. https://doi.org/10.1145/3290607.3308455
[4]
Robert Fisher. 2006. Still thinking: The case for meditation with children. Thinking Skills and Creativity 1, 2 (Nov. 2006), 146–151. https://doi.org/10.1016/j.tsc.2006.06.004
[5]
Guoning Hu and DeLiang Wang. 2010. A Tandem Algorithm for Pitch Estimation and Voiced Speech Segregation. IEEE Transactions on Audio, Speech, and Language Processing 18, 8 (Nov. 2010), 2067–2079. https://doi.org/10.1109/TASL.2010.2041110
[6]
Atsushi Hiyama, Hiroyuki Onimaru, Mariko Miyashita, Eikan Ebuchi, Masazumi Seki, and Michitaka Hirose. 2013. Augmented Reality System for Measuring and Learning Tacit Artisan Skills. In Human Interface and the Management of Information. Information and Interaction for Health, Safety, Mobility and Complex Environments (Lecture Notes in Computer Science), Sakae Yamamoto (Ed.). Springer, 85–91. https://doi.org/10.1007/978-3-642-39215-3 10 Place: Berlin, Heidelberg.
[7]
Tim Ingold. 2021. The perception of the environment: essays on livelihood, dwelling and skill (new edition ed.). Routledge, London. https://doi.org/10.4324/9781003196662 OCLC: 1273729044.
[8]
Ananya Ipsita, Levi Erickson, Yangzi Dong, Joey Huang, Alexa K Bushinski, Sraven Saradhi, Ana M Villanueva, Kylie A Peppler, Thomas S Redick, and Karthik Ramani. 2022. Towards Modeling of Virtual Reality Welding Simulators to Promote Accessible and Scalable Training. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI ’22). Association for Computing Machinery, 1–21. https://doi.org/10.1145/3491102.3517696 Place: New York, NY, USA.
[9]
Nils Karges, Jeroen Staab, Jürgen Rauh, Martin Wegmann, and Hannes Taubenböck. 2022. Soundscapes on edge - The real-time machine learning approach for measuring Soundscapes on resource-constrained devices. In Proceedings of the 24th International Congress on Acoustics. 128–139. https://elib.dlr.de/190129/
[10]
Kiat Hui Khng. 2017. A better state-of-mind: deep breathing reduces state anxiety and enhances test performance through regulating test cognitions in children. Cognition & Emotion 31, 7 (Nov. 2017), 1502–1510. https://doi.org/10.1080/02699931.2016.1233095
[11]
Konstantina Kilteni, Raphaela Groten, and Mel Slater. 2012. The Sense of Embodiment in Virtual Reality. Presence: Teleoperators and Virtual Environments 21, 4 (Nov. 2012), 373–387. https://doi.org/10.1162/PRES_a_00124
[12]
Benjamin Knoke and Klaus-Dieter Thoben. 2021. Training simulators for manufacturing processes: Literature review and systematisation of applicability factors. Computer Applications in Engineering Education 29, 5 (Sept. 2021), 1191–1207. https://doi.org/10.1002/cae.22378
[13]
Felix Lauber, Claudius Böttcher, and Andreas Butz. 2014. PapAR: Paper Prototyping for Augmented Reality. In Adjunct Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, Seattle WA USA, 1–6. https://doi.org/10.1145/2667239.2667271
[14]
Olena O. Lavrentieva, Ihor O. Arkhypov, Olexander I. Kuchma, and Aleksandr D. Uchitel. 2020. Use of simulators together with virtual and augmented reality in the system of welders’ vocational training: past, present, and future. [.]. https://doi.org/10.31812/123456789/3748
[15]
Germán Leiva, Jens Emil Grønbæk, Clemens Nyl-andsted Klokmose, Cuong Nguyen, Rubaiat Habib Kazi, and Paul Asente. 2021. Rapido: Prototyping Interactive AR Experiences through Programming by Demonstration. In The 34th Annual ACM Symposium on User Interface Software and Technology. ACM, Virtual Event USA, 626–637. https://doi.org/10.1145/3472749.3474774
[16]
Germán Leiva, Cuong Nguyen, Rubaiat Habib Kazi, and Paul Asente. 2020. Pronto: Rapid Augmented Reality Video Prototyping Using Sketches and Enaction. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1–13. https://doi.org/10.1145/3313831.3376160
[17]
Jo Mackiewicz. 2022. Welding technical communication: teaching and learning embodied knowledge. State University of New York Press, Albany.
[18]
Sheila L. Macrine and Jennifer M. B. Fugate. 2020. Embodied Cognition. In Oxford Research Encyclopedia of Education. https://doi.org/10.1093/acre-fore/9780190264093.013.885
[19]
Bella Martin and Bruce Hanington. 2012. Universal methods of design: 100 Ways to Research Complex Problems, Develop Innovative Ideas, and Design Effective Solutions. Rockport, Beverly, MA.
[20]
Kierstin Nash. 2023. Robotic Welder Combats Labor Shortage to Boost American Businesses. Thomas Insights (Feb. 2023). https://www.thom-asnet.com/insights/robotic-welder-combats-labor-shortage-to-boost-american-businesses/
[21]
Michael Nebeling and Katy Madier. 2019. 360proto: Making Interactive Virtual Reality & Augmented Reality Prototypes from Paper. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, Glasgow Scotland Uk, 1–13. https://doi.org/10.1145/3290605.3300826
[22]
Michael Nebeling, Janet Nebeling, Ao Yu, and Rob Rumble. 2018. ProtoAR: Rapid Physical-Digital Prototyping of Mobile Augmented Reality Applications. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, Montreal QC Canada, 1–12. https://doi.org/10.1145/3173574.3173927
[23]
Maria Lucia L.R. Okimoto, Paulo César Okimoto, and Carlos Eduardo Goldbach. 2015. User Experience in Augmented Reality Applied to the Welding Education. Procedia Manufacturing 3 (2015), 6223–6227. https://doi.org/10.1016/j.promfg.2015.07.739
[24]
Issa Panahi, Nasser Kehtarnavaz, and Linda Thibodeau. 2016. Smartphone-based noise adaptive speech enhancement for hearing aid applications. In 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE, Orlando, FL, USA, 85–88. https://doi.org/10.1109/EMBC.2016.7590646
[25]
Pierre Philippot, Gaëtane Chapelle, and Sylvie Blairy. 2002. Respiratory feedback in the generation of emotion. Cognition and Emotion 16, 5 (Aug. 2002), 605–627. https://doi.org/10.1080/02699930143000392
[26]
Mirjana Prpa, Ekaterina R. Stepanova, Thecla Schiphorst, Bernhard E. Riecke, and Philippe Pasquier. 2020. Inhaling and Exhaling: How Technologies Can Perceptually Extend our Breath Awareness. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, HonoluluHI USA, 1–15. https://doi.org/10.1145/3313831.3376183
[27]
Mirjana Prpa, Kıvanç Tatar, Jules Françoise, Bernhard Riecke, Thecla Schiphorst, and Philippe Pasquier. 2018. Attending to Breath: Exploring How the Cues in a Virtual Environment Guide the Attention to Breath and Shape the Quality of Experience to Support Mindfulness. In Proceedings of the 2018 Designing Interactive Systems Conference. ACM, Hong Kong China, 71–84. https://doi.org/10.1145/3196709.3196765
[28]
Elizabeth B.-N. Sanders and Pieter Jan Stappers. 2008. Co-creation and the new landscapes of design. CoDesign 4, 1 (March 2008), 5–18. https://doi.org/10.1080/15710880701875068
[29]
Richard T. Stone, Elease McLaurin, Peihan Zhong, and Kristopher Patrick Watts. 2013. Full Virtual Reality vs. Integrated Virtual Reality Training in Welding. Welding Journal 92 (2013).
[30]
Froukje Sleeswijk Visser, Pieter Jan Stappers, Remko Van Der Lugt, and Elizabeth B-N Sanders. 2005. Contextmapping: experiences from practice. CoDesign 1, 2 (April 2005), 119–149. https://doi.org/10.1080/15710880500135987
[31]
Yizhong Wang, Yonghua Chen, Zhongliang Nan, and Yong Hu. 2006. Study on Welder Training by Means of Haptic Guidance and Virtual Reality for Arc Welding. In 2006 IEEE International Conference on Robotics and Biomimetics. IEEE, Kunming, China, 954–958. https://doi.org/10.1109/ROBIO.2006.340349
[32]
Steven A White. 2013. Impact of Visualization Augmentation on Welder Training: A Study with the Simulated MIG Lab. Doctoral Thesis. Impact of Visualization Augmentation on Welder Training: A Study with the Simulated MIG Lab. https://www.proquest.com/docview/1431170165
[33]
Steven A. White, Mores Prachyabrued, Terrence L. Chambers, Christoph W. Borst, and Dirk Reiners. 2011. Low-cost simulated MIG welding for advancement in technical training. Virtual Reality 15, 1 (March 2011), 69–81. https://doi.org/10.1007/s10055-010-0162-x
[34]
Ungyeon Yang, Gun A. Lee, Yongwan Kim, Dongsik Jo, Jinsung Choi, and Ki-Hong Kim. 2010. Virtual Reality Based Welding Training Simulator with 3D Multimodal Interaction. In 2010 International Conference on Cyberworlds. IEEE, Singapore, Singapore, 150–154. https://doi.org/10.1109/CW.2010.68
[35]
Unity Serial Port Utility Pro Plugin. Unity Asset Store. https://assetstore.unity.com/packages/tools/utilities/serial-port-utility-pro-125863

Cited By

View all
  • (2024)XRweld: An In-Situ Extended Reality Platform for Welding EducationACM SIGGRAPH 2024 Immersive Pavilion10.1145/3641521.3664409(1-2)Online publication date: 27-Jul-2024

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
TEI '24: Proceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction
February 2024
1058 pages
ISBN:9798400704024
DOI:10.1145/3623509
This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 February 2024

Check for updates

Badges

  • Honorable Mention

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Data Availability

Conference

TEI '24
Sponsor:

Acceptance Rates

Overall Acceptance Rate 393 of 1,367 submissions, 29%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)380
  • Downloads (Last 6 weeks)49
Reflects downloads up to 01 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)XRweld: An In-Situ Extended Reality Platform for Welding EducationACM SIGGRAPH 2024 Immersive Pavilion10.1145/3641521.3664409(1-2)Online publication date: 27-Jul-2024

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media