Abstract
Work-related musculoskeletal disorders are costly to economies and society, and are the most common work-related health problems. In the European Union and the United States, 30–40% of workers reported work-related musculoskeletal disorders at least in the last decade. Effective ergonomics interventions can be difficult and expensive to implement, leaving administrative measures such as rest breaks, job rotation, and ergonomic training as the main interventions. However, traditional ergonomic training often lacks effectiveness due to design flaws. With advancements in technology, motion capture and pose estimation technologies based on Augmented Reality and Virtual Reality have been proposed as solutions, but these still have limitations such as they are not participative and are not conducted in the actual workplace. This study aimed to evaluate the effectiveness and usability of an AR pose estimation prototype intended for use as real-time visual feedback in ergonomic training at the workplace. Mediapipe Pose, a computer vision solution from Google, was used to project holograms on the bodies of participants based on a custom Rapid Upper Limb Assessment calculation on shoulders, elbows, neck and back. The participants performed a simulated task and were randomly assigned to one of two groups for practical training. AR Group (n = 5) received AR pose estimation ET with a big screen to provide visual feedback to detect postural exposures and improve technique. The Control group (n = 4) received feedback from an ergonomics specialist. The effectiveness of each ET intervention was measured using a custom time-weighted Rapid Upper Limb Assessment-based score showing positive results from both interventions, the AR pose intervention and the Control Group. The usability of the AR prototype was evaluated using the Post-study System Usability Questionnaire and Bipolar Laddering which resulted in both positive and negative points which are going to be used as input for future improvement of the AR prototype. The results of the study showed promising results in terms of the AR pose estimation prototype being effective in transferring knowledge into behavior. Overall, the AR group showed a greater learning effect than the control group. However, these results have to be taken with caution in relation to the number of participants. The study may contribute to enhancing the outcomes of ET and expanding the field of study on its potential impact on health and safety culture in organizations. The improved prototype will be tested in a real occupational context to further assess its effectiveness.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Niu, S.: Ergonomics and occupational safety and health: An ILO perspective. Appl. Ergon. 41(6), 744–753 (2010)
Punnett, L., Wegman, D.H.: Work-related musculoskeletal disorders: the epidemiologic evidence and the debate. J. Electromyogr. Kinesiol. 14(1), 13–23 (2004)
Bernard, B.P., Putz-Anderson, V.: Musculoskeletal disorders and workplace factors; a critical review of epidemiologic evidence for work-related musculoskeletal disorders of the neck, upper extremity, and low back. National Institute for Occupational Safety and Health. (97B141) (1997). https://www.cdc.gov/niosh/docs/97-141/pdfs/97-141.pdf?id=10.26616/NIOSHPUB97141
European agency for safety and health at work and IKEI and Panteia. Work-related musculoskeletal disorders: prevalence, costs and demographics in the EU. Publications Office (2019)
Bureau of labor statistics. Fact Sheet | Occupational injuries and illnesses resulting in musculoskeletal disorders (MSDs). U.S. Department of Labor (2022). https://www.bls.gov/iif/factsheets/msds.html Accessed 29 Nov 2022
International labour organization. Global trends on occupational accidents and diseases; (2015). https://www.ilo.org/legacy/english/osh/en/story_content/external_files/fs_st_1-ILO_5_en.pdf Accessed 03 Nov 2022
The national institute for occupational safety and health (NIOSH). WMSDs Step 4: Implement your Ergonomic Program (2022). https://www.cdc.gov/niosh/topics/ergonomics/ergoprimer/step4.html Accessed 29 Nov 2022
Nicholson, A., Smith, C., Mitchell, A., et al.: Cost-benefit studies that support tackling musculoskeletal disorders. Health and Safety Executive (HSE). Research report (2006)
Denadai, M.S., Alouche, S.R., Valentim, D.P., Padula, R.S.: An ergonomics educational training program to prevent work-related musculoskeletal disorders to novice and experienced workers in the poultry processing industry: a quasi-experimental study. Appl. Ergon. 90, 103234 (2021)
Burke, M.J., Sarpy, S.A., Smith-Crowe, K., Chan-Serafin, S., Salvador, R.O., Islam, G.: Relative effectiveness of worker safety and health training methods. Am. J. Public Health 96(2), 315–324 (2006)
Etuknwa, A.B., Humpheries, S.: A systematic review on the effectiveness of ergonomic training intervention in reducing the risk of musculoskeletal disorder. J. Nursing Health Stud. 03(02) (2018). https://doi.org/10.21767/2574-2825.1000032
Casey, T., Turner, N., Hu, X., Bancroft, K.: Making safety training stickier: a richer model of safety training engagement and transfer. J. Saf. Res. 78, 303–313 (2021)
McAtamney, L., Corlett, E.N.: RULA: a survey method for the investigation of work-related upper limb disorders. Appl. Ergon. 24(2), 91–99 (1993)
Diego-Mas, J.A., Alcaide-Marzal, J., Poveda-Bautista, R.: Effects of using immersive media on the effectiveness of training to prevent ergonomics risks. Int. J. Environ. Res. Public Health 17(7), 2592 (2020)
Rauh, S.F., Koller, M., Schäfer, P., Meixner, G., Bogdan, C., Viberg, O.: MR On-SeT: a mixed reality occupational health and safety training for world-wide distribution. Int. J. Emerg. Tech. Learn. (iJET). 16(05), 163 (2021)
da Silva, A.G., Winkler, I., Gomes, M.M., Pinto, U.D.M.: Ergonomic analysis supported by virtual reality: a systematic literature review. In: 2020 22nd Symposium on Virtual and Augmented Reality (SVR), IEEE (2020)
Desmarais, Y., Mottet, D., Slangen, P., Montesinos, P.: A review of 3D human pose estimation algorithms for markerless motion capture (2020)
Sauro, J., Lewis, J.R.: Standardized usability questionnaires. In: Quantifying the User Experience, Elsevier, pp. 185–248 (2016). https://doi.org/10.1016/b978-0-12-802308-2.00008-4
Pifarreacute, M., Sorribas, X., Villegas, E.: BLA (Bipolar Laddering) applied to YouTube. Performing postmodern psychology paradigms in user experience field. In: Advanced Technologies. InTech; (2009). https://doi.org/10.5772/8233
Bazarevsky, V., Grishchenko, I., Raveendran, K., Zhu, T., Zhang, F., Grundmann, M.: BlazePose: on-device real-time body pose tracking (2020)
Manghisi, V.M., Uva, A.E., Fiorentino, M., Bevilacqua, V., Trotta, G.F., Monno, G.: Real time RULA assessment using Kinect v2 sensor. Appl. Ergon. 65, 481–491 (2017)
Lewis, J.: Psychometric evaluation of the PSSUQ using data from five years of usability studies. Int. J. Hum. Comput. Interact. 09(14), 463–488 (2002)
Acknowlegdements
We would like to express our sincere gratitude to the Deutscher Akademischer Austauschdienst (DAAD) for their collaborative relationship with Heidelberg University, Heilbronn University, and Universidad de Chile, and for awarding the internship scholarship that enabled us to undertake this work. We would also like to thank the members of UniTyLab - University of Heilbronn and the Centro de Informática Médica y Telemedicina (CIMT) of the Universidad de Chile for their invaluable guidance, support, feedback, and expertise, which helped us to improve our work. Finally, we extend our special thanks to Prof. Dr. Steffen Härtel from CIMT, and Director of the Magister en Informatica Médica at the Universidad de Chile, for making this opportunity possible.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Vicente, D., Schwarz, M., Meixner, G. (2023). Improving Ergonomic Training Using Augmented Reality Feedback. In: Duffy, V.G. (eds) Digital Human Modeling and Applications in Health, Safety, Ergonomics and Risk Management. HCII 2023. Lecture Notes in Computer Science, vol 14028. Springer, Cham. https://doi.org/10.1007/978-3-031-35741-1_20
Download citation
DOI: https://doi.org/10.1007/978-3-031-35741-1_20
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-35740-4
Online ISBN: 978-3-031-35741-1
eBook Packages: Computer ScienceComputer Science (R0)