abstract

A Virtual Reality Simulator for Training Gaze Control of Wheeled Tele-Robots

Authors:

Guangtao Zhang,

John Paulin HansenAuthors Info & Claims

VRST '19: Proceedings of the 25th ACM Symposium on Virtual Reality Software and Technology

Article No.: 49, Pages 1 - 2

https://doi.org/10.1145/3359996.3364707

Published: 12 November 2019 Publication History

Get Access

Abstract

People who cannot use their hands may use eye-gaze to interact with robots. Emerging virtual reality head-mounted displays (HMD) have built-in eye-tracking sensors. Previous studies suggest that users need substantial practice for gaze steering of wheeled robots with an HMD. In this paper, we propose to apply a VR-based simulator for training of gaze-controlled robot steering. The simulator and preliminary test results are presented.

References

[1]

Robert Leeb, Luca Tonin, Martin Rohm, Lorenzo Desideri, Tom Carlson, and Jose del R Millan. 2015. Towards independence: a BCI telepresence robot for people with severe motor disabilities. Proc. IEEE 103, 6 (2015), 969–982.

Crossref

Google Scholar

[2]

Eoin MacCraith, James C Forde, and Niall F Davis. 2019. Robotic simulation training for urological trainees: a comprehensive review on cost, merits and challenges. Journal of robotic surgery(2019), 1–7.

Google Scholar

[3]

Luis Pérez, Eduardo Diez, Rubén Usamentiaga, and Daniel F García. 2019. Industrial robot control and operator training using virtual reality interfaces. Computers in Industry 109 (2019), 114–120.

Digital Library

Google Scholar

[4]

Katherine M Tsui, Kelsey Flynn, Amelia McHugh, Holly A Yanco, and David Kontak. 2013. Designing speech-based interfaces for telepresence robots for people with disabilities. In 2013 IEEE 13th International Conference on Rehabilitation Robotics (ICORR). IEEE, 1–8.

Crossref

Google Scholar

[5]

Ginger S Watson, Yiannis E Papelis, and Katheryn C Hicks. 2016. Simulation-based environment for the eye-tracking control of tele-operated mobile robots. In Proceedings of the Modeling and Simulation of Complexity in Intelligent, Adaptive and Autonomous Systems 2016 (MSCIAAS 2016) and Space Simulation for Planetary Space Exploration (SPACE 2016). Society for Computer Simulation International, 4.

Digital Library

Google Scholar

[6]

Tom Williams, Daniel Szafir, Tathagata Chakraborti, and Elizabeth Phillips. 2019. Virtual, Augmented, and Mixed Reality for Human-Robot Interaction (VAM-HRI). In 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 671–672.

Crossref

Google Scholar

[7]

Guangtao Zhang, John Paulin Hansen, and Katsumi Minakata. 2019a. Hand- and gaze-control of telepresence robots. In Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications. ACM, 70: 1– 8.

Digital Library

Google Scholar

[8]

Guangtao Zhang, John Paulin Hansen, Katsumi Minakata, Alexandre Alapetite, and Zhongyu Wang. 2019b. Eye-Gaze-Controlled Telepresence Robots for People with Motor Disabilities. In 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 574–575.

Google Scholar

Cited By

View all

Lee JKim HYang YKim G(2024)RPG: Rotation Technique in VR Locomotion using Peripheral GazeProceedings of the ACM on Human-Computer Interaction10.1145/36556098:ETRA(1-19)Online publication date: 28-May-2024
https://dl.acm.org/doi/10.1145/3655609
Alhakamy A(2024)Extended Reality (XR) Toward Building Immersive Solutions: The Key to Unlocking Industry 4.0ACM Computing Surveys10.1145/365259556:9(1-38)Online publication date: 25-Apr-2024
https://dl.acm.org/doi/10.1145/3652595
Caso S(2024)Emerging technologies in military space operations: current applications and future research for educational and training purposesInternational Journal of Training Research10.1080/14480220.2024.2431482(1-16)Online publication date: 25-Nov-2024
https://doi.org/10.1080/14480220.2024.2431482
Show More Cited By

Recommendations

Head and gaze control of a telepresence robot with an HMD
ETRA '18: Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications

Gaze interaction with telerobots is a new opportunity for wheelchair users with severe motor disabilities. We present a video showing how head-mounted displays (HMD) with gaze tracking can be used to monitor a robot that carries a 360° video camera and ...
Snap, Pursuit and Gain: Virtual Reality Viewport Control by Gaze
CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems

Head-mounted displays let users explore virtual environments through a viewport that is coupled with head movement. In this work, we investigate gaze as an alternative modality for viewport control, enabling exploration of virtual worlds with less head ...
Haptics-based virtual reality periodontal training simulator

This paper focuses upon the research and development of a prototype dental simulator for training of periodontal procedures. By the use of virtual reality and haptics technology, the periodontal simulator allows trainees to learn performing diagnosis ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

VRST '19: Proceedings of the 25th ACM Symposium on Virtual Reality Software and Technology

November 2019

498 pages

ISBN:9781450370011

DOI:10.1145/3359996

Editors:
Tomas Trescak
Western Sydney University
,
Simeon Simoff
Western Sydney University
,
Deborah Richards
Macquarie University
,
Anton Bogdanovych
Western Sydney University
,
Thierry Duval
IMT Atlantique
,
Torsten Kuhlen
RWTH Aachen University
,
Huyen Nguyen
University of New South Wales
,
Shigeo Morishima
University of Waseda
,
Yuichi Itoh
University of Osaka
,
Richard Skarbez
La Trobe
,
Anton Bogdanovych
Western Sydney University
,
Martin Masek
Edith Cowan University

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 November 2019

Check for updates

Author Tags

Qualifiers

Abstract
Research
Refereed limited

Funding Sources

Bevica Fonden
China Scholarship Council

Conference

VRST '19

Sponsor:

VRST '19: 25th ACM Symposium on Virtual Reality Software and Technology

November 12 - 15, 2019

NSW, Parramatta, Australia

Acceptance Rates

Overall Acceptance Rate 66 of 254 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
299
Total Downloads

Downloads (Last 12 months)22
Downloads (Last 6 weeks)0

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Lee JKim HYang YKim G(2024)RPG: Rotation Technique in VR Locomotion using Peripheral GazeProceedings of the ACM on Human-Computer Interaction10.1145/36556098:ETRA(1-19)Online publication date: 28-May-2024
https://dl.acm.org/doi/10.1145/3655609
Alhakamy A(2024)Extended Reality (XR) Toward Building Immersive Solutions: The Key to Unlocking Industry 4.0ACM Computing Surveys10.1145/365259556:9(1-38)Online publication date: 25-Apr-2024
https://dl.acm.org/doi/10.1145/3652595
Caso S(2024)Emerging technologies in military space operations: current applications and future research for educational and training purposesInternational Journal of Training Research10.1080/14480220.2024.2431482(1-16)Online publication date: 25-Nov-2024
https://doi.org/10.1080/14480220.2024.2431482
Zhang GHansen SBehrens OHansen J(2024)Saccade response testing during teleoperations with a head-mounted displayCognition, Technology & Work10.1007/s10111-023-00750-626:1(127-138)Online publication date: 18-Jan-2024
https://doi.org/10.1007/s10111-023-00750-6
Adhanom IMacNeilage PFolmer E(2023)Eye Tracking in Virtual Reality: a Broad Review of Applications and ChallengesVirtual Reality10.1007/s10055-022-00738-z27:2(1481-1505)Online publication date: 18-Jan-2023
https://doi.org/10.1007/s10055-022-00738-z
Plopski AHirzle TNorouzi NQian LBruder GLanglotz T(2022)The Eye in Extended Reality: A Survey on Gaze Interaction and Eye Tracking in Head-worn Extended RealityACM Computing Surveys10.1145/349120755:3(1-39)Online publication date: 25-Mar-2022
https://dl.acm.org/doi/10.1145/3491207
Poy IWu LShi B(2021)A Multimodal Direct Gaze Interface for Wheelchairs and Teleoperated Robots2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC)10.1109/EMBC46164.2021.9630471(4796-4800)Online publication date: 1-Nov-2021
https://doi.org/10.1109/EMBC46164.2021.9630471
Doolani SWessels CKanal VSevastopoulos CJaiswal ANambiappan HMakedon F(2020)A Review of Extended Reality (XR) Technologies for Manufacturing TrainingTechnologies10.3390/technologies80400778:4(77)Online publication date: 10-Dec-2020
https://doi.org/10.3390/technologies8040077
Zhang GHansen JBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)People with Motor Disabilities Using Gaze to Control TelerobotsExtended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3334480.3382939(1-9)Online publication date: 25-Apr-2020
https://dl.acm.org/doi/10.1145/3334480.3382939

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Abstract

References

Cited By

Recommendations

Head and gaze control of a telepresence robot with an HMD

Snap, Pursuit and Gain: Virtual Reality Viewport Control by Gaze

Haptics-based virtual reality periodontal training simulator

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

HTML Format

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations