abstract

New Design of a Manipulator Control Interface That Employs Voice and Multi-Touch Command

Authors:

Tetsushi Oka,

Keisuke MatsushimaAuthors Info & Claims

HRI '16: The Eleventh ACM/IEEE International Conference on Human Robot Interaction

Pages 487 - 488

Published: 07 March 2016 Publication History

Get Access

Abstract

In this study, we designed a new manipulator control interface that employs voice and multi-touch commands taking into account efficiency, learnability, and usability. In this interface, one can select control modes and shortcut to commonly-used manipulator configurations by issuing voice commands. In each control mode, one can employ intuitive multi-touch actions in order to command gripper speed and movements. We implemented the first version of the control interface and conducted an initial evaluation of the system. Some experienced users were able to control a seven-degree-of-freedom manipulator and complete some tasks fairly efficiently, without help of others or notes. In addition, eight novice users were able to pick up a pencil and put it in a pen stand more efficiently using the new interface than some existing manipulator control interfaces.

References

[1]

P. F. Hokayem and M. W. Spong, "Bilateral teleoperation: An historical survey," Automatica, vol. 42, no. 12, pp. 2035--2057, 2006.

Digital Library

Google Scholar

[2]

J. Kofman, X. Wu, T. J. Luu, and S. Verma, "Teleoperation of a robot manipulator using a vision-based human-robot interface," IEEE Trans. Industrial Electronics, vol. 52, no. 5, pp. 1206--1219, 2005.

Crossref

Google Scholar

[3]

H. Jiang, T. Zhang, J. P. Wachs, and B. S. Duerstock, "Autonomous performance of multistep activities with a wheelchair mounted robotic manipulator using body dependent positioning," in Workshop on Assistive Robotics for Individuals with Disabilities: HRI Issues and Beyond, IEEE/RSJ Int. Conf. Intell. Robots and Systems, 2014.

Google Scholar

[4]

C. H. Chung, H. Wang, and R. A. Cooper, "Functional assessment and performance evaluation for assistive robotic manipulators: Literature review," J. Spinal Cord Medicine, vol. 36, no. 4, pp. 273--289, 2013.

Crossref

Google Scholar

[5]

H. Tijsma, F. Liefhebber, and J. L. Herder, "A framework of interface improvements for designing new user interfaces for the MANUS robot arm," in Proc. IEEE 9th Int. Conf. Rehabilitation Robotics, Chicago, 2005, pp. 235--240.

Google Scholar

[6]

K. M. Tsui, D.-J. Kim, A. Behal, D. Kontak, and H. A. Yanco, "I want that: Human-in-the-loop control of a wheelchair-mounted robotic arm," Applied Bionics and Biomechanics, vol. 8, no. 1, pp. 127--147, 2011.

Digital Library

Google Scholar

[7]

C. P. Quintero, O. Ramirez, and M. Jagersand, "VIBI: Assistive vision-based interface for robot manipulation," in Proc. 2015 IEEE Int. Conf. Robotics and Automation, Seattle, 2015, pp. 4458--4463.

Crossref

Google Scholar

[8]

C. S. Chung, J. Boninger, H. Wang, and R. A. Cooper, "The Jacontrol: Development of a smartphone interface for the assistive robotic manipulator," in Proc. the Rehabilitation Engineering and Assistive Technology Society of North America Annu. Conf., 2015, Denver, 2015.

Google Scholar

[9]

H. Jiang, J. P. Wachs, M. Pendergast, and B. S. Duerstock, "3D joystick for robotic arm control by individuals with high level spinal cord injuries," in Proc. 2013 IEEE Int. Conf. Rehabilitation Robotics, Seattle, 2013, pp. 1--5.

Crossref

Google Scholar

[10]

T. Oka and K. Matsushima, "Multimodal manipulator control interface using speech and multi-touch gesture recognition," in Proc. the 10th Annu. ACM/IEEE Int. Conf. Human-Robot Interaction Extended Abstracts, Portland, 2015, pp. 21--22.

Digital Library

Google Scholar

Cited By

View all

Johansen SDonovan JRittenbruch MCastellano GRiek LCakmak MLeite I(2023)Illustrating Robot MovementsProceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3568162.3576956(231-242)Online publication date: 13-Mar-2023
https://dl.acm.org/doi/10.1145/3568162.3576956
Law EHagenberg AHall LTurner P(2017)Clinicians' attitudes and practices on technology-supported notetakingProceedings of the 31st British Computer Society Human Computer Interaction Conference10.14236/ewic/HCI2017.56(1-12)Online publication date: 3-Jul-2017
https://dl.acm.org/doi/10.14236/ewic/HCI2017.56
Oka TIchikawa KMutlu BTscheligi MWeiss AYoung J(2017)Evaluation of a Manipulator Control Interface That Employs Touch Gestures and Voice ShortcutsProceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3029798.3038323(235-236)Online publication date: 6-Mar-2017
https://dl.acm.org/doi/10.1145/3029798.3038323

Index Terms

New Design of a Manipulator Control Interface That Employs Voice and Multi-Touch Command
1. Computing methodologies
  1. Artificial intelligence
    1. Planning and scheduling
      1. Robotic planning
2. Human-centered computing
  1. Interaction design
    1. Interaction design process and methods
      1. User interface design

Recommendations

Multimodal Manipulator Control Interface using Speech and Multi-touch Gesture Recognition
HRI'15 Extended Abstracts: Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction Extended Abstracts

In this study, we describe a novel multimodal interface to control a manipulator that uses speech and multi-touch gesture recognition. In addition, we describe our prototype system and discuss findings from a preliminary study that employs the system. ...
Evaluation of a Manipulator Control Interface That Employs Touch Gestures and Voice Shortcuts
HRI '17: Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction

In this study, we evaluated a multimodal manipulator control interface that employs touch gestures and voice shortcuts. This interface allows a human operator to translate, rotate, open and close the gripper of a seven-degree-of-freedom robotic ...
Evaluation of a three-mode robotic manipulator control interface that employs voice and multi-touch commands
2016 IEEE International Conference on Advanced Intelligent Mechatronics (AIM)
In this paper, we present a user study of a multimodal interface to control a robotic manipulator that employs voice and multi-touch commands. We have designed and implemented a new interface based on the results of a pilot study. This interface operates ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

HRI '16: The Eleventh ACM/IEEE International Conference on Human Robot Interaction

March 2016

676 pages

ISBN:9781467383707

General Chairs:
Christoph Bartneck
University of Canterbury, New Zealand
,
Yukie Nagai
Osaka University, Japan
,
Program Chairs:
Ana Paiva
Technical University of Lisbon, Portugal
,
Selma Šabanović
Indiana University Bloomington, USA

In-Cooperation

AAAI: American Association for Artificial Intelligence
Human Factors & Ergonomics Soc: Human Factors & Ergonomics Soc

Publisher

IEEE Press

Publication History

Published: 07 March 2016

Check for updates

Author Tags

Qualifiers

Abstract

Funding Sources

The Japan Society for the Promotion of Science

Conference

HRI '16

Sponsor:

HRI '16: ACM/IEEE International Conference on Human-Robot Interaction

March 7 - 10, 2016

Christchurch, New Zealand

Acceptance Rates

HRI '16 Paper Acceptance Rate 45 of 181 submissions, 25%;

Overall Acceptance Rate 268 of 1,124 submissions, 24%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
112
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 21 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Johansen SDonovan JRittenbruch MCastellano GRiek LCakmak MLeite I(2023)Illustrating Robot MovementsProceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3568162.3576956(231-242)Online publication date: 13-Mar-2023
https://dl.acm.org/doi/10.1145/3568162.3576956
Law EHagenberg AHall LTurner P(2017)Clinicians' attitudes and practices on technology-supported notetakingProceedings of the 31st British Computer Society Human Computer Interaction Conference10.14236/ewic/HCI2017.56(1-12)Online publication date: 3-Jul-2017
https://dl.acm.org/doi/10.14236/ewic/HCI2017.56
Oka TIchikawa KMutlu BTscheligi MWeiss AYoung J(2017)Evaluation of a Manipulator Control Interface That Employs Touch Gestures and Voice ShortcutsProceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3029798.3038323(235-236)Online publication date: 6-Mar-2017
https://dl.acm.org/doi/10.1145/3029798.3038323

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Multimodal Manipulator Control Interface using Speech and Multi-touch Gesture Recognition

Evaluation of a Manipulator Control Interface That Employs Touch Gestures and Voice Shortcuts

Evaluation of a three-mode robotic manipulator control interface that employs voice and multi-touch commands