abstract

Multimodal Manipulator Control Interface using Speech and Multi-touch Gesture Recognition

Authors:

HRI'15 Extended Abstracts: Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction Extended Abstracts

Pages 21 - 22

https://doi.org/10.1145/2701973.2702000

Published: 02 March 2015 Publication History

Get Access

Abstract

In this study, we describe a novel multimodal interface to control a manipulator that uses speech and multi-touch gesture recognition. In addition, we describe our prototype system and discuss findings from a preliminary study that employs the system. The interface operates in three control modes that allow the user of a manipulator to translate, rotate, open, and close the gripper using touch gestures. The user can employ multimodal commands to switch among modes and control the manipulator. In our study, inexperienced users were able to control a 7-degree-of-freedom manipulator using the prototype interface.

References

[1]

Driessen, B. J. F., ten Kate, T. K., Liefhebber, F., Versluis, A. H. G., and van Woerden, J. A. 2005. Collaborative control of the Manus manipulator, Univ. Access Inf. Soc. 4, 2 (Dec. 2005), 165--173.

Digital Library

Google Scholar

[2]

Dune, C., Leroux, C., and Marchand, E. 2007. Intuitive human interaction with an arm robot for severely handicapped people - a one click approach. In Proceedings of the 10th IEEE International Conference on Rehabilitation Robotics (Noordwijk, The Netherlands, June 13 - 15, 2007). ICORR '07. IEEE, 582--589.

Google Scholar

[3]

Exact Dynamics http://www.exactdynamics.nl/. December 2014.

Google Scholar

[4]

Tijsma, H. A., Liefhebber, F., and Herder, J. 2005. A framework of interface improvements for designing new user interfaces for the MANUS robot arm. In Proceedings of the IEEE 9th International Conference on Rehabilitation Robotics (Chicago, IL, USA, June 28 - July 1, 2005). ICORR '05. IEEE, 1--10.

Google Scholar

[5]

Tsui, K. M., Kim, D. J., Behal, A., Kontak, D., and Yanco, H. A. 2011."I want that": human-in-the-loop control of a wheelchair-mounted robotic arm. Appl. Bion. Biom. 8, 2 (May. 2011), 127--147.

Digital Library

Google Scholar

Cited By

View all

Narayana PBeveridge JDraper B(2019)Continuous Gesture Recognition through Selective Temporal Fusion2019 International Joint Conference on Neural Networks (IJCNN)10.1109/IJCNN.2019.8852385(1-8)Online publication date: Jul-2019
https://doi.org/10.1109/IJCNN.2019.8852385
Oka TMatsushima K(2016)New design of a manipulator control interface that employs voice and multi-touch command2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI)10.1109/HRI.2016.7451819(487-488)Online publication date: Mar-2016
https://doi.org/10.1109/HRI.2016.7451819
Oka TMatsushima K(2016)Evaluation of a three-mode robotic manipulator control interface that employs voice and multi-touch commands2016 IEEE International Conference on Advanced Intelligent Mechatronics (AIM)10.1109/AIM.2016.7576755(130-135)Online publication date: Jul-2016
https://doi.org/10.1109/AIM.2016.7576755

Index Terms

Multimodal Manipulator Control Interface using Speech and Multi-touch Gesture Recognition
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

New Design of a Manipulator Control Interface That Employs Voice and Multi-Touch Command
HRI '16: The Eleventh ACM/IEEE International Conference on Human Robot Interaction

In this study, we designed a new manipulator control interface that employs voice and multi-touch commands taking into account efficiency, learnability, and usability. In this interface, one can select control modes and shortcut to commonly-used ...
Designing user interfaces for multi-touch and surface-gesture devices
CHI EA '10: CHI '10 Extended Abstracts on Human Factors in Computing Systems

Initially Designers only had a keyboard and lines of text to design. Then, the mouse enabled a richer design ecosystem with two dimensional plains of UI. Now the Design and Research communities have access to multi-touch and gestural interfaces which ...
Designing user interfaces for multi-touch and gesture devices
CHI EA '09: CHI '09 Extended Abstracts on Human Factors in Computing Systems

Initially Designers only had a keyboard and lines of text to design. Then, the mouse enabled a richer design ecosystem with two dimensional plains of UI. Now the Design and Research communities have access to multi-touch and gestural interfaces which ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

HRI'15 Extended Abstracts: Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction Extended Abstracts

March 2015

336 pages

ISBN:9781450333184

DOI:10.1145/2701973

General Chairs:
Julie A. Adams
Vanderbilt University, USA
,
William Smart
Oregon State University, USA
,
Program Chairs:
Bilge Mutlu
University of Wisconsin-Madison, USA
,
Leila Takayama
Google[x], USA

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 March 2015

Check for updates

Author Tags

Qualifiers

Abstract

Funding Sources

Japan Society for the Promotion of Science

Conference

HRI '15

Sponsor:

HRI '15: ACM/IEEE International Conference on Human-Robot Interaction

March 2 - 5, 2015

Oregon, Portland, USA

Acceptance Rates

HRI'15 Extended Abstracts Paper Acceptance Rate 92 of 102 submissions, 90%;

Overall Acceptance Rate 192 of 519 submissions, 37%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
235
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 06 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Narayana PBeveridge JDraper B(2019)Continuous Gesture Recognition through Selective Temporal Fusion2019 International Joint Conference on Neural Networks (IJCNN)10.1109/IJCNN.2019.8852385(1-8)Online publication date: Jul-2019
https://doi.org/10.1109/IJCNN.2019.8852385
Oka TMatsushima K(2016)New design of a manipulator control interface that employs voice and multi-touch command2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI)10.1109/HRI.2016.7451819(487-488)Online publication date: Mar-2016
https://doi.org/10.1109/HRI.2016.7451819
Oka TMatsushima K(2016)Evaluation of a three-mode robotic manipulator control interface that employs voice and multi-touch commands2016 IEEE International Conference on Advanced Intelligent Mechatronics (AIM)10.1109/AIM.2016.7576755(130-135)Online publication date: Jul-2016
https://doi.org/10.1109/AIM.2016.7576755

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

New Design of a Manipulator Control Interface That Employs Voice and Multi-Touch Command

Designing user interfaces for multi-touch and surface-gesture devices

Designing user interfaces for multi-touch and gesture devices