[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3396339.3396403acmotherconferencesArticle/Chapter ViewAbstractPublication PagesahConference Proceedingsconference-collections
research-article

Development of a cooperative work method based on autonomous learning of implicit instructions

Published: 27 May 2020 Publication History

Abstract

Cooperative work with wearable robotics designed as an "extended body" for the wearer has the potential to improve individual productivity regardless of the context. The final purpose of this research it to design a new communication method between the wearer and a wearable robot arm as they perform daily chores simultaneously. Among previous studies on wearable robot arms, very little quantify the magnitude of the impact of robot operation on attention distribution and psychological burden for the user. The present paper presents an approach based on the idea that the robot arm could understand human intentions by reading implicit instruction cues nested in the natural motion flow of the operator performing a task. The present paper describes an Inertial Measurement Unit (IMU) sensor data - deep learning approach that enables the robot arm to learn these cues. The validity of the method was evaluated on three indexes: implicit instruction estimation accuracy, secondary task completion quality, and cognitive burden for the wearer. Results showed considerable improvement on all these proposed axes compared to other explicit operation methods (such as voice instructions), along with better results than similar implicit instruction-based researches.

References

[1]
V. M. Becerra, S. Member, and J. R. Llata, "Working Together : A Review on Safe Human-Robot Collaboration in Industrial Environments," vol. 5, 2017.
[2]
K. KASE, K. SUZUKI, P.-C. YANG, and T. OGATA, "Put-In-Box task generated from multiple discrete tasks by humanoid robot using deep learning," Proc. JSME Annu. Conf. Robot. Mechatronics, vol. 2017, no. 0, p. 1P2--N07, 2017.
[3]
P. Yang, K. Sasaki, K. Suzuki, K. Kase, S. Sugano, and T. Ogata, "Repeatable Folding Task by Humanoid Robot Worker Using Deep Learning," vol. 2, no. 2, pp. 397--403, 2017.
[4]
A. M. Zanchettin, N. M. Ceriani, P. Rocco, H. Ding, and B. Matthias, "Safety in Human-Robot Collaborative Manufacturing Environments: Metrics and Control," IEEE Trans. Autom. Sci. Eng., vol. 13, no. 2, pp. 882--893, 2016.
[5]
M. F. Schwartz, E. S. Edwards, M. Montomery, C. Palmer, and N. H. Mayer, "The quantitative description of axtion desorganization after brain damage: A case stugy," Cogn. Neuropsychol., vol. 8, pp. 381--414, 1991.
[6]
B. L. Sturm, "A Simple Method to Determine if a Music Information Retrieval System is a `Horse,'" vol. 16, no. 6, pp. 1636--1644, 2014.
[7]
F. Paas, J. E. Touvienen, H. Tabbers, and P. W. M. Van Gervern, "Cognitive Load Measurement as a Means to Advanced Cognitive Load Theory," vol. 38, no. 1, pp. 1--7, 2003.
[8]
T. Nishimoto, M. Takayama, and M. Araki, "An Evaluation Method of cognitive Load for the Voice Interface Systems," 2003.
[9]
F. A. Haji, D. Rojas, R. Childs, S. De Ribaupierre, and A. Dubrowski, "cognitive workload Measuring cognitive load : performance, mental effort and simulation task complexity," pp. 815--827, 2015.
[10]
I. ATR-Promotions, "TSND151," 2014. [Online]. Available: https://www.atrp.com/products/TSND121.html.
[11]
K. Kurihara, I. Science, and K. Tsukada, "SpeechJammer: A System Utilizing Artificial Speech Disturbance with Delayed Auditory Feedback.".
[12]
Š. Ê. M, "Subjective Evaluation of Perception of Delay Time between Visual Information and Tactile Information," vol. 49, no. 10, pp. 1353--1356, 1995.
[13]
T. Iwata, T. Yamabe, and T. Nakajima "Workload evaluation of information cognition in a multi-task environment," IPSJ research report, vol. 2009, no. 8 pp. 1--8, 2009.
[14]
K. Kaneda, M. Sugaya, T. Sato, and T. Amino "Long-Term Motor Practice in Basketball Players Alters Event-Related Brain Potential and Performance of Dual Task," 2017.
[15]
S. G. Hart and L. E. Staveland, "Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research," in Human Mental Workload, vol. 52, P. A. Hancock and N. B. T.-A. in P. Meshkati, Eds. North-Holland, 1988, pp. 139--183.
[16]
S. Haga and N. Mizukami, "Japanese version of NASA Task Load Index: Sensitvity of its workload score to difficulty of three different laboratory tasks, "The Japanese Journal of Ergonomics, vol. 32, no. 2, 1996.
[17]
Y. Hayakawa, T. Ogata, and S. Sugano, "Flexible assembly work cooperation based on work state identifications by a self-organizing map Flexible Assembly Work Cooperation based on Work State Identifications by a Self-Organizing Map," no. August, 2003.
[18]
K. Kobayashi, "Human-Robot Cooperative Sweeping by Extending Commands Embedded in Actions".
[19]
Y. Iwasaki and H. Iwata, "Study on the [third arm] that allows intuitive voluntary operation-analysis of cognitive load required for matching onboard motion function and scene request function," Waseda University, 2018

Cited By

View all
  • (2022)Cyborgs, Human Augmentation, Cybernetics, and JIZAI BodyProceedings of the Augmented Humans International Conference 202210.1145/3519391.3519401(230-242)Online publication date: 13-Mar-2022

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences
AH '20: Proceedings of the 11th Augmented Human International Conference
May 2020
151 pages
ISBN:9781450377287
DOI:10.1145/3396339
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 May 2020

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. IMU sensor
  2. deep learning
  3. interface design
  4. robot collaboration
  5. robot control

Qualifiers

  • Research-article

Conference

AH '20
AH '20: 11th Augmented Human International Conference
May 27 - 29, 2020
Manitoba, Winnipeg, Canada

Acceptance Rates

Overall Acceptance Rate 121 of 306 submissions, 40%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)7
  • Downloads (Last 6 weeks)0
Reflects downloads up to 13 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2022)Cyborgs, Human Augmentation, Cybernetics, and JIZAI BodyProceedings of the Augmented Humans International Conference 202210.1145/3519391.3519401(230-242)Online publication date: 13-Mar-2022

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media