abstract

Challenges of a Real-World HRI Study with Non-Native English Speakers: Can Personalisation Save the Day?

Authors:

Bahar Irfan,

Mehdi Hellou,

Alexandre Mazel,

Tony BelpaemeAuthors Info & Claims

HRI '20: Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction

Pages 272 - 274

https://doi.org/10.1145/3371382.3378278

Published: 01 April 2020 Publication History

Get Access

Abstract

Real-world studies allow for testing the limits of HRI systems and observing how people react to failures. We developed a fully autonomous personalised barista robot and deployed the robot on an international student campus for five days. We experienced several challenges, the most important one being speech recognition failures due to foreign accents. Nonetheless, these failures showed a different perspective on HRI, and we demonstrate how personalisation can overcome a negative user experience.

References

[1]

Antoine Bordes, Y-Lan Boureau, and Jason Weston. 2016. Learning End-to-End Goal-Oriented Dialog. arxiv: cs.CL/1605.07683

Google Scholar

[2]

Nikhil Churamani, Paul Anton, Marc Brügger, Erik Flieundefinedwasser, Thomas Hummel, Julius Mayer, Waleed Mustafa, Hwei Geok Ng, Thi Linh Chi Nguyen, Quan Nguyen, and et al. 2017. The Impact of Personalisation on Human-Robot Interaction in Learning Scenarios. In Proceedings of the 5th International Conference on Human Agent Interaction. Association for Computing Machinery, New York, NY, USA, 171----180. https://doi.org/10.1145/3125739.3125756

Digital Library

Google Scholar

[3]

Christian Dondrup, Lynne Baillie, Frank Broz, and Katrin Lohan. 2018. How can we transition from lab to the real world with our HCI and HRI setups? In 2018 ACM/IEEE International Conference on Human-Robot Interaction, 4th Workshop on Public Space Human-Robot Interaction: MobileHRI: Mobile human-robot interaction . Chicago, IL, USA.

Google Scholar

[4]

Bahar Irfan, Natalia Lyubova, Michael Garcia Ortiz, and Tony Belpaeme. 2018. Multi-modal Open-Set Person Identification in HRI. In 2018 ACM/IEEE International Conference on Human-Robot Interaction Social Robots in the Wild workshop . Chicago, IL, USA.

Google Scholar

[5]

Bahar Irfan, Aditi Ramachandran, Samuel Spaulding, Dylan F. Glas, Iolanda Leite, and Kheng Lee Koay. 2019. Personalization in Long-Term Human-Robot Interaction. In 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, Daegu, South Korea, 685--686. https://doi.org/10.1109/HRI.2019.8673076

Crossref

Google Scholar

[6]

Harold Jeffreys. 1939. Theory of probability 1 ed.). The Clarendon Press, Oxford.

Google Scholar

[7]

Zerrin Kasap and Nadia Magnenat-Thalmann. 2012. Building Long-Term Relationships with Virtual and Robotic Characters: The Role of Remembering. Vis. Comput., Vol. 28, 1 (2012), 87--97. https://doi.org/10.1007/s00371-011-0630--7

Crossref

Google Scholar

[8]

James Kennedy, Séverin Lemaignan, Caroline Montassier, Pauline Lavalade, Bahar Irfan, Fotios Papadopoulos, Emmanuel Senft, and Tony Belpaeme. 2017. Child Speech Recognition in Human-Robot Interaction: Evaluations and Recommendations. In Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction . ACM, Vienna, Austria, 82--90. https://doi.org/10.1145/2909824.3020229

Digital Library

Google Scholar

[9]

Xiqian Zheng, Dylan F. Glas, Takashi Minato, and Hiroshi Ishiguro. 2019. Four memory categories to support socially- appropriate conversations in long-term HRI. In 2019 ACM/IEEE International Conference on Human-Robot Interaction Personalization in Long-Term Human-Robot Interaction (PLOT-HRI19) workshop. Daegu, South Korea.

Google Scholar

Cited By

View all

Abbate LGermak C(2024)Human-Robot-Human: The Natural Dimension of the Telepresence Robotics DesignFor Nature/With Nature: New Sustainable Design Scenarios10.1007/978-3-031-53122-4_38(637-656)Online publication date: 4-May-2024
https://doi.org/10.1007/978-3-031-53122-4_38
Papakyriakopoulos OChoi AThong WZhao DAndrews JBourke RXiang AKoenecke A(2023)Augmented Datasheets for Speech Datasets and Ethical Decision-MakingProceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency10.1145/3593013.3594049(881-904)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3593013.3594049
Irfan BRamachandran AStaffa MGunes HCastellano GRiek LCakmak MLeite I(2023)Lifelong Learning and Personalization in Long-Term Human-Robot Interaction (LEAP-HRI)Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3568294.3579956(929-931)Online publication date: 13-Mar-2023
https://dl.acm.org/doi/10.1145/3568294.3579956
Show More Cited By

Index Terms

Challenges of a Real-World HRI Study with Non-Native English Speakers: Can Personalisation Save the Day?

Recommendations

English lexical stress produced by native (L1) Bengali speakers compared to native (L1) English speakers: an acoustic study

English lexical stress is acoustically related to combination of duration, intensity, fundamental frequency (F0) and vowel quality. Errors in any or all of these correlates could interfere with production of the stress contrast, but it is unknown which ...
Phonetic realization of English lexical stress by native (L1) Bengali speakers compared to native (L1) English speakers

Compares the use of acoustic correlates in the production of English lexical stress by English and Bengali speakers.Bengali speakers able to approximate English like patterns of duration, intensity, F0 of stressed and unstressed vowels.It is very ...
English Vowel Production by Native Mandarin and Hindi Speakers
ITNG '10: Proceedings of the 2010 Seventh International Conference on Information Technology: New Generations

Research into pronunciation and acoustic properties of foreign speech have evolved with technology and produced interesting results. The production of English vowel sounds by native Mandarin and Hindi speakers were investigated. The first three formant ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

HRI '20: Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction

March 2020

702 pages

ISBN:9781450370578

DOI:10.1145/3371382

General Chairs:
Tony Belpaeme
Ghent University, Belgium
,
James Young
University of Manitoba, Canada
,
Program Chairs:
Hatice Gunes
University of Cambridge, UK
,
Laurel Riek
UC San Diego, USA

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 April 2020

Check for updates

Author Tags

Qualifiers

Abstract

Funding Sources

H2020 Marie Sk?odowska-Curie Actions

Conference

HRI '20

Sponsor:

HRI '20: ACM/IEEE International Conference on Human-Robot Interaction

March 23 - 26, 2020

Cambridge, United Kingdom

Acceptance Rates

Overall Acceptance Rate 192 of 519 submissions, 37%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
242
Total Downloads

Downloads (Last 12 months)20
Downloads (Last 6 weeks)9

Reflects downloads up to 12 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Abbate LGermak C(2024)Human-Robot-Human: The Natural Dimension of the Telepresence Robotics DesignFor Nature/With Nature: New Sustainable Design Scenarios10.1007/978-3-031-53122-4_38(637-656)Online publication date: 4-May-2024
https://doi.org/10.1007/978-3-031-53122-4_38
Papakyriakopoulos OChoi AThong WZhao DAndrews JBourke RXiang AKoenecke A(2023)Augmented Datasheets for Speech Datasets and Ethical Decision-MakingProceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency10.1145/3593013.3594049(881-904)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3593013.3594049
Irfan BRamachandran AStaffa MGunes HCastellano GRiek LCakmak MLeite I(2023)Lifelong Learning and Personalization in Long-Term Human-Robot Interaction (LEAP-HRI)Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3568294.3579956(929-931)Online publication date: 13-Mar-2023
https://dl.acm.org/doi/10.1145/3568294.3579956
Ross MBroz FBaillie L(2023) Individual Squash Training is More Effective and Social with a Humanoid Robotic Coach * 2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)10.1109/RO-MAN57019.2023.10309567(621-626)Online publication date: 28-Aug-2023
https://doi.org/10.1109/RO-MAN57019.2023.10309567
Irfan BRamachandran ASpaulding SParisi GGunes HSakamoto DWeiss AHiatt LShiomi M(2022)Lifelong Learning and Personalization in Long-Term Human-Robot Interaction (LEAP-HRI)Proceedings of the 2022 ACM/IEEE International Conference on Human-Robot Interaction10.5555/3523760.3523998(1261-1264)Online publication date: 7-Mar-2022
https://dl.acm.org/doi/10.5555/3523760.3523998
Seaborn KFrank A(2022)What Pronouns for Pepper? A Critical Review of Gender/ing in ResearchProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501996(1-15)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501996
Irfan BRamachandran ASpaulding SParisi GGunes H(2022)Lifelong Learning and Personalization in Long-Term Human-Robot Interaction (LEAP-HRI)2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI)10.1109/HRI53351.2022.9889477(1261-1264)Online publication date: 7-Mar-2022
https://doi.org/10.1109/HRI53351.2022.9889477
Hellou MLim JGasteiger NJang MAhn H(2022)Technical Methods for Social Robots in Museum Settings: An Overview of the LiteratureInternational Journal of Social Robotics10.1007/s12369-022-00904-y14:8(1767-1786)Online publication date: 9-Aug-2022
https://doi.org/10.1007/s12369-022-00904-y
Irfan BCéspedes NCasas JSenft EGutiérrez LRincon-Roncancio MCifuentes CBelpaeme TMúnera M(2022)Personalised socially assistive robot for cardiac rehabilitation: Critical reflections on long-term interactions in the real worldUser Modeling and User-Adapted Interaction10.1007/s11257-022-09323-033:2(497-544)Online publication date: 19-Jul-2022
https://doi.org/10.1007/s11257-022-09323-0
Irfan BHellou MBelpaeme T(2021)Coffee With a Hint of Data: Towards Using Data-Driven Approaches in Personalised Long-Term InteractionsFrontiers in Robotics and AI10.3389/frobt.2021.6768148Online publication date: 28-Sep-2021
https://doi.org/10.3389/frobt.2021.676814
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

English lexical stress produced by native (L1) Bengali speakers compared to native (L1) English speakers: an acoustic study

Phonetic realization of English lexical stress by native (L1) Bengali speakers compared to native (L1) English speakers

English Vowel Production by Native Mandarin and Hindi Speakers