More Web Proxy on the site http://driver.im/

Article

Verbalization: narration of autonomous robot experience

Authors:

Stephanie Rosenthal,

Sai P. Selvaraj,

Manuela VelosoAuthors Info & Claims

IJCAI'16: Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence

Pages 862 - 868

Published: 09 July 2016 Publication History

Abstract

Autonomous mobile robots navigate in our spaces by planning and executing routes to destinations. When a mobile robot appears at a location, there is no clear way to understand what navigational path the robot planned and experienced just by looking at it. In this work, we address the generation of narrations of autonomous mobile robot navigation experiences. We contribute the concept of verbalization as a parallel to the well-studied concept of visualization. Through verbalizations, robots can describe through language what they experience, in particular in their paths. For every executed path, we consider many possible verbalizations that could be generated. We introduce the verbalization space that covers the variability of utterances that the robot may use to narrate its experience to different humans. We present an algorithm for segmenting a path and mapping each segment to an utterance, as a function of the desired point in the verbalization space, and demonstrate its application using our mobile service robot moving in our buildings. We believe our verbalization space and algorithm are applicable to different narrative aspects for many mobile robots, including autonomous cars.

References

[1]

Nicholas D Allen, John R Templon, Patrick Summerhays McNally, Larry Birnbaum, and Kristian J Hammond. Statsmonkey: A data-driven sports narrative writer. In AAAI Fall Symposium: Computational Models of Narrative , 2010.

[2]

Robert Belvin, Ron Burns, and Cheryl Hein. Development of the hrl route navigation dialogue system. In Proceedings of the first international conference on Human language technology research , pages 1-5. Association for Computational Linguistics, 2001.

Digital Library

[3]

Joydeep Biswas and Manuela Veloso. Localization and Navigation of the CoBots over Long-term Deployments. International Journal of Robotics Research , 32(14):1679-1694, 2013.

Digital Library

[4]

Joydeep Biswas and Manuela Veloso. Episodic Non-Markov Localization: Reasoning about Short-Term and Long-Term Features. In Proceedings of the International Conference on Robotics and Automation , 2014.

[5]

Dan Bohus, Chit W Saw, and Eric Horvitz. Directions robot: In-the-wild experiences and lessons learned. In Proceedings of the International Conference on Autonomous Agents and Multi-Agent Systems , pages 637-644, 2014.

Digital Library

[6]

Adrian Bussone, Simone Stumpf, and Dympna O'Sullivan. The role of explanations on trust and reliance in clinical decision support systems. IEEE International Conference on Healthcare Informatics , 2015.

Digital Library

[7]

Anind K Dey. Explanations in context-aware systems. In ExaCt , pages 84-93, 2009.

[8]

Rachel Kirby, Frank Broz, Jodi Forlizzi, Marek Piotr Michalowski, Anne Mundell, Stephanie Rosenthal, Brennan Peter Sellner, Reid Simmons, Kevin Snipes, Alan Schultz, and Jue Wang. Designing robots for long-term social interaction. In Proceedings of the International Conference on Intelligent Robots and Systems , pages 2199-2204, 2005.

[9]

Todd Kulesza, Simone Stumpf, Margaret Burnett, and Irwin Kwan. Tell me more?: the effects of mental model soundness on personalizing an intelligent agent. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems , pages 1-10. ACM, 2012.

Digital Library

[10]

Todd Kulesza, Simone Stumpf, Margaret Burnett, Songping Yang, Irwin Kwan, and Weng-Keen Wong. Too much, too little, or just right? ways explanations impact end users' mental models. In Visual Languages and Human-Centric Computing (VL/HCC), 2013 IEEE Symposium on , pages 3-10. IEEE, 2013.

[11]

Brian Y Lim and Anind K Dey. Toolkit to support intelligibility in context-aware applications. In Proceedings of the 12th ACM international conference on Ubiquitous computing , pages 13-22. ACM, 2010.

Digital Library

[12]

Brian Y Lim, Anind K Dey, and Daniel Avrahami. Why and why not explanations improve the intelligibility of context-aware intelligent systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems , pages 2119-2128. ACM, 2009.

Digital Library

[13]

Linus J Luotsinen, Hans Fernlund, and Ladislau Bölöni. Automatic annotation of team actions in observations of embodied agents. In Proceedings of the 6th international joint conference on Autonomous agents and multiagent systems , page 9. ACM, 2007.

Digital Library

[14]

Alastair MacFadden, Lorin Elias, and Deborah Saucier. Males and females scan maps similarly, but give directions differently. Brain and Cognition , 53(2):297-300, 2003.

[15]

Vittorio Perera and Manuela Veloso. Handling Complex Commands for Service Robot Task Requests. In Proceedings of the International Joint Conference on Artificial Intelligence , 2015.

Digital Library

[16]

Vittorio Perera, Robin Soetens, Thomas Kollar, Mehdi Samadi, Yichao Sun, Daniele Nardi, René van de Molengraft, and Manuela Veloso. Learning task knowledge from dialog and web access. Robotics , 4(2):223-252, 2015.

[17]

Stephanie Rosenthal, Joydeep Biswas, and Manuela Veloso. An Effective Personal Mobile Robot Agent Through Symbiotic Human-Robot Interaction. In Proceedings of AAMAS'10, the Ninth International Joint Conference on Autonomous Agents and Multi-Agent Systems , Toronto, Canada, May 2010.

Digital Library

[18]

Jesse Thomason, Shiqi Zhang, Raymond Mooney, and Peter Stone. Learning to interpret natural language commands through human-robot dialog. In Proceedings of the 2015 International Joint Conference on Artificial Intelligence (IJCAI) , July 2015.

Digital Library

[19]

Manuela Veloso, Nicholas Armstrong-Crews, Sonia Chernova, Elisabeth Crawford, Colin McMillen, Maayan Roth, Douglas Vail, and Stefan Zickler. A team of humanoid game commentators. International Journal of Humanoid Robotics , 5(03):457-480, 2008.

[20]

Manuela Veloso, Joydeep Biswas, Brian Coltin, and Stephanie Rosenthal. CoBots: Robust Symbiotic Autonomous Mobile Service Robots. In Proceedings of the International Joint Conference on Artificial Intelligence , 2015.

Digital Library

[21]

Dirk Voelz, Elisabeth André, Gerd Herzog, and Thomas Rist. Rocco: A robocup soccer commentator system. In RoboCup-98 , pages 50-60. Springer, 1999.

Digital Library

[22]

Ameni Yengui and NEJI Mahmoud. Semantic annotation formalism of video-conferencing documents. Cognition and Exploratory Learning in Digital Age , 2009.

Cited By

Penney SDodge JAnderson AHilderbrand CSimpson LBurnett M(2021)The Shoutcasters, the Game Enthusiasts, and the AI: Foraging for Explanations of Real-time Strategy PlayersACM Transactions on Interactive Intelligent Systems10.1145/339604711:1(1-46)Online publication date: 15-Mar-2021
https://dl.acm.org/doi/10.1145/3396047
Chakraborti TSreedharan SKambhampati S(2019)Balancing explicability and explanations for human-aware planningProceedings of the 28th International Joint Conference on Artificial Intelligence10.5555/3367032.3367222(1335-1343)Online publication date: 10-Aug-2019
https://dl.acm.org/doi/10.5555/3367032.3367222
Wang DYang QAbdul ALim BBrewster SFitzpatrick GCox AKostakos V(2019)Designing Theory-Driven User-Centric Explainable AIProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300831(1-15)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300831
Show More Cited By

Index Terms

Verbalization: narration of autonomous robot experience

Recommendations

Dynamic generation and refinement of robot verbalization
2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN)
With a growing number of robots performing autonomously without human intervention, it is difficult to understand what the robots experience along their routes during execution without looking at execution logs. Rather than looking through logs, our goal ...
Verbalization for Business Rules and Two Flavors of Verbalization for Fact Examples
OTM '08: Proceedings of the OTM Confederated International Workshops and Posters on On the Move to Meaningful Internet Systems: 2008 Workshops: ADI, AWeSoMe, COMBEK, EI2N, IWSSA, MONET, OnToContent + QSI, ORM, PerSys, RDDS, SEMELS, and SWWS

In the literature of NIAM, ORM, CogNIAM, OWL, Business Rules and SBVR [1, 5, 7, 16, 18] one increasingly encounters the modeling process of verbalization. Most fact based conceptual analysts are aware that process models need to be extended with fact ...
A biologically inspired method for robot navigation in a cluttered environment

The problem of wheeled mobile robot (WMR) navigation toward an unknown target in a cluttered environment has been considered. The biologically inspired navigation algorithm is the equiangular navigation guidance (ENG) law combined with a local obstacle ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings

IJCAI'16: Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence

July 2016

4277 pages

ISBN:9781577357704

Editor:
Gerhard Brewka
Leipzig University, Germany

Sponsors

Sony: Sony Corporation
Arizona State University: Arizona State University
Microsoft: Microsoft
Facebook: Facebook
AI Journal: AI Journal

Publisher

AAAI Press

Publication History

Published: 09 July 2016

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 10 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Penney SDodge JAnderson AHilderbrand CSimpson LBurnett M(2021)The Shoutcasters, the Game Enthusiasts, and the AI: Foraging for Explanations of Real-time Strategy PlayersACM Transactions on Interactive Intelligent Systems10.1145/339604711:1(1-46)Online publication date: 15-Mar-2021
https://dl.acm.org/doi/10.1145/3396047
Chakraborti TSreedharan SKambhampati S(2019)Balancing explicability and explanations for human-aware planningProceedings of the 28th International Joint Conference on Artificial Intelligence10.5555/3367032.3367222(1335-1343)Online publication date: 10-Aug-2019
https://dl.acm.org/doi/10.5555/3367032.3367222
Wang DYang QAbdul ALim BBrewster SFitzpatrick GCox AKostakos V(2019)Designing Theory-Driven User-Centric Explainable AIProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300831(1-15)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300831
Huang SHeld DAbbeel PDragan A(2019)Enabling robots to communicate their objectivesAutonomous Robots10.1007/s10514-018-9771-043:2(309-326)Online publication date: 1-Feb-2019
https://dl.acm.org/doi/10.1007/s10514-018-9771-0
de Jong MZhang KRoth ARhodes TSchmucker RZhou CFerreira SCartucho JVeloso MAndre EKoenig SDastani MSukthankar G(2018)Towards a Robust Interactive and Learning Social RobotProceedings of the 17th International Conference on Autonomous Agents and MultiAgent Systems10.5555/3237383.3237831(883-891)Online publication date: 9-Jul-2018
https://dl.acm.org/doi/10.5555/3237383.3237831
Abdul AVermeulen JWang DLim BKankanhalli MMandryk RHancock MPerry MCox A(2018)Trends and Trajectories for Explainable, Accountable and Intelligible SystemsProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3174156(1-18)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3174156

View Options

View options

Media

Figures

Other

Tables

View Table of Contents