More Web Proxy on the site http://driver.im/

Article

Effects of Reliance Support on Team Performance by Advising and Adaptive Autonomy

Authors:

Peter-Paul van Maanen,

Francien Wisse,

Jurriaan van Diggelen,

Robbert-Jan BeunAuthors Info & Claims

WI-IAT '11: Proceedings of the 2011 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology - Volume 02

Pages 280 - 287

https://doi.org/10.1109/WI-IAT.2011.117

Published: 22 August 2011 Publication History

Abstract

Problems with estimating trust in information sources are common in time constraining and ambiguous situations and often lead to a decrease of team performance. Humans lack the resources to track the integrity of information and thus tend to over- or under-rely on advice from support systems. Two types of adaptive team support have been developed and evaluated that are intended to support human-computer teams in estimating trust appropriately and making appropriate reliance decisions thereof. The first adaptive system (graphical support) supports by communicating the estimated degree of over- or under-trust. The second system (adaptive autonomy) takes over a reliance decision when this estimation exceeds a certain threshold. The two types of support were implemented in a multi-agent environment where human operators and Unmanned Aerial Vehicles (UAVs) work together on a target classification task. We evaluated the two support types in terms of team performance, satisfaction and effectiveness and obtained promising results.

References

[1]

M. Grootjen and M. Neerincx, "Operator load management during task execution in process control," in Human Factors Impact on Ship Design, 2005.

[2]

J. Lee and N. Moray, "Trust, control strategies, and allocation of function in human-machine systems," Ergonomics, vol. 35, pp. 1243-1270, 1992.

[3]

----, "Trust, self-confidence, and operators' adaption to automation," International Journal of Human-Computer Studies, vol. 40, pp. 153- 184, 1994.

Digital Library

[4]

B. M. Muir, "Trust between human and machines, and the design of decision aids," International Journal of Man-Machine Studies, vol. 27, no. 5-6, pp. 527-539, 1987.

Digital Library

[5]

----, "Trust in automation: Part i. theoretical issues in the study of trust and human intervention in automated systems," Ergonomics, vol. 37, no. 11, pp. 1905-1922, 1994.

[6]

B. M. Muir and N. Moray, "Trust in automation, part ii. experimental studies of trust and human intervention in a process control simulation," Ergonomics, vol. 39, no. 3, pp. 429-460, 1996.

[7]

R. Parasuraman and V. A. Riley, "Humans and automation: Use, misuse, disuse, abuse," Human Factors, vol. 39, pp. 230-253, 1997.

[8]

J. D. Lee and K. A. See, "Trust in automation: Designing for appropriate reliance," Human Factors, vol. 46, no. 1, pp. 50-80, 2004.

[9]

K. van Dongen and P.-P. van Maanen, "Under-reliance on the decision aid: A difference in calibration and attribution between self and aid," in Proceedings of the Human Factors and Ergonomics Society's 50th Annual Meeting, 2006.

[10]

L. J. Skitka, K. L. Mosier, and M. Burdick, "Does automation bias decision-making?" International Journal of Human-Computer Studies, vol. 51, no. 5, pp. 991-1006, 1999.

Digital Library

[11]

M. T. Dzindolet, L. G. Pierce, H. P. Beck, and L. A. Dawe, "Misuse and disuse of automated aids," in Proceedings of the Human Factors Society 43rd Annual Meeting, Santa Monica, CA, 1999, pp. 339-343.

[12]

P.-P. van Maanen, T. Klos, and K. van Dongen, "Aiding human reliance decision making using computational models of trust," in Proceedings of the Workshop on Communication between Human and Artificial Agents (CHAA'07). Fremont, California, USA: IEEE Computer Society Press, 2007, pp. 372-376, co-located with The 2007 IEEE IAT/WIC/ACM International Conference on Intelligent Agent Technology.

Digital Library

[13]

P.-P. van Maanen and K. van Dongen, "Towards task allocation decision support by means of cognitive modeling of trust," in Proceedings of the Eighth International Workshop on Trust in Agent Societies (Trust 2005), C. Castelfranchi, S. Barber, J. Sabater, and M. Singh, Eds., jul 2005, pp. 168-77.

[14]

M. T. Brannick, E. Salas, and C. Prince, Eds., Team Performance Assessment and Measurement: Theory, Methods, and Applications. Mahwah, NJ: Lawrence Erlbaum Associates, 1997.

[15]

C. Castelfranchi and R. Falcone, "Principles of trust for MAS: Cognitive anatomy, social importance, and quantification," in Proceedings of 3rd International Conference on MultiAgent Systems, 1998, pp. 72-79.

Digital Library

[16]

M. Hoogendoorn, S. W. Jaffry, and P.-P. van maanen, "Validation of agent models of trust: Independent compared to relative trust," 2010, submitted to conference.

[17]

G. A. Dorais, R. P. Bonasso, D. Kortenkamp, B. Pell, and D. Schreckenghost, "Adjustable autonomy for human-centered autonomous systems on mars," in Proceedings of the First International Conference of the Mars Society, 1998.

[18]

R. Parasuraman, T. B. Sheridan, and C. D. Wickens, "A model for types and levels of human interaction with automation," IEEE Transactions on Systems, Man, and Cybernetics, vol. 30, pp. 286-297, 2000.

Digital Library

[19]

J. B. Rotter, "General expectancies for internal versus external control of reinforcement," Psychological Monographs: General and Applied, vol. 80, no. 1, 1966, whole no. 609.

[20]

J. M. McGuirl and N. B. Sarter, "Supporting trust calibration and the effective use of decision aids by presenting dynamic system confidence information," Human Factors, vol. 48, no. 4, pp. 656-665, 2006.

[21]

L. Bartram, C. Ware, and T. Calvert, "Moticons: detection distraction and task," International Journal of Human-Computer Studies, vol. 58, no. 5, pp. 515-545, 2003.

Digital Library

[22]

M. Hoogendoorn, S. Jaffry, and J. Treur, "Modeling dynamics of relative trust of competitive information agents," in Proceedings of the 12th International Workshop on Cooperative Information Agents (CIA'08), ser. LNAI, M. Klusch, M. Pechoucek, and A. Polleres, Eds., vol. 5180. Springer, 2008, pp. 55-70.

Digital Library

[23]

C. M. Jonker and J. Treur, "Formal analysis of models for the dynamics of trust based on experiences," in Multi-Agent System Engineering, Proceedings of the 9th European Workshop on Modelling Autonomous Agents in a Multi-Agent World, MAAMAW'99, F. J. Garijo and M. Boman, Eds., vol. 1647. Berlin: Springer Verlag, 1998, pp. 221-232.

Digital Library

[24]

R. Parasuraman, M. Mouloua, and R. Molloy, "Effects of adaptive task allocation on monitoring of automated systems," Human Factors, vol. 38, no. 4, pp. 665-679, 1996.

Cited By

Vereschak OAlizadeh FBailly GCaramiaux B(2024)Trust in AI-assisted Decision Making: Perspectives from Those Behind the System and Those for Whom the Decision is MadeProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642018(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642018
Williams KYuh MJain N(2023)A Computational Model of Coupled Human Trust and Self-confidence DynamicsACM Transactions on Human-Robot Interaction10.1145/359471512:3(1-29)Online publication date: 23-Jun-2023
https://dl.acm.org/doi/10.1145/3594715
Vereschak OBailly GCaramiaux B(2021)How to Evaluate Trust in AI-Assisted Decision Making? A Survey of Empirical MethodologiesProceedings of the ACM on Human-Computer Interaction10.1145/34760685:CSCW2(1-39)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3476068

Index Terms

Effects of Reliance Support on Team Performance by Advising and Adaptive Autonomy

Recommendations

Brains or Beauty: How to Engender Trust in User-Agent Interactions
Special Issue on Affect and Interaction in Agent-based Systems and Social Media and Regular Paper

Software-based agents are becoming increasingly ubiquitous and automated. However, current technology and algorithms are still fallible, which considerably affects users’ trust and interaction with such agents. In this article, we investigate two ...
Simulating rational social normative trust, predictive trust, and predictive reliance between agents

A program for the simulation of rational social normative trust, predictive `trust,' and predictive reliance between agents will be introduced. It offers a tool for social scientists or a trust component for multi-agent simulations/multi-agent systems, which ...
The effects of personalizaion and familiarity on trust and adoption of recommendation agents

In the context of personalization technologies, such as Web-based product-brokering recommendation agents (RAs) in electronic commerce, existing technology acceptance theories need to be expanded to take into account not only the cognitive beliefs ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

WI-IAT '11: Proceedings of the 2011 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology - Volume 02

August 2011

457 pages

ISBN:9780769545134

Sponsors

SIGAI: ACM Special Interest Group on Artificial Intelligence

Publisher

IEEE Computer Society

United States

Publication History

Published: 22 August 2011

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
55
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)0

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Vereschak OAlizadeh FBailly GCaramiaux B(2024)Trust in AI-assisted Decision Making: Perspectives from Those Behind the System and Those for Whom the Decision is MadeProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642018(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642018
Williams KYuh MJain N(2023)A Computational Model of Coupled Human Trust and Self-confidence DynamicsACM Transactions on Human-Robot Interaction10.1145/359471512:3(1-29)Online publication date: 23-Jun-2023
https://dl.acm.org/doi/10.1145/3594715
Vereschak OBailly GCaramiaux B(2021)How to Evaluate Trust in AI-Assisted Decision Making? A Survey of Empirical MethodologiesProceedings of the ACM on Human-Computer Interaction10.1145/34760685:CSCW2(1-39)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3476068

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten