Towards Ethical AI: Empirically Investigating Dimensions of AI Ethics, Trust, and Performance in Human-AI Teaming
Beau G. Schelble, Jeremy Lopez, Claire Textor, Rui Zhang, Nathan J. McNeese, Richard Pak, Guo Freeman
Human Factors, 66(4), 1037-1055 (2022)
Abstract
Objective: Determining the efficacy of two trust repair strategies (apology and denial) for trust violations of an ethical nature by an autonomous teammate. Background: While ethics in human-AI interaction is extensively studied, little research has investigated how decisions with ethical implications impact trust and performance within human-AI teams and their subsequent repair. Method: Forty teams of two participants and one autonomous teammate completed three team missions within a synthetic task environment. The autonomous teammate made an ethical or unethical action during each mission, followed by an apology or denial. Measures of individual team trust, autonomous teammate trust, human teammate trust, perceived autonomous teammate ethicality, and team performance were taken. Results: Teams with unethical autonomous teammates had significantly lower trust in the team and trust in the autonomous teammate. Unethical autonomous teammates were also perceived as substantially more unethical. Neither trust repair strategy effectively restored trust after an ethical violation, and autonomous teammate ethicality was not related to the team score, but unethical autonomous teammates did have shorter times. Conclusion: Ethical violations significantly harm trust in the overall team and autonomous teammate but do not negatively impact team score. However, current trust repair strategies like apologies and denials appear ineffective in restoring trust after this type of violation. Application: This research highlights the need to develop trust repair strategies specific to human-AI teams and trust violations of an ethical nature.
Read online
Open full screen ↗Read the paper
The full author-version PDF is free. It opens in your browser's PDF viewer.
BibTeX
@article{schelble2022towards,
title = {Towards Ethical AI: Empirically Investigating Dimensions of AI Ethics, Trust, and Performance in Human-AI Teaming},
author = {Schelble, Beau G. and Lopez, Jeremy and Textor, Claire and Zhang, Rui and McNeese, Nathan J. and Pak, Richard and Freeman, Guo},
year = {2022},
journal = {Human Factors},
note = {66(4), 1037-1055},
doi = {10.1177/00187208221116952}
}Topics
Related Work
The Effect of Ethical and Unethical AI Actions on Outcomes of Trust and Performance in Human-AI Teams
Proceedings of the 56th Hawaii International Conference on System Sciences
Human or AI Advice? Examining Trust, Influence, and Responsibility in Ethically-Charged Human-AI Team Decision-Making
Journal of Cognitive Engineering and Decision Making
The Spread of Trust and Distrust in Human-AI Teams
Applied Ergonomics
Addressing the Role of Context on Trust in Human-AI Teams: The Influence of Team Role and Violation Type in High-Risk Tasks
Ergonomics