TY - GEN
T1 - A risk-based trust framework for assuring the humans in human-machine teaming
AU - Assaad, Zena
N1 - Publisher Copyright:
© 2024 Copyright held by the owner/author(s).
PY - 2024/9/16
Y1 - 2024/9/16
N2 - Trust in human-machine teaming (HMT) is a difficult concept to define and manage. This is largely due to its subjectivity. Despite its subjectivity, trust has become a critical element of safety for HMT. The level of trust a human has in an autonomous or AI-enabled system impacts the decisions they make when operating alongside that system. As HMT involves a greater interdependence between humans and autonomous or AI-enabled systems, there is a greater significance on the human roles and responsibilities in this dynamic. Humans are an equal, if not greater contributor to trustworthy HMT. This paper presents a human centric risk-based trust framework for HMT. The framework is intended to be used to support risk assessments for HMT which captures human centric trust related risks and enforces measures for facilitating calibrated levels of trust in HMT operations. The presented framework focusses on interventions for the human in HMT specific to the implementation phase.
AB - Trust in human-machine teaming (HMT) is a difficult concept to define and manage. This is largely due to its subjectivity. Despite its subjectivity, trust has become a critical element of safety for HMT. The level of trust a human has in an autonomous or AI-enabled system impacts the decisions they make when operating alongside that system. As HMT involves a greater interdependence between humans and autonomous or AI-enabled systems, there is a greater significance on the human roles and responsibilities in this dynamic. Humans are an equal, if not greater contributor to trustworthy HMT. This paper presents a human centric risk-based trust framework for HMT. The framework is intended to be used to support risk assessments for HMT which captures human centric trust related risks and enforces measures for facilitating calibrated levels of trust in HMT operations. The presented framework focusses on interventions for the human in HMT specific to the implementation phase.
KW - Human-machine teaming
KW - risk
KW - trust
KW - unpredictability
UR - http://www.scopus.com/inward/record.url?scp=85205385978&partnerID=8YFLogxK
U2 - 10.1145/3686038.3686045
DO - 10.1145/3686038.3686045
M3 - Conference contribution
AN - SCOPUS:85205385978
T3 - ACM International Conference Proceeding Series
BT - TAS 2024 - Proceedings of the 2nd International Symposium on Trustworthy Autonomous Systems
PB - Association for Computing Machinery (ACM)
T2 - 2nd International Symposium on Trustworthy Autonomous Systems, TAS 2024
Y2 - 15 September 2024 through 18 September 2024
ER -