Begin with the human: Designing for safety and trustworthiness in cyber-physical systems

Elizabeth T. Williams; Ehsan Nabavi; Genevieve Bell; Caitlin M. Bentley; Katherine A. Daniell; Noel Derwort; Zac Hatfield-Dodds; Kobi Leins; Amy K. McLennan

doi:10.1016/B978-0-12-820543-3.00017-1

Begin with the human: Designing for safety and trustworthiness in cyber-physical systems

Elizabeth T. Williams, Ehsan Nabavi, Genevieve Bell, Caitlin M. Bentley, Katherine A. Daniell, Noel Derwort, Zac Hatfield-Dodds, Kobi Leins, Amy K. McLennan

Research output: Chapter in Book/Report/Conference proceeding › Chapter › peer-review

1 Citation (Scopus)

Abstract

Control systems are designed and built to manage and regulate the behavior of other systems. The use of artificial intelligence (AI) in control systems has simultaneously created new opportunities and new challenges in how we create, manage, and govern cyber-physical systems. In this paper, we discuss the challenge of defining and developing a model for contemplating how these systems will potentially learn, evolve, and act without human intervention. We present an analytical framework for thinking about trust and safety in these systems-both key factors for shared context in human-machine teams-and demonstrate its application using an example from history.

Original language	English
Title of host publication	Human-Machine Shared Contexts
Publisher	Elsevier
Pages	341-357
Number of pages	17
ISBN (Electronic)	9780128205433
DOIs	https://doi.org/10.1016/B978-0-12-820543-3.00017-1
Publication status	Published - 1 Jan 2020

Access to Document

10.1016/B978-0-12-820543-3.00017-1

Cite this

@inbook{7e6ff285c1044761b307fd0184827759,

title = "Begin with the human: Designing for safety and trustworthiness in cyber-physical systems",

abstract = "Control systems are designed and built to manage and regulate the behavior of other systems. The use of artificial intelligence (AI) in control systems has simultaneously created new opportunities and new challenges in how we create, manage, and govern cyber-physical systems. In this paper, we discuss the challenge of defining and developing a model for contemplating how these systems will potentially learn, evolve, and act without human intervention. We present an analytical framework for thinking about trust and safety in these systems-both key factors for shared context in human-machine teams-and demonstrate its application using an example from history.",

keywords = "Agency, Assurance, Autonomy, Cyber-physical systems, Human-machine interaction, Interfaces, Metrics, Safety, Trust",

author = "Williams, {Elizabeth T.} and Ehsan Nabavi and Genevieve Bell and Bentley, {Caitlin M.} and Daniell, {Katherine A.} and Noel Derwort and Zac Hatfield-Dodds and Kobi Leins and McLennan, {Amy K.}",

note = "Publisher Copyright: {\textcopyright} 2020 Elsevier Inc.",

year = "2020",

month = jan,

day = "1",

doi = "10.1016/B978-0-12-820543-3.00017-1",

language = "English",

pages = "341--357",

booktitle = "Human-Machine Shared Contexts",

publisher = "Elsevier",

address = "Netherlands",

}

TY - CHAP

T1 - Begin with the human

T2 - Designing for safety and trustworthiness in cyber-physical systems

AU - Williams, Elizabeth T.

AU - Nabavi, Ehsan

AU - Bell, Genevieve

AU - Bentley, Caitlin M.

AU - Daniell, Katherine A.

AU - Derwort, Noel

AU - Hatfield-Dodds, Zac

AU - Leins, Kobi

AU - McLennan, Amy K.

PY - 2020/1/1

Y1 - 2020/1/1

N2 - Control systems are designed and built to manage and regulate the behavior of other systems. The use of artificial intelligence (AI) in control systems has simultaneously created new opportunities and new challenges in how we create, manage, and govern cyber-physical systems. In this paper, we discuss the challenge of defining and developing a model for contemplating how these systems will potentially learn, evolve, and act without human intervention. We present an analytical framework for thinking about trust and safety in these systems-both key factors for shared context in human-machine teams-and demonstrate its application using an example from history.

AB - Control systems are designed and built to manage and regulate the behavior of other systems. The use of artificial intelligence (AI) in control systems has simultaneously created new opportunities and new challenges in how we create, manage, and govern cyber-physical systems. In this paper, we discuss the challenge of defining and developing a model for contemplating how these systems will potentially learn, evolve, and act without human intervention. We present an analytical framework for thinking about trust and safety in these systems-both key factors for shared context in human-machine teams-and demonstrate its application using an example from history.

KW - Agency

KW - Assurance

KW - Autonomy

KW - Cyber-physical systems

KW - Human-machine interaction

KW - Interfaces

KW - Metrics

KW - Safety

KW - Trust

UR - http://www.scopus.com/inward/record.url?scp=85124923756&partnerID=8YFLogxK

U2 - 10.1016/B978-0-12-820543-3.00017-1

DO - 10.1016/B978-0-12-820543-3.00017-1

M3 - Chapter

SP - 341

EP - 357

BT - Human-Machine Shared Contexts

PB - Elsevier

ER -

Begin with the human: Designing for safety and trustworthiness in cyber-physical systems

Abstract

Access to Document

Other files and links

Fingerprint

Cite this