Dynamic Calibration of  Trust and Trustworthiness in  AI-Enabled Systems

Magnus Liebherr; Ellen Enkel; Effie Law; Mohammadreza Mousavi; Matteo  Sammartino; Philipp  Sieberg

Dynamic Calibration of Trust and Trustworthiness in AI-Enabled Systems

Magnus Liebherr, Ellen Enkel, Effie Law, Mohammadreza Mousavi, Matteo Sammartino, Philipp Sieberg

Informatics

Research output: Contribution to journal › Article › peer-review

116 Downloads (Pure)

Abstract

Trust is a multi-faceted phenomenon traditionally studied in human relations and more recently in human-machine interactions. In the context of AI-enabled systems, trust is about the belief of the user that in a given scenario the system is going to be helpful and safe. The system-side counterpart to trust is trustworthiness. When trust and trustworthiness are aligned with each other, there is calibrated trust. Trust, trustworthiness, and calibrated trust are all dynamic phenomena, evolving throughout the history and evolution of user beliefs, systems, and their interaction.
In this paper, we review the basic concepts of trust, trustworthiness and calibrated trust and provide definitions for them. We discuss their various metrics used in the literature, and the causes that may affect their dynamics, particularly in the context of AI-enabled systems. We discuss the implications of the discussed concepts for various types of stakeholders and suggest some challenges for future research.

Original language	English
Journal	International Journal on Software Tools for Technology Transfer
Publication status	Accepted/In press - 14 Mar 2025

Keywords

Trust
Trustworthiness
Calibrated Trust
AI-Enabled Systems

Access to Document

Dagstuhl_Trust_Final_SubmittedAccepted author manuscript, 828 KBLicence: CC BY-ND

Cite this

@article{017429994354463992df849d5a11cd4f,

title = "Dynamic Calibration of Trust and Trustworthiness in AI-Enabled Systems",

abstract = "Trust is a multi-faceted phenomenon traditionally studied in human relations and more recently in human-machine interactions. In the context of AI-enabled systems, trust is about the belief of the user that in a given scenario the system is going to be helpful and safe. The system-side counterpart to trust is trustworthiness. When trust and trustworthiness are aligned with each other, there is calibrated trust. Trust, trustworthiness, and calibrated trust are all dynamic phenomena, evolving throughout the history and evolution of user beliefs, systems, and their interaction.In this paper, we review the basic concepts of trust, trustworthiness and calibrated trust and provide definitions for them. We discuss their various metrics used in the literature, and the causes that may affect their dynamics, particularly in the context of AI-enabled systems. We discuss the implications of the discussed concepts for various types of stakeholders and suggest some challenges for future research.",

keywords = "Trust, Trustworthiness, Calibrated Trust, AI-Enabled Systems",

author = "Magnus Liebherr and Ellen Enkel and Effie Law and Mohammadreza Mousavi and Matteo Sammartino and Philipp Sieberg",

year = "2025",

month = mar,

day = "14",

language = "English",

journal = "International Journal on Software Tools for Technology Transfer",

issn = "1433-2779",

publisher = "Springer Verlag",

}

TY - JOUR

T1 - Dynamic Calibration of Trust and Trustworthiness in AI-Enabled Systems

AU - Liebherr, Magnus

AU - Enkel, Ellen

AU - Law, Effie

AU - Mousavi, Mohammadreza

AU - Sammartino, Matteo

AU - Sieberg, Philipp

PY - 2025/3/14

Y1 - 2025/3/14

N2 - Trust is a multi-faceted phenomenon traditionally studied in human relations and more recently in human-machine interactions. In the context of AI-enabled systems, trust is about the belief of the user that in a given scenario the system is going to be helpful and safe. The system-side counterpart to trust is trustworthiness. When trust and trustworthiness are aligned with each other, there is calibrated trust. Trust, trustworthiness, and calibrated trust are all dynamic phenomena, evolving throughout the history and evolution of user beliefs, systems, and their interaction.In this paper, we review the basic concepts of trust, trustworthiness and calibrated trust and provide definitions for them. We discuss their various metrics used in the literature, and the causes that may affect their dynamics, particularly in the context of AI-enabled systems. We discuss the implications of the discussed concepts for various types of stakeholders and suggest some challenges for future research.

AB - Trust is a multi-faceted phenomenon traditionally studied in human relations and more recently in human-machine interactions. In the context of AI-enabled systems, trust is about the belief of the user that in a given scenario the system is going to be helpful and safe. The system-side counterpart to trust is trustworthiness. When trust and trustworthiness are aligned with each other, there is calibrated trust. Trust, trustworthiness, and calibrated trust are all dynamic phenomena, evolving throughout the history and evolution of user beliefs, systems, and their interaction.In this paper, we review the basic concepts of trust, trustworthiness and calibrated trust and provide definitions for them. We discuss their various metrics used in the literature, and the causes that may affect their dynamics, particularly in the context of AI-enabled systems. We discuss the implications of the discussed concepts for various types of stakeholders and suggest some challenges for future research.

KW - Trust

KW - Trustworthiness

KW - Calibrated Trust

KW - AI-Enabled Systems

M3 - Article

SN - 1433-2779

JO - International Journal on Software Tools for Technology Transfer

JF - International Journal on Software Tools for Technology Transfer

ER -

Dynamic Calibration of Trust and Trustworthiness in AI-Enabled Systems

Abstract

Keywords

Access to Document

Fingerprint

Cite this