Provenance-based Explanations for Automated Decisions: Final IAA Project Report

TY - BOOK

T1 - Provenance-based Explanations for Automated Decisions

T2 - Final IAA Project Report

AU - Huynh, Trung Dong

AU - Stalla-Bourdillon, Sophie

AU - Moreau, Luc

PY - 2019/7/18

Y1 - 2019/7/18

N2 - AI-based automated decisions are increasingly used as part of new services being deployed to the general public. This approach to building services presents significant potential benefits, such as the reduced speed of execution, increased accuracy, lower cost, and ability to learn from a wide variety of situations. Of course, equally significant concerns have been raised and are now well documented such as concerns about privacy, fairness, bias and ethics.In this project, we have implemented a Loan Decision scenario, instrumented its decision pipeline so that it records provenance, categorised explanations according to their audience and their purpose, built an explanation-generation prototype, and wrapped the whole system in an online demonstrator. This work aimed to demonstrate that provenance, defined as a record that describes the people, institutions, entities, and activities involved in producing, influencing, or delivering a decision, is a solid foundation for generating its explanations.

AB - AI-based automated decisions are increasingly used as part of new services being deployed to the general public. This approach to building services presents significant potential benefits, such as the reduced speed of execution, increased accuracy, lower cost, and ability to learn from a wide variety of situations. Of course, equally significant concerns have been raised and are now well documented such as concerns about privacy, fairness, bias and ethics.In this project, we have implemented a Loan Decision scenario, instrumented its decision pipeline so that it records provenance, categorised explanations according to their audience and their purpose, built an explanation-generation prototype, and wrapped the whole system in an online demonstrator. This work aimed to demonstrate that provenance, defined as a record that describes the people, institutions, entities, and activities involved in producing, influencing, or delivering a decision, is a solid foundation for generating its explanations.

KW - explainable computing

KW - provenance

KW - explanations

KW - automated decisions

KW - GDPR

KW - data protection

M3 - Report

BT - Provenance-based Explanations for Automated Decisions

ER -