King's College London

Research portal

Integrating quantitative and qualitative reasoning for value alignment

Research output: Chapter in Book/Report/Conference proceedingConference paperpeer-review

Original languageEnglish
Title of host publicationThe 19th European Conference on Multi-Agent Systems
Accepted/In press25 Jul 2022


  • EUMAS_paper_30

    Value_based_reasoning_1.pdf, 265 KB, application/pdf

    Uploaded date:03 Sep 2022

    Version:Accepted author manuscript

King's Authors


Agents that focus only on achieving their own goals may cause significant harm to society. As a result, when deciding which actions to perform, agents have to consider societal values and how their actions impact these values - the `value alignment problem'. There is therefore a need to integrate quantitative machine reasoning with an ability to reason about the qualitative aspects of human values. In this paper, we present a novel framework for value-based reasoning that aims to bridge the gap between these two modes of reasoning. In particular, our framework extends the theory of grading to model how societal values can trade off with each other or with the agent's goals. Furthermore, our framework introduces the use of hyperreal numbers to represent both quantitative and qualitative aspects of reasoning and help address the value alignment problem.

Download statistics

No data available

View graph of relations

© 2020 King's College London | Strand | London WC2R 2LS | England | United Kingdom | Tel +44 (0)20 7836 5454