Using Normative Markov Decision Processes for evaluating electronic contracts

Moser Silva Fagundes; Sascha Ossowski; Michael Luck; Simon Miles

doi:10.3233/AIC-2012-0511

Using Normative Markov Decision Processes for evaluating electronic contracts

Moser Silva Fagundes, Sascha Ossowski, Michael Luck, Simon Miles

Univ Rey Juan Carlos, Ctr Intelligent Informat Technol

Research output: Contribution to journal › Article › peer-review

14 Citations (Scopus)

5 Downloads (Pure)

Abstract

Before signing electronic contracts, a rational agent should estimate the expected utilities of these contracts and calculate the violation risks related to them. In order to perform such pre-signing procedures, this agent has to be capable of computing a policy taking into account the norms and sanctions in the contracts. In relation to this, the contribution of this work is threefold. First, we present the Normative Markov Decision Process, an extension of the Markov Decision Process for explicitly representing norms. In order to illustrate the usage of our framework, we model an example in a simulated aerospace aftermarket. Second, we specify an algorithm for identifying the states of the process which characterize the violation of norms. Finally, we show how to compute policies with our framework and how to calculate the risk of violating the norms in the contracts by adopting a particular policy.

Original language	English
Pages (from-to)	1 - 17
Number of pages	17
Journal	AI COMMUNICATIONS
Volume	25
Issue number	1
DOIs	https://doi.org/10.3233/AIC-2012-0511
Publication status	Published - 2012

Access to Document

10.3233/AIC-2012-0511

Cite this

@article{97ba5134fcdf4444b0ef500009a1eae0,

title = "Using Normative Markov Decision Processes for evaluating electronic contracts",

abstract = "Before signing electronic contracts, a rational agent should estimate the expected utilities of these contracts and calculate the violation risks related to them. In order to perform such pre-signing procedures, this agent has to be capable of computing a policy taking into account the norms and sanctions in the contracts. In relation to this, the contribution of this work is threefold. First, we present the Normative Markov Decision Process, an extension of the Markov Decision Process for explicitly representing norms. In order to illustrate the usage of our framework, we model an example in a simulated aerospace aftermarket. Second, we specify an algorithm for identifying the states of the process which characterize the violation of norms. Finally, we show how to compute policies with our framework and how to calculate the risk of violating the norms in the contracts by adopting a particular policy.",

author = "Fagundes, {Moser Silva} and Sascha Ossowski and Michael Luck and Simon Miles",

year = "2012",

doi = "10.3233/AIC-2012-0511",

language = "English",

volume = "25",

pages = "1 -- 17",

journal = "AI COMMUNICATIONS",

publisher = "IOS Press",

number = "1",

}

TY - JOUR

T1 - Using Normative Markov Decision Processes for evaluating electronic contracts

AU - Fagundes, Moser Silva

AU - Ossowski, Sascha

AU - Luck, Michael

AU - Miles, Simon

PY - 2012

Y1 - 2012

N2 - Before signing electronic contracts, a rational agent should estimate the expected utilities of these contracts and calculate the violation risks related to them. In order to perform such pre-signing procedures, this agent has to be capable of computing a policy taking into account the norms and sanctions in the contracts. In relation to this, the contribution of this work is threefold. First, we present the Normative Markov Decision Process, an extension of the Markov Decision Process for explicitly representing norms. In order to illustrate the usage of our framework, we model an example in a simulated aerospace aftermarket. Second, we specify an algorithm for identifying the states of the process which characterize the violation of norms. Finally, we show how to compute policies with our framework and how to calculate the risk of violating the norms in the contracts by adopting a particular policy.

AB - Before signing electronic contracts, a rational agent should estimate the expected utilities of these contracts and calculate the violation risks related to them. In order to perform such pre-signing procedures, this agent has to be capable of computing a policy taking into account the norms and sanctions in the contracts. In relation to this, the contribution of this work is threefold. First, we present the Normative Markov Decision Process, an extension of the Markov Decision Process for explicitly representing norms. In order to illustrate the usage of our framework, we model an example in a simulated aerospace aftermarket. Second, we specify an algorithm for identifying the states of the process which characterize the violation of norms. Finally, we show how to compute policies with our framework and how to calculate the risk of violating the norms in the contracts by adopting a particular policy.

U2 - 10.3233/AIC-2012-0511

DO - 10.3233/AIC-2012-0511

M3 - Article

VL - 25

SP - 1

EP - 17

JO - AI COMMUNICATIONS

JF - AI COMMUNICATIONS

IS - 1

ER -

Using Normative Markov Decision Processes for evaluating electronic contracts

Abstract

Access to Document

Fingerprint

Cite this