Normal view MARC view ISBD view

Markov Decision Processes and the Belief-Desire-Intention Model [electronic resource] :Bridging the Gap for Autonomous Agents / by Gerardo I. Simari, Simon D. Parsons.

by Simari, Gerardo I [author.]; Parsons, Simon D [author.]; SpringerLink (Online service).
Material type: materialTypeLabelBookSeries: SpringerBriefs in Computer Science: Publisher: New York, NY : Springer New York, 2011.Description: VIII, 63p. online resource.ISBN: 9781461414728.Subject(s): Computer science | Artificial intelligence | Computer simulation | Computer Science | Artificial Intelligence (incl. Robotics) | Simulation and ModelingDDC classification: 006.3 Online resources: Click here to access online
Contents:
Introduction -- Preliminary Concepts -- An Empirical Comparison of Models -- A Theoretical Comparison of Models -- Related Work. Conclusions, Limitations, and Future Directions.
In: Springer eBooksSummary: In this work, we provide a treatment of the relationship between two models that have been widely used in the implementation of autonomous agents: the Belief DesireIntention (BDI) model and Markov Decision Processes (MDPs). We start with an informal description of the relationship, identifying the common features of the two approaches and the differences between them. Then we hone our understanding of these differences through an empirical analysis of the performance of both models on the TileWorld testbed. This allows us to show that even though the MDP model displays consistently better behavior than the BDI model for small worlds, this is not the case when the world becomes large and the MDP model cannot be solved exactly. Finally we present a theoretical analysis of the relationship between the two approaches, identifying mappings that allow us to extract a set of intentions from a policy (a solution to an MDP), and to extract a policy from a set of intentions.
Tags from this library: No tags from this library for this title. Add tag(s)
Log in to add tags.
    average rating: 0.0 (0 votes)

Introduction -- Preliminary Concepts -- An Empirical Comparison of Models -- A Theoretical Comparison of Models -- Related Work. Conclusions, Limitations, and Future Directions.

In this work, we provide a treatment of the relationship between two models that have been widely used in the implementation of autonomous agents: the Belief DesireIntention (BDI) model and Markov Decision Processes (MDPs). We start with an informal description of the relationship, identifying the common features of the two approaches and the differences between them. Then we hone our understanding of these differences through an empirical analysis of the performance of both models on the TileWorld testbed. This allows us to show that even though the MDP model displays consistently better behavior than the BDI model for small worlds, this is not the case when the world becomes large and the MDP model cannot be solved exactly. Finally we present a theoretical analysis of the relationship between the two approaches, identifying mappings that allow us to extract a set of intentions from a policy (a solution to an MDP), and to extract a policy from a set of intentions.

There are no comments for this item.

Log in to your account to post a comment.
@ Jomo Kenyatta University Of Agriculture and Technology Library

Powered by Koha