The misbehavior of value and the discipline of the will.

by: P Dayan, Y Niv, B Seymour, ND Daw

Neural Netw, Vol. 19, No. 8. (October 2006), pp. 1153-1160.

View FullText article

DOI, Pubmed, Hubmed, ScienceDirect

Reviews [Write a review of this article]

There are no reviews of this article

Find related articles from these CiteULike users

brian, awooga

Find related articles with these CiteULike tags

classical, conditioning, instinct, instrumental, misbehaviour, operant, pavlovian, reinforcementlearning, reinforcement-learning, td

Abstract

Most reinforcement learning models of animal conditioning operate under the convenient, though fictive, assumption that Pavlovian conditioning concerns prediction learning whereas instrumental conditioning concerns action learning. However, it is only through Pavlovian responses that Pavlovian prediction learning is evident, and these responses can act against the instrumental interests of the subjects. This can be seen in both experimental and natural circumstances. In this paper we study the consequences of importing this competition into a reinforcement learning context, and demonstrate the resulting effects in an omission schedule and a maze navigation task. The misbehavior created by Pavlovian values can be quite debilitating; we discuss how it may be disciplined.

@article{citeulike:1926528, abstract = {Most reinforcement learning models of animal conditioning operate under the convenient, though fictive, assumption that Pavlovian conditioning concerns prediction learning whereas instrumental conditioning concerns action learning. However, it is only through Pavlovian responses that Pavlovian prediction learning is evident, and these responses can act against the instrumental interests of the subjects. This can be seen in both experimental and natural circumstances. In this paper we study the consequences of importing this competition into a reinforcement learning context, and demonstrate the resulting effects in an omission schedule and a maze navigation task. The misbehavior created by Pavlovian values can be quite debilitating; we discuss how it may be disciplined.}, address = {Gatsby Computational Neuroscience Unit, UCL, 17 Queen Square, London, UK. dayan@gatsby.ucl.ac.uk}, author = {Dayan, P. and Niv, Y. and Seymour, B. and Daw, N. D. }, citeulike-article-id = {1926528}, doi = {10.1016/j.neunet.2006.03.002}, issn = {0893-6080}, journal = {Neural Netw}, keywords = {classical, conditioning, instrumental, operant, pavlovian, reinforcementlearning, td}, month = {October}, number = {8}, pages = {1153--1160}, posted-at = {2007-11-16 14:13:09}, priority = {2}, title = {The misbehavior of value and the discipline of the will.}, url = {http://dx.doi.org/10.1016/j.neunet.2006.03.002}, volume = {19}, year = {2006} }

RIS record

TY - JOUR ID - citeulike:1926528 L3 - citeulike-article-id:1926528 TI - The misbehavior of value and the discipline of the will. JF - Neural Netw VL - 19 IS - 8 SP - 1153 EP - 1160 AD - Gatsby Computational Neuroscience Unit, UCL, 17 Queen Square, London, UK. dayan@gatsby.ucl.ac.uk SN - 0893-6080 N2 - Most reinforcement learning models of animal conditioning operate under the convenient, though fictive, assumption that Pavlovian conditioning concerns prediction learning whereas instrumental conditioning concerns action learning. However, it is only through Pavlovian responses that Pavlovian prediction learning is evident, and these responses can act against the instrumental interests of the subjects. This can be seen in both experimental and natural circumstances. In this paper we study the consequences of importing this competition into a reinforcement learning context, and demonstrate the resulting effects in an omission schedule and a maze navigation task. The misbehavior created by Pavlovian values can be quite debilitating; we discuss how it may be disciplined. KW - classical KW - conditioning KW - instrumental KW - operant KW - pavlovian KW - reinforcementlearning KW - td AU - Dayan, P AU - Niv, Y AU - Seymour, B AU - Daw, ND PY - 2006/10// UR - http://dx.doi.org/10.1016/j.neunet.2006.03.002 ER -

RIS BibTeX