UZH-Logo

Maintenance Infos

Surprise beyond prediction error


Chumbley, Justin R; Burke, Christopher J; Stephan, Klaas E; Friston, Karl J; Tobler, Philippe N; Fehr, Ernst (2014). Surprise beyond prediction error. Human Brain Mapping, 35(9):4805-4814.

Abstract

Surprise drives learning. Various neural “prediction error” signals are believed to underpin surprise-based reinforcement learning. Here, we report a surprise signal that reflects reinforcement learning but is neither un/signed reward prediction error (RPE) nor un/signed state prediction error (SPE). To exclude these alternatives, we measured surprise responses in the absence of RPE and accounted for a host of potential SPE confounds. This new surprise signal was evident in ventral striatum, primary sensory cortex, frontal poles, and amygdala. We interpret these findings via a normative model of surprise.

Surprise drives learning. Various neural “prediction error” signals are believed to underpin surprise-based reinforcement learning. Here, we report a surprise signal that reflects reinforcement learning but is neither un/signed reward prediction error (RPE) nor un/signed state prediction error (SPE). To exclude these alternatives, we measured surprise responses in the absence of RPE and accounted for a host of potential SPE confounds. This new surprise signal was evident in ventral striatum, primary sensory cortex, frontal poles, and amygdala. We interpret these findings via a normative model of surprise.

Citations

2 citations in Web of Science®
2 citations in Scopus®
Google Scholar™

Altmetrics

Downloads

0 downloads since deposited on 03 Nov 2014
0 downloads since 12 months

Additional indexing

Item Type:Journal Article, refereed, original work
Communities & Collections:03 Faculty of Economics > Department of Economics
04 Faculty of Medicine > Institute of Biomedical Engineering
Dewey Decimal Classification:330 Economics
Language:English
Date:September 2014
Deposited On:03 Nov 2014 10:09
Last Modified:05 Apr 2016 18:28
Publisher:Wiley-Blackwell Publishing, Inc.
ISSN:1065-9471
Free access at:Publisher DOI. An embargo period may apply.
Publisher DOI:https://doi.org/10.1002/hbm.22513
Permanent URL: https://doi.org/10.5167/uzh-100192

Download

[img]
Content: Accepted Version
Filetype: PDF - Registered users only
Size: 296kB
View at publisher
[img]
Content: Supplemental Material
Filetype: PDF - Registered users only
Size: 639kB
[img]
Content: Supplemental Material
Filetype: PDF - Registered users only
Size: 490kB

TrendTerms

TrendTerms displays relevant terms of the abstract of this publication and related documents on a map. The terms and their relations were extracted from ZORA using word statistics. Their timelines are taken from ZORA as well. The bubble size of a term is proportional to the number of documents where the term occurs. Red, orange, yellow and green colors are used for terms that occur in the current document; red indicates high interlinkedness of a term with other terms, orange, yellow and green decreasing interlinkedness. Blue is used for terms that have a relation with the terms in this document, but occur in other documents.
You can navigate and zoom the map. Mouse-hovering a term displays its timeline, clicking it yields the associated documents.

Author Collaborations