Header

UZH-Logo

Maintenance Infos

Cross-modal effects of value on perceptual acuity and stimulus encoding


Pooresmaeili, Arezoo; FitzGerald, Thomas H B; Bach, Dominik R; Toelch, Ulf; Ostendorf, Florian; Dolan, Raymond J (2014). Cross-modal effects of value on perceptual acuity and stimulus encoding. Proceedings of the National Academy of Sciences of the United States of America, 111(42):15244-15249.

Abstract

Cross-modal interactions are very common in perception. An important feature of many perceptual stimuli is their reward-predicting properties, the utilization of which is essential for adaptive behavior. What is unknown is whether reward associations in one sensory modality influence perception of stimuli in another modality. Here we show that auditory stimuli with high-reward associations increase the sensitivity of visual perception, even when sounds and reward associations are both irrelevant for the visual task. This increased sensitivity correlates with a change in stimulus representation in the visual cortex, indexed by increased multivariate decoding accuracy in simultaneously acquired functional MRI data. Univariate analysis showed that reward associations modulated responses in regions associated with multisensory processing in which the strength of modulation was a better predictor of the magnitude of the behavioral effect than the modulation in classical reward regions. Our findings demonstrate a value-driven cross-modal interaction that affects perception and stimulus encoding, with a resemblance to well-described modulatory effects of attention. We suggest that multisensory processing areas may mediate the transfer of value signals across senses.

Abstract

Cross-modal interactions are very common in perception. An important feature of many perceptual stimuli is their reward-predicting properties, the utilization of which is essential for adaptive behavior. What is unknown is whether reward associations in one sensory modality influence perception of stimuli in another modality. Here we show that auditory stimuli with high-reward associations increase the sensitivity of visual perception, even when sounds and reward associations are both irrelevant for the visual task. This increased sensitivity correlates with a change in stimulus representation in the visual cortex, indexed by increased multivariate decoding accuracy in simultaneously acquired functional MRI data. Univariate analysis showed that reward associations modulated responses in regions associated with multisensory processing in which the strength of modulation was a better predictor of the magnitude of the behavioral effect than the modulation in classical reward regions. Our findings demonstrate a value-driven cross-modal interaction that affects perception and stimulus encoding, with a resemblance to well-described modulatory effects of attention. We suggest that multisensory processing areas may mediate the transfer of value signals across senses.

Statistics

Citations

10 citations in Web of Science®
10 citations in Scopus®
Google Scholar™

Altmetrics

Additional indexing

Item Type:Journal Article, refereed, original work
Communities & Collections:04 Faculty of Medicine > Psychiatric University Hospital Zurich > Clinic for Psychiatry, Psychotherapy, and Psychosomatics
Dewey Decimal Classification:610 Medicine & health
Language:English
Date:21 October 2014
Deposited On:16 Jan 2015 13:43
Last Modified:08 Dec 2017 10:13
Publisher:National Academy of Sciences
ISSN:0027-8424
Publisher DOI:https://doi.org/10.1073/pnas.1408873111
PubMed ID:25288729

Download

Full text not available from this repository.
View at publisher