UZH-Logo

Computation with spikes in a winner-take-all network


Oster, M; Douglas, R J; Liu, S C (2009). Computation with spikes in a winner-take-all network. Neural Computation, 21(9):2436-2465.

Abstract

The winner-take-all (WTA) computation in networks of recurrently connected neurons is an important decision element of many models of cortical processing. However, analytical studies of the WTA performance in recurrent networks have generally addressed rate-based models. Very few have addressed networks of spiking neurons, which are relevant for understanding the biological networks themselves, and also for the development of neuromorphic electronic neurons that commmunicate by action-potential like address-events. Here, we make steps in that direction by using a simplified Markov model of the spiking network to examine analytically the ability of a spike-based WTA network to discriminate the statistics of inputs ranging from stationary regular to non-stationary Poisson events. Our work extends previous theoretical results showing that a WTA recurrent network receiving regular spike inputs can select the correct winner within one interspike interval. We show firstly for the case of spike rate inputs, that input discrimination and the effects of self-excitation and inhibition on this discrimination are consistent with results obtained from the standard rate-based WTA models. We also extend this discrimination analysis of spiking WTAs to non-stationary inputs with time-varying spike rates resembling statistics of real-world sensory stimuli. We conclude that spiking WTAs are consistent with their continuous counterparts for steady-state inputs, but they also exhibit high discrimination performance with non-stationary inputs.

The winner-take-all (WTA) computation in networks of recurrently connected neurons is an important decision element of many models of cortical processing. However, analytical studies of the WTA performance in recurrent networks have generally addressed rate-based models. Very few have addressed networks of spiking neurons, which are relevant for understanding the biological networks themselves, and also for the development of neuromorphic electronic neurons that commmunicate by action-potential like address-events. Here, we make steps in that direction by using a simplified Markov model of the spiking network to examine analytically the ability of a spike-based WTA network to discriminate the statistics of inputs ranging from stationary regular to non-stationary Poisson events. Our work extends previous theoretical results showing that a WTA recurrent network receiving regular spike inputs can select the correct winner within one interspike interval. We show firstly for the case of spike rate inputs, that input discrimination and the effects of self-excitation and inhibition on this discrimination are consistent with results obtained from the standard rate-based WTA models. We also extend this discrimination analysis of spiking WTAs to non-stationary inputs with time-varying spike rates resembling statistics of real-world sensory stimuli. We conclude that spiking WTAs are consistent with their continuous counterparts for steady-state inputs, but they also exhibit high discrimination performance with non-stationary inputs.

Citations

19 citations in Web of Science®
24 citations in Scopus®
Google Scholar™

Altmetrics

Downloads

32 downloads since deposited on 28 Feb 2010
6 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Journal Article, refereed, original work
Communities & Collections:07 Faculty of Science > Institute of Neuroinformatics
Dewey Decimal Classification:570 Life sciences; biology
Uncontrolled Keywords:WTA spikes
Language:English
Date:2009
Deposited On:28 Feb 2010 10:14
Last Modified:20 May 2016 10:06
Publisher:MIT Press
ISSN:0899-7667
Additional Information:Copyright: MIT Press
Publisher DOI:10.1162/neco.2009.07-08-829
Related URLs:http://www.ini.uzh.ch/node/21376 (Organisation)
PubMed ID:19548795
Permanent URL: http://doi.org/10.5167/uzh-32038

Download

[img]
Preview
Filetype: PDF
Size: 718kB
View at publisher

TrendTerms

TrendTerms displays relevant terms of the abstract of this publication and related documents on a map. The terms and their relations were extracted from ZORA using word statistics. Their timelines are taken from ZORA as well. The bubble size of a term is proportional to the number of documents where the term occurs. Red, orange, yellow and green colors are used for terms that occur in the current document; red indicates high interlinkedness of a term with other terms, orange, yellow and green decreasing interlinkedness. Blue is used for terms that have a relation with the terms in this document, but occur in other documents.
You can navigate and zoom the map. Mouse-hovering a term displays its timeline, clicking it yields the associated documents.

Author Collaborations