Header

UZH-Logo

Maintenance Infos

Avalanche and edge-of-chaos criticality do not necessarily co-occur in neural networks


Kanders, Karlis; Lorimer, Tom; Stoop, Ruedi (2017). Avalanche and edge-of-chaos criticality do not necessarily co-occur in neural networks. CHAOS (København), 27(4):047408.

Abstract

There are indications that for optimizing neural computation, neural networks may operate at criticality. Previous approaches have used distinct fingerprints of criticality, leaving open the question whether the different notions would necessarily reflect different aspects of one and the same instance of criticality, or whether they could potentially refer to distinct instances of criticality. In this work, we choose avalanche criticality and edge-of-chaos criticality and demonstrate for a recurrent spiking neural network that avalanche criticality does not necessarily entrain dynamical edge-of-chaos criticality. This suggests that the different fingerprints may pertain to distinct phenomena.
In biological neural networks, scale-free avalanches of neuronal firing events have suggested that such networks might preferably operate at criticality, in particular, since theoretical studies of artificial neural networks and of cellular automata have highlighted some potential computational benefits of such a state. In these studies, notions of either edge-of-chaos criticality or avalanche criticality were adhered to. Here, using a recurrent neural network of more realistic neurons compared with what has been considered previously, we scrutinize whether these two manifestations of criticality are necessarily co-occurring. Based on a realistic paradigm of neural networks, we show that a positive largest Lyapunov exponent—indicating chaotic dynamics of the network—is conserved as we tune the network from subcritical to critical and to supercritical avalanche behavior. This demonstrates that avalanche criticality does not necessarily co-occur with edge-of-chaos criticality.

Abstract

There are indications that for optimizing neural computation, neural networks may operate at criticality. Previous approaches have used distinct fingerprints of criticality, leaving open the question whether the different notions would necessarily reflect different aspects of one and the same instance of criticality, or whether they could potentially refer to distinct instances of criticality. In this work, we choose avalanche criticality and edge-of-chaos criticality and demonstrate for a recurrent spiking neural network that avalanche criticality does not necessarily entrain dynamical edge-of-chaos criticality. This suggests that the different fingerprints may pertain to distinct phenomena.
In biological neural networks, scale-free avalanches of neuronal firing events have suggested that such networks might preferably operate at criticality, in particular, since theoretical studies of artificial neural networks and of cellular automata have highlighted some potential computational benefits of such a state. In these studies, notions of either edge-of-chaos criticality or avalanche criticality were adhered to. Here, using a recurrent neural network of more realistic neurons compared with what has been considered previously, we scrutinize whether these two manifestations of criticality are necessarily co-occurring. Based on a realistic paradigm of neural networks, we show that a positive largest Lyapunov exponent—indicating chaotic dynamics of the network—is conserved as we tune the network from subcritical to critical and to supercritical avalanche behavior. This demonstrates that avalanche criticality does not necessarily co-occur with edge-of-chaos criticality.

Statistics

Citations

Dimensions.ai Metrics
1 citation in Web of Science®
2 citations in Scopus®
1 citation in Microsoft Academic
Google Scholar™

Altmetrics

Additional indexing

Item Type:Journal Article, refereed, original work
Communities & Collections:07 Faculty of Science > Institute of Neuroinformatics
Dewey Decimal Classification:570 Life sciences; biology
Language:English
Date:2017
Deposited On:01 Mar 2018 12:15
Last Modified:14 Mar 2018 18:01
Publisher:Museum Tusculanum Press
Series Name:Chaos
Number of Pages:1
ISSN:0108-4453
OA Status:Closed
Free access at:Publisher DOI. An embargo period may apply.
Publisher DOI:https://doi.org/10.1063/1.4978998
Official URL:http://aip.scitation.org/doi/10.1063/1.4978998

Download

Full text not available from this repository.
View at publisher