Robustness and fault tolerance make brains harder to study
© Srinivasan and Stevens; licensee BioMed Central Ltd. 2011
Received: 27 June 2011
Accepted: 29 June 2011
Published: 29 June 2011
Brains increase the survival value of organisms by being robust and fault tolerant. That is, brain circuits continue to operate as the organism needs, even when the circuit properties are significantly perturbed. Kispersky and colleagues, in a recent paper in Neural Systems & Circuits, have found that Granger Causality analysis, an important method used to infer circuit connections from the behavior of neurons within the circuit, is defeated by the mechanisms that give rise to this robustness and fault tolerance.
See research article: http://www.neuralsystemsandcircuits.com/content/1/1/9/abstract
Neuroscience has always been concerned with how neural circuits in the brain manage to carry out the computations that underlie behavior, but there has been a recent resurgence of interest in circuits. This intensified interest largely reflects the development of impressive new techniques for discovering how the brain is wired , for perturbing interactions between individual neurons or neuron classes , and for observing the activity exhibited by many members of neuronal populations as they go about their job [3–5]. A new paper by Kispersky et al. , however, highlights the observation that brains are designed to make life hard for neuroscientists who want to understand how circuits work. Specifically, this group has shown that an important analytical technique - Granger Causality - can invent causal interactions that do not actually exist between neurons, and they have figured out why the method sometimes fails.
Clive Granger, a Nobel prize winning economist, developed a method designed to detect causal relations in econometric data, and the method has also been applied in neurobiology. To see how this method works, suppose neuron A has a direct synaptic input onto neuron B that helps to drive the output of B; the output of cell A (one of the many inputs into cell B) is designated by a(t), and the output of cell B by b(t), where t represents time. Generally, neuronal outputs reflect non-random inputs, so the output of cell B will have some temporal structure, which means that earlier parts of b(t) will be correlated with the later parts of b(t). To apply Granger Causality, it is first necessary to determine how well the earlier parts of b(t) will predict the later parts of b(t) because these correlations reflect the overall temporal structure in the total signal cell B receives, together with the properties of cell B's spike-encoding mechanisms. The next step is to determine whether a better prediction of b(t) at later times can be obtained by including information from earlier parts of a(t) as well as the earlier parts of b(t) itself. You then do a statistical test to find out if the improvement in predicting b(t) by including information from a(t) is a lot better than chance, and if it is, then you say that a(t) is causally related to b(t). In biological terms, this sort of causation would be produced by a synaptic input A → B, and so significant Granger Causality can be a sign of a direct synaptic connection between a pair of cells. It gives a way of inferring the brain's wiring diagram.
This argument seems fine and has been shown to work in earlier studies. Or perhaps it only seemed to work before because the test was not sufficiently rigorous. What Kispersky et al. found, however, is that Granger Causality analysis claimed a significant connection between a pair of cells in the crab pyloric network (a simple, extensively studied pattern generation network), even though this cell pair is known not to communicate directly. If Granger Causality analysis works in general, it certainly should work in this very simple, very well studied circuit, but it did not.
Invertebrates have many pattern generation networks. This same problem would be expected to arise in any of them because they all have been designed to keep working even when something goes wrong with the network. One might ask whether this is a problem unique to invertebrates who have very simple (numerically, at least) neural circuits. Actually, the problem is likely to be worse in the vertebrate brain because vertebrates rely on redundant neurons in their circuits to achieve fault tolerance. The logic behind the use of redundant neurons to produce fault tolerance is that the overall pattern generated does not depend on any single connection being present. No two of these networks have exactly the same connections, but they still work as they need to, and they continue working even when connections or cells are eliminated (up to a point).
A very nice analysis of this phenomenon in mammals has been carried out by Schwab et al.  for the preBotziner network, a pattern generator for breathing. Because of redundancies in this network, its output is invariant as individual neurons are removed (up to a critical number) and in such a network, analytical techniques (such as Granger Causality) would be expected to identify synaptic connections between neurons even where none exist. Although this example is for a pattern generator, the same principle of fault tolerance through redundancy holds for all sorts of networks, and they all present the same problem for the application of Granger Causality.
In summary, neural networks have been designed to have outputs that degrade gracefully as network elements are eliminated or their properties perturbed. Such a design principle makes the networks work better for the animals, but simultaneously makes life harder for neuroscientists who want to learn how the network works by making measurements on the network as it does its job.
- Luo L, Callaway EM, Svoboda K: Genetic dissection of neural circuits. Neuron. 2008, 57: 634-660. 10.1016/j.neuron.2008.01.002.PubMed CentralView ArticlePubMed
- Airan RD, Thompson KR, Fenno LE, Bernstein H, Deisseroth K: Temporally precise in vivo control of intracellular signalling. Nature. 2009, 458: 1025-1029. 10.1038/nature07926.View ArticlePubMed
- Ohki K, Chung S, Ch'ng YH, Kara P, Reid RC: Functional imaging with cellular resolution reveals precise micro-architecture in visual cortex. Nature. 2005, 433: 597-603. 10.1038/nature03274.View ArticlePubMed
- Bock DD, Lee WC, Kerlin AM, Andermann ML, Hood G, Wetzel AW, Yurgenson S, Soucy ER, Kim HS, Reid RC: Network anatomy and in vivo physiology of visual cortical neurons. Nature. 2011, 471: 177-182. 10.1038/nature09802.PubMed CentralView ArticlePubMed
- Briggman KL, Helmstaedter M, Denk W: Wiring specificity in the direction-selectivity circuit of the retina. Nature. 2011, 471: 183-188. 10.1038/nature09818.View ArticlePubMed
- Kispersky T, Gutierrez GJ, Marder E: Functional connectivity in a rhythmic inhibitory circuit using Granger causality. Neural Systems Circuits. 2011, 1: 9-10.1186/2042-1001-1-9.PubMed CentralView ArticlePubMed
- Prinz AA, Bucher D, Marder E: Similar network activity from disparate circuit parameters. Nat Neurosci. 2004, 7: 1345-1352. 10.1038/nn1352.View ArticlePubMed
- Schwab DJ, Bruinsma RF, Feldman JL, Levine AJ: Rhythmogenic neuronal networks, emergent leaders and k-cores. Phys Rev E Stat Nonlin Soft Matter Phys. 2010, 82: 051911-PubMed CentralView ArticlePubMed
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.