Network Information and Connected Correlations
Physical Review LettersPublished 2 December 2003Open access
Elad Schneidman, Susanne Still, Michael J. Berry, William Bialek
Citations323
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
The information theoretic analog of connected correlation functions is constructed: irreducible N-point correlation is measured by a decrease in entropy for the joint distribution of N variables relative to the maximum entropy allowed by all the observed N-1 variable distributions.
Abstract
Entropy and information provide natural measures of correlation among elements in a network. We construct here the information theoretic analog of connected correlation functions: irreducible N-point correlation is measured by a decrease in entropy for the joint distribution of N variables relative to the maximum entropy allowed by all the observed N-1 variable distributions. We calculate the "connected information" terms for several examples and show that it also enables the decomposition of the information that is carried by a population of elements about an outside source.
Keywords
NeurosciencePhysics and Astronomy
Bell System Technical JournalA Mathematical Theory of Communication
80,675 Citations1948Claude E. Shannon
The Annals of Probability$I$-Divergence Geometry of Probability Distributions and Minimization Problems
1,648 Citations1975Imre Csiszár
Cambridge University Press eBooksCorticonics
1,367 Citations1991Micha Abeles
This work has shown that not only is the probability for synaptic contact between neurons in the cortex high, but also the relationship between membrane potential and synaptic response curve is low.
IBM Journal of Research and DevelopmentInformation Theoretical Analysis of Multivariate Correlation
743 Citations1960Satosi Watanabé
The present paper gives various theorems, according to which Ctot(λ) can be decomposed in terms of the partial correlations existing in subsets of λ, and of quantities derivable therefrom.
The Annals of Mathematical StatisticsMaximum Entropy for Hypothesis Formulation, Especially for Multidimensional Contingency Tables
401 Citations1963I. J. Good
IEEE Transactions on Information TheoryInformation geometry on hierarchy of probability distributions
394 Citations2001Шун-ичи Амари
The orthogonal decomposition of an exponential family or mixture family of probability distributions has a natural hierarchical structure is given and is important for extracting intrinsic interactions in firing patterns of an ensemble of neurons and for estimating its functional connections.
Neural ComputationSynergy in a Neural Code
363 Citations2000Naama Brenner, Steven Strong +3 more
It is shown that the information carried by compound events in neural spike trainspatterns of spikes across time or across a population of cellscan can be measured, independent of assumptions about what these patterns might represent.
Transactions of the IRE Professional Group on Information TheoryMultivariate information transmission
303 Citations1954W. J. McGill
It is shown that sample transmitted information provides a simple method for measuring and testing association in multi-dimensional contingency tables and relations with analysis of variance are pointed out.
Biological CyberneticsOn the significance of correlations among neuronal spike trains
253 Citations1988G. Palm, Ad Aertsen +1 more
It is possible to compare stimulus-locked, and therefore time dependent correlations for different stimuli and also for different times relative to stimulus onset, and to separate purely stimulus-induced correlation from intrinsic interneuronal correlation.
NeuronMultineuronal Firing Patterns in the Signal from Eye to Brain
182 Citations2003Mark J. Schnitzer, Markus Meister
Neural ComputationNeural Coding: Higher-Order Temporal Patterns in the Neurostatistics of Cell Assemblies
156 Citations2000Laura Martignon, Gustavo Deco +4 more
This work presents test statistics for detecting the presence of higher-order interactions in spike train data by parameterizing these interactions in terms of coefficients of log-linear models and presents a Bayesian approach for inferring the existence or absence of interactions and estimating their strength.
Physical Review LettersAlmost Every Pure State of Three Qubits Is Completely Determined by Its Two-Particle Reduced Density Matrices
142 Citations2002Noah Linden, Sandu Popescu +1 more
Almost every pure state of three qubits is completely determined by its two-particle reduced density matrices, and it is shown that there is no correlation between n-1 particles and n-way correlation.
Journal of the American Statistical AssociationA Generalizable Formulation of Conditional Logit with Diagnostics
89 Citations1992Ehsan S. Soofi
Texts in computer scienceLearning Graphical Models
21 Citations2016Rudolf Kruse, Christian Borgelt +3 more