Maximally informative dimensions
- 2 min read
- 2 chapters
Related on Lably
Through Statistics, Linearity and Neuron
Mathematical formulation
Neural stimulus-response functions are typically given as the probability of a neuron generating an action potential, or spike, in response to a stimulus . The goal of maximally informative dimensions is to find a small relevant subspace of the much larger stimulus space that accurately captures the salient features of . Let denote the dimensionality of the entire stimulus space and denote the dimensionality of the relevant subspace, such that . We let denote the basis of the relevant subspace, and the projection of onto . Using Bayes' theorem we can write out the probability of a spike given a stimulus:
where
is some nonlinear function of the projected stimulus.
In order to choose the optimal , we compare the prior stimulus distribution with the spike-triggered stimulus distribution using the Shannon information. The average information (averaged across all presented stimuli) per spike is given by
- .
Now consider a dimensional subspace defined by a single direction . The average information conveyed by a single spike about the projection is
- ,
where the probability distributions are approximated by a measured data set via and , i.e., each presented stimulus is represented by a scaled Dirac delta function and the probability distributions are created by averaging over all spike-eliciting stimuli, in the former case, or the entire presented stimulus set, in the latter case. For a given dataset, the average information is a function only of the direction . Under this formulation, the relevant subspace of dimension would be defined by the direction that maximizes the average information .
This procedure can readily be extended to a relevant subspace of dimension by defining
and
and maximizing .
Sign up free to read the rest
One more chapter is free with a Lably account.
Already have an account?
Importance
Maximally informative dimensions does not make any assumptions about the Gaussianity of the stimulus set, which is important, because naturalistic stimuli tend to have non-Gaussian statistics. In this way the technique is more robust than other dimensionality reduction techniques such as spike-triggered covariance analyses.
