Bits per Spike as a Betting Game · neurostatsblog
Whenever we fit a model to neural or behavioral data, we need to benchmark it against simpler or well-known baselines. Typically this is done by reporting the difference in log-likelihoods on heldout data. For example, the popular “bits per spike” performance metric (see e.g. Pillow et al. 2008) is simply the log (base 2) likelihood of the model minus the log (base 2) likelihood of a homogeneous Poisson process (or another appropriate baseline model), divided by the total number of spikes in the dataset.
Revision history v1 (2026-05-27): Initial version. v2 (2026-05-30): Added time to significance. Cite this post Copy @misc{williams2026_model, author = {Alex H Williams}, title = {Bits per Spike as a Betting Game}, year = {2026}, howpublished = {\url{https://doi.org/10.5281/zenodo.20418560}}, doi = {10.5281/zenodo.20418560}, note = {neurostatsblog}, } View as PDF Contents Basic Setup A Demo of the Betting Game Introducing the Game Choosing the optimal contract function Some interpretations Connection to Hypothesis Testing Take Home Message Further Reading Supplementary Note 1 Supplementary Note
saved by
related reading
- Notes towards Neurostimulation and Mathematical Neurosciencebernoullicollective.org
- How much do you believe your results? — LessWronglesswrong.com
- Six (and a half) intuitions for KL divergence — LessWronglesswrong.com
- Benchmarking spike rate inference in population calcium imagingpmc.ncbi.nlm.nih.gov
- Some Math behind Neural Tangent Kernel | Lil'Loglilianweng.github.io
- Likelihood-ratio test - Wikipediaen.wikipedia.org
- Speeding up RL with high-leverage samples | Applied Computeappliedcompute.com
- Competing with sampling — Alignment Research Centeralignment.org
- It’s Bayes All The Way Upslatestarcodex.com
- Logs, Tails, Long Tails – Ryan Moulton's Articlesmoultano.wordpress.com
- Tips for Training Likelihood Modelsblog.evjang.com
- Exploring spiking neural networks: a comprehensive analysis of mathematical models and applicationsfrontiersin.org