97 citations · 406 across the 28 of their papers we have counts for
29 papers
Predictions for and lack of maximal information transmission in the neuromuscular junction
Eitan Goldfein, Sarah Marzen
A key question in theoretical biology is how effectively biological systems preserve information about their inputs while operating under physical and functional constraints. We ex…
An Investigation of the Channel Capacity of Bacterial Chemotactic Sensors for Low Chemoattractant Concentrations
Ziyi Cui, Sarah Marzen
Bacterial chemotactic sensing converts noisy chemical signals into running and tumbling. We analyze the static sensing limits of mixed Tar/Tsr chemoreceptor clusters in individual…
Comment on Deterministic Information Bottleneck
Sarah Marzen
We make the case that although Deterministic Information Bottleneck may be a contribution to clustering, it should not be used to aid lossy compression without the addition of bloc…
Transformers represent belief state geometry in their residual stream
Adam S. Shai, Sarah E. Marzen, Lucas Teixeira +2
What computational structure are we building into large language models when we train them on next-token prediction? Here, we present evidence that this structure is given by the m…
Complexity-calibrated Benchmarks for Machine Learning Reveal When Next-Generation Reservoir Computer Predictions Succeed and Mislead
Sarah E. Marzen, Paul M. Riechers, James P. Crutchfield
Recurrent neural networks are used to forecast time series in finance, climate, language, and from many other domains. Reservoir computers are a particularly easily trainable form…
Time cells might be optimized for predictive capacity, not redundancy reduction or memory capacity
Alexander Hsu, Sarah Marzen
Recently, researchers have found time cells in the hippocampus that appear to contain information about the timing of past events. Some researchers have argued that time cells are…