4 papers
Bullet Trains: Parallelizing Training of Temporally Precise Spiking Neural Networks
Todd Morrill, Christian Pehle, Anthony Zador
Continuous-time, event-native spiking neural networks (SNNs) operate strictly on spike events, treating spike timing and ordering as the representation rather than an artifact of t…
NeuroAI and Beyond: Bridging Between Advances in Neuroscience and ArtificialIntelligence
Anthony Zador, Jean-Marc Fellous, Terrence Sejnowski +28
Neuroscience and Artificial Intelligence (AI) have made impressive progress in recent years but remain only loosely interconnected. Based on a workshop convened by the National Sci…
Walking the Weight Manifold: a Topological Approach to Conditioning Inspired by Neuromodulation
Ari S. Benjamin, Kyle Daruwalla, Christian Pehle +2
One frequently wishes to learn a range of similar tasks as efficiently as possible, re-using knowledge across tasks. In artificial neural networks, this is typically accomplished b…
Token-Level Uncertainty-Aware Objective for Language Model Post-Training
Tingkai Liu, Ari S. Benjamin, Anthony M. Zador
In the current work, we connect token-level uncertainty in causal language modeling to two types of training objectives: 1) masked maximum likelihood (MLE), 2) self-distillation. W…