211 citations · 629 across the 21 of their papers we have counts for
3 papers · 1 filter
NORACL: Neurogenesis for Oracle-free Resource-Adaptive Continual Learning
Karthik Charan Raghunathan, Christian Metzner, Laura Kriener +1
In a continual learning setting, we require a model to be plastic enough to learn a new task and stable enough to not disturb previously learned capabilities. We argue that this di…
mGRADE: Minimal Recurrent Gating Meets Delay Convolutions for Lightweight Sequence Modeling
Tristan Torchet, Christian Metzner, Karthik Charan Raghunathan +4
Multi-timescale sequence modeling relies on capturing both local fast dynamics and global slow context; yet, maintaining these capabilities under the strict memory constraints comm…
Quantizing Small-Scale State-Space Models for Edge AI
Leo Zhao, Tristan Torchet, Melika Payvand +2
State-space models (SSMs) have recently gained attention in deep learning for their ability to efficiently model long-range dependencies, making them promising candidates for edge-…