From the 1 of 8 linked papers with an AI index.
8 papers
NORACL: Neurogenesis for Oracle-free Resource-Adaptive Continual Learning
Karthik Charan Raghunathan, Christian Metzner, Laura Kriener +1
The paper introduces NORACL, a continual‑learning method that dynamically expands a neural network when representational or plasticity saturation is detected, eliminating the need…
mGRADE: Minimal Recurrent Gating Meets Delay Convolutions for Lightweight Sequence Modeling
Tristan Torchet, Christian Metzner, Karthik Charan Raghunathan +4
Multi-timescale sequence modeling relies on capturing both local fast dynamics and global slow context; yet, maintaining these capabilities under the strict memory constraints comm…
A Linear Implementation of an Analog Resonate-and-Fire Neuron
Angqi Liu, Filippo Moro, Sebastian Billaudelle +1
Oscillatory dynamics have recently proven highly effective in machine learning (ML), particularly through State-Space-Models (SSM) that leverage structured linear recurrences for l…
Unified Memcapacitor-Memristor Memory for Synaptic Weights and Neuron Temporal Dynamics
Simone D'Agostino, Marco Massarotto, Tristan Torchet +7
We present a fabricated and experimentally characterized memory stack that unifies memristive and memcapacitive behavior. Exploiting this dual functionality, we design a circuit en…
Quantizing Small-Scale State-Space Models for Edge AI
Leo Zhao, Tristan Torchet, Melika Payvand +2
State-space models (SSMs) have recently gained attention in deep learning for their ability to efficiently model long-range dependencies, making them promising candidates for edge-…
MINIMALIST: switched-capacitor circuits for efficient in-memory computation of gated recurrent units
Sebastian Billaudelle, Laura Kriener, Filippo Moro +2
Recurrent neural networks (RNNs) have been a long-standing candidate for processing of temporal sequence data, especially in memory-constrained systems that one may find in embedde…