8 papers · 1 filter
Position: Modular Memory is the Key to Continual Learning Agents
Vaggelis Dorovatas, Malte Schwerin, Andrew D. Bagdanov +21
Foundation models have transformed machine learning through large-scale pretraining and increased test-time compute. Despite surpassing human performance in several domains, these…
M2RU: Memristive Minion Recurrent Unit for On-Chip Continual Learning at the Edge
Abdullah M. Zyarah, Dhireesha Kudithipudi
Continual learning on edge platforms remains challenging because recurrent networks depend on energy-intensive training procedures and frequent data movement that are impractical f…
Temporal Chunking Enhances Recognition of Implicit Sequential Patterns
Jayanta Dey, Nicholas Soures, Miranda Gonzales +3
In this pilot study, we propose a neuro-inspired approach that compresses temporal sequences into context-tagged chunks, where each tag represents a recurring structural unit or``c…
Minion Gated Recurrent Unit for Continual Learning
Abdullah M. Zyarah, Dhireesha Kudithipudi
The increasing demand for continual learning in sequential data processing has led to progressively complex training methodologies and larger recurrent network architectures. Conse…
Reservoir Network with Structural Plasticity for Human Activity Recognition
Abdullah M. Zyarah, Alaa M. Abdul-Hadi, Dhireesha Kudithipudi
The unprecedented dissemination of edge devices is accompanied by a growing demand for neuromorphic chips that can process time-series data natively without cloud support. Echo sta…
Time-Series Forecasting and Sequence Learning Using Memristor-based Reservoir System
Abdullah M. Zyarah, Dhireesha Kudithipudi
Pushing the frontiers of time-series information processing in the ever-growing domain of edge devices with stringent resources has been impeded by the systems' ability to process…