Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Orth-Dion: Eliminating Geometric Mismatch in Distributed Low-Rank Spectral Optimization
Tatsuhiro Nakamori, Laura Gomezjurado Gonzalez, Ganesh Talluri +5
Low-rank gradient compression reduces communication in distributed training by representing updates with rank- factors. Dion is a recent method that approximates Muon, a spectra…
cs.LG2025
Local Timescale Gates for Timescale-Robust Continual Spiking Neural Networks
Ansh Tiwari, Devansh Deep, Ayush Chauhan
Spiking neural networks (SNNs) promise energy-efficient artificial intelligence on neuromorphic hardware but struggle with tasks requiring both fast adaptation and long-term memory…