3 papers
cs.IT2026
Curvature-Weighted Capacity Allocation: A Minimum Description Length Framework for Layer-Adaptive Large Language Model Optimization
Theophilus Amaefuna, Hitesh Vaidya, Anshuman Chhabra +1
Layer-wise capacity in large language models is highly non-uniform: some layers contribute disproportionately to loss reduction, whereas others are nearly redundant. Existing layer…
cs.LG2024
Neuro-mimetic Task-free Unsupervised Online Learning with Continual Self-Organizing Maps
Hitesh Vaidya, Travis Desell, Ankur Mali +1
An intelligent system capable of continual learning is one that can process and extract knowledge from potentially infinitely long streams of pattern vectors. The major challenge t…
cs.LG2021
Reducing Catastrophic Forgetting in Self Organizing Maps with Internally-Induced Generative Replay
Hitesh Vaidya, Travis Desell, Alexander Ororbia
A lifelong learning agent is able to continually learn from potentially infinite streams of pattern sensory data. One major historic difficulty in building agents that adapt in thi…