Showing cs.LGShow all
3 papers · 1 filter
cs.LG2026
Memorize Theorems, Not Instances: Probing SFT Generalization through Mathematical Reasoning
Ruiying Peng, Mengyu Yang, Jing Lei +3
Supervised Fine-Tuning (SFT) is widely used for task-specific adaptation, yet recent work shows it systematically undermines reasoning generalization. We argue the root cause is no…
cs.LG2024
Learning to (Learn at Test Time): RNNs with Expressive Hidden States
Yu Sun, Xinhao Li, Karan Dalal +9
Self-attention performs well in long context but has quadratic complexity. Existing RNN layers have linear complexity, but their performance in long context is limited by the expre…
cs.LG2023
Learning to (Learn at Test Time)
Yu Sun, Xinhao Li, Karan Dalal +6
We reformulate the problem of supervised learning as learning to learn with two nested loops (i.e. learning problems). The inner loop learns on each individual instance with self-s…