Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Rational ANOVA Networks
Jusheng Zhang, Ningyuan Liu, Qinhan Lyu +2
Deep neural networks typically treat nonlinearities as fixed primitives (e.g., ReLU), limiting both interpretability and the granularity of control over the induced function class.…
cs.LG2025
RevFFN: Memory-Efficient Full-Parameter Fine-Tuning of Mixture-of-Experts LLMs with Reversible Blocks
Ningyuan Liu, Jing Yang, Kaitong Cai +1
Full parameter fine tuning is a key technique for adapting large language models (LLMs) to downstream tasks, but it incurs substantial memory overhead due to the need to cache exte…