2 papers
cs.LG2026
Normalized Low-Rank Adaptation
Jiale Kang, Ziyin Yue, Zheng Zhan +2
While low-rank adaptation (LoRA) is widely used for parameter-efficient model adaptation, how to regularize its training dynamics for stable and effective optimization remains unde…
cs.CL2025
ModRWKV: Transformer Multimodality in Linear Time
Jiale Kang, Ziyin Yue, Qingyu Yin +4
Currently, most multimodal studies are based on large language models (LLMs) with quadratic-complexity Transformer architectures. While linear models like RNNs enjoy low inference…