2 citations · 5 across the 23 of their papers we have counts for
5 papers · 1 filter
ReGRA: Residual-Gradient Adaptation for Complementary Low-Rank Fine-Tuning
Fanyao Li, Yuxi Liu, Xiaohao Liu +3
Low-rank adaptation (LoRA) enables parameter-efficient fine-tuning by learning low-rank weight updates. Increasing rank expands adaptation capacity, but does not guarantee that all…
BARQ: Balanced Codebook Refinement for Low-Bit LLM Quantization
Chenhang Cui, Xu Xie, Linrui Xu +4
As large language models (LLMs) grow in parameter count, model storage and parameter memory traffic have become major bottlenecks to efficient deployment. Codebook-based weight qua…
Hyperbolic Multimodal Continual Learning
Jiahong Liu, Ming Shen, Xiaohao Liu +4
Hyperbolic geometry has recently emerged as a powerful representation space for multimodal learning, as it naturally captures hierarchical semantic structure across modalities. Des…
AlphaSteer: Learning Refusal Steering with Principled Null-Space Constraint
Leheng Sheng, Changshuo Shen, Weixiang Zhao +6
As LLMs are increasingly deployed in real-world applications, ensuring their ability to refuse malicious prompts, especially jailbreak attacks, is essential for safe and reliable u…
Continual Multimodal Contrastive Learning
Xiaohao Liu, Xiaobo Xia, See-Kiong Ng +1
Multimodal Contrastive Learning (MCL) advances in aligning different modalities and generating multimodal representations in a joint space. By leveraging contrastive learning acros…