From the 1 of 10 linked papers with an AI index.
10 papers
Stochastic Meta-Unlearning: Bridging Language Backbone and Multimodal Unlearning
Zijie Liu, Jinhao Duan, Gaowen Liu +2
Machine unlearning for vision-language models (VLMs) remains underexplored. Unlike language models, VLMs combine a language backbone with visual components, which makes unlearning…
A Replicate-and-Quantize Strategy for Plug-and-Play Load Balancing of Sparse Mixture-of-Experts LLMs
Zijie Liu, Jie Peng, Jinhao Duan +7
The paper proposes a training‑free method that replicates heavily used experts and quantizes less important ones to rebalance workload in sparse mixture‑of‑experts large language m…
RAVEN: Agentic RAG for Automated Vulnerability Repair
Varun Gadey, Zijie Liu, Alexandra Dmitrienko
Automated vulnerability repair has emerged as a promising direction to mitigate the growing number of software vulnerabilities. Recent advances in Large Language Models (LLMs) have…
GEMQ: Global Expert-Level Mixed-Precision Quantization for MoE LLMs
Jianing Deng, Song Wang, Dongwei Wang +4
Mixture-of-Experts Large Language Models (MoE-LLMs) achieve strong performance but incur substantial memory overhead due to massive expert parameters. Mixed-precision quantization…
SWE-Next: Scalable Real-World Software Engineering Tasks for Agents
Jiarong Liang, Zhiheng Lyu, Zijie Liu +4
Executable software engineering data is valuable for training SWE agents, but scaling it remains difficult for two reasons: only a small fraction of real repository changes yield v…
Dialogue is Better Than Monologue: Instructing Medical LLMs via Strategical Conversations
Zijie Liu, Xinyu Zhao, Jie Peng +5
Current medical AI systems often fail to replicate real-world clinical reasoning, as they are predominantly trained and evaluated on static text and question-answer tasks. These tu…