11 papers
HIVE: Hidden-Evidence Verification for Hallucination Detection in Diffusion Large Language Models
Guoshenghui Zhao, Tan Yu, Weijie Zhao
Diffusion large language models generate text through multi-step denoising, where hallucination signals may emerge throughout the trajectory rather than only in the final output. E…
RapidUn: Influence-Driven Parameter Reweighting for Efficient Large Language Model Unlearning
Guoshenghui Zhao, Huawei Lin, Weijie Zhao
Removing specific data influence from large language models (LLMs) remains challenging, as retraining is costly and existing approximate unlearning methods are often unstable. The…
Nexusformer: Nonlinear Attention Expansion for Stable and Inheritable Transformer Scaling
Weijie Zhao, Mingquan Liu, Bolun Wang +4
Scaling Transformers typically necessitates training larger models from scratch, as standard architectures struggle to expand without discarding learned representations. We identif…
Randomized Antipodal Search Done Right for Data Pareto Improvement of LLM Unlearning
Ziwen Liu, Huawei Lin, Yide Ran +5
Large language models (LLMs) sometimes memorize undesirable knowledge, which must be removed after deployment. Prior work on machine unlearning has focused largely on optimization…
DMin: Scalable Training Data Influence Estimation for Diffusion Models
Huawei Lin, Yingjie Lao, Weijie Zhao
Identifying the training data samples that most influence a generated image is a critical task in understanding diffusion models (DMs), yet existing influence estimation methods ar…
Agent-Omni: Test-Time Multimodal Reasoning via Model Coordination for Understanding Anything
Huawei Lin, Yunzhi Shi, Tong Geng +3
Multimodal large language models (MLLMs) have shown strong capabilities but remain limited to fixed modality pairs and require costly fine-tuning with large aligned datasets. Build…