7 papers
When Retain Constraints Conflict: Mitigating Forget-Retain Interference in Tabular Data
Zijie Liu, Jinhao Duan, Bingqi Shang +3
Machine unlearning aims to remove the influence of designated training data while preserving model utility, but its behavior on tabular data remains underexplored. This gap is impo…
SAF3R: Dynamic Sparse Attention for Feed-Forward 3D Reconstruction Transformers
Jianing Deng, Yuanzhe Li, Jialu Wang +4
Feed-forward 3D reconstruction (F3R) transformers have recently achieved remarkable success. However, scaling them to long image sequences remains challenging, as the quadratic com…
FairGen: Preference-Aligned Diffusion for Demographically Equitable Medical Image Synthesis
Zhimin Li, Ruichen Zhang, Zhen Tan +3
Medical imaging is central to modern diagnostics, and artificial intelligence (AI) systems are increasingly used to support image-based analysis by improving efficiency, accuracy,…
GEMQ: Global Expert-Level Mixed-Precision Quantization for MoE LLMs
Jianing Deng, Song Wang, Dongwei Wang +4
Mixture-of-Experts Large Language Models (MoE-LLMs) achieve strong performance but incur substantial memory overhead due to massive expert parameters. Mixed-precision quantization…
Dynamic Mixed-Precision Routing for Efficient Multi-step LLM Interaction
Yuanzhe Li, Jianing Deng, Jingtong Hu +3
Large language models (LLMs) achieve strong performance in long-horizon decision-making tasks through multi-step interaction and reasoning at test time. While practitioners commonl…
FIER: Fine-Grained and Efficient KV Cache Retrieval for Long-context LLM Inference
Dongwei Wang, Zijie Liu, Song Wang +5
The Key-Value (KV) cache reading latency increases significantly with context lengths, hindering the efficiency of long-context LLM inference. To address this, previous works propo…