Showing cs.CLShow all
3 papers · 1 filter
cs.CL2026
S-Attention:Attention-Aligned Endogenous Retrieval for Memory-Bounded Long-Context Inference
Qingsen Ma, Dianyun Wang, Yaoye Wang +7
Large language models are increasingly applied to multi-document and long-form inputs, yet long-context inference remains memory- and noise-inefficient. Key-value (KV) caching scal…
cs.CL2026
Interpretable Safety Alignment via SAE-Constructed Low-Rank Subspace Adaptation
Dianyun Wang, Qingsen Ma, Yuhu Shang +5
Safety alignment -- training large language models (LLMs) to refuse harmful requests while remaining helpful -- is critical for responsible deployment. Prior work established that…
cs.CL2025
CIP: A Plug-and-Play Causal Prompting Framework for Mitigating Hallucinations under Long-Context Noise
Qingsen Ma, Dianyun Wang, Ran Jing +2
Large language models often hallucinate when processing long and noisy retrieval contexts because they rely on spurious correlations rather than genuine causal relationships. We pr…