3 papers
cs.CL2026
Hallucinations as Orthogonal Noise: Inference-Time Manifold Alignment via Dynamic Contextual Orthogonalization
Mingkuan Zhao, Wentao Hu, Tianchen Huang +6
Hallucination in Large Language Models (LLMs), characterized by the generation of content inconsistent with contextual facts or logical constraints -- remains a persistent challeng…
cs.CL2026
Resonant Context Anchoring: Decoupling Attention Routing and Signal Gain at Inference Time
Mingkuan Zhao, Yide Gao, Wentao Hu +6
Large Language Models (LLMs) frequently exhibit "contextual disregard" when faced with input evidence that conflicts with their internal parametric memory, leading to persistent fa…
cs.CV2024
Can Students Beyond The Teacher? Distilling Knowledge from Teacher's Bias
Jianhua Zhang, Yi Gao, Ruyu Liu +3
Knowledge distillation (KD) is a model compression technique that transfers knowledge from a large teacher model to a smaller student model to enhance its performance. Existing met…