Showing 2026Show all
2 papers · 1 filter
cs.LG2026
Rethinking Reverse KL as Adaptive Entropy Distillation
Shizhen Li, Zhiyu Shen, Yuyin Lu +4
Knowledge distillation (KD) is widely used to transfer the capabilities of large language models (LLMs) to smaller students, but existing objectives often struggle to balance faith…
cs.CL2026
Double-Calibration: Towards Reliable LLMs via Calibrating Knowledge and Reasoning Confidence
Yuyin Lu, Ziran Liang, Yanghui Rao +3
Reliable reasoning in Large Language Models (LLMs) is challenged by their propensity for hallucination. While augmenting LLMs with Knowledge Graphs (KGs) improves factual accuracy,…