Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
QUATRO: Query-Adaptive Trust Region Policy Optimization for LLM Fine-tuning
Doyeon Lee, Eunyi Lyou, Hyunsoo Cho +3
GRPO-style reinforcement learning (RL)-based LLM fine-tuning algorithms have recently gained popularity. Relying on heuristic trust-region approximations, however, they can lead to…
cs.LG2026
Trust the uncertain teacher: distilling dark knowledge via calibrated uncertainty
Jeonghyun Kim, SooKyung Kim, Richeng Xuan +1
The core of knowledge distillation lies in transferring the teacher's rich 'dark knowledge'-subtle probabilistic patterns that reveal how classes are related and the distribution o…