Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Consensus as Privileged Context for Label-Free Self-Distillation
John Gkountouras, Josip Jukić, Ivan Titov
Sampling multiple solutions and returning the majority answer is among the most reliable ways to improve the reasoning accuracy of large language models without labels, and a growi…
cs.LG2026
Geometric Self-Distillation for Reasoning Generalization
Josip Jukić, Ivan Titov
On-policy distillation provides dense teacher supervision on a language model's own trajectories. In self-distillation with privileged context, this supervision comes from the mode…