Showing 2026Show all
3 papers · 1 filter
cs.LG2026
Separators Make Carry Propagation Learnable:The Geometry of Latent Carry in a Multiplication Transformer
Sama Satariyan, Raphael Cousin, G{é}rard Biau
Transformers asked to multiply multi-digit numbers in a single forward pass often fail, and interpretability studies of pretrained language models find arithmetic solved by input-r…
cs.AI2026
Distilling LLM Feedback for Lean Theorem Proving
Gaetan Narozniak, Gérard Biau, Rémi Munos +2
Post-training for reasoning models typically combines supervised fine-tuning with reinforcement learning from verifiable rewards, most commonly with GRPO. However, this algorithm s…
math.ST2026
A Note on k-NN Gating in RAG
Gérard Biau, Claire Boyer
We propose a statistical proxy framework for retrieval-augmented generation (RAG) that formalizes how language models balance internal predictions with retrieved evidence. We deriv…