3 papers
cs.DC2026
Optimizing Teacher-Student Partitioning for Scalable Knowledge Distillation on HPC Systems
Adrian P. Dieguez, Victor Conchello Vendrell, Alex Batlle +3
Knowledge Distillation (KD) enables training smaller student models under the guidance of larger teacher models, and the widely adopted TRL library implements it. Yet, TRL treats b…
cs.AI2026
LaneRoPE: Positional Encoding for Collaborative Parallel Reasoning and Generation
Gabriele Cesa, Thomas Hehn, Aleix Torres-Camps +4
Parallel LLM test-time scaling techniques (e.g., best-of-) require drawing sequences conditioned on the same input prompt. These methods boost accuracy while exploiting th…
cs.CL2026
M3Kang: Evaluating Multilingual Multimodal Mathematical Reasoning in Vision-Language Models
Aleix Torres-Camps, Nathaniel Mitrani Hadida, VÃctor Conchello Vendrell +3
Despite state-of-the-art vision-language models (VLMs) have demonstrated strong reasoning capabilities, their performance in multilingual mathematical reasoning remains underexplor…