13 papers
Fundamental bounds on efficiency-confidence trade-off for transductive conformal prediction
Arash Behboodi, Alvaro H. C. Correia, Fabio Valerio Massoli +1
Transductive conformal prediction addresses the simultaneous prediction for multiple data points. Given a desired confidence level, the objective is to construct a prediction set t…
When Cloud Agents Meet Device Agents: Lessons from Hybrid Multi-Agent Systems
Corrado Rainone, Davide Belli, Bence Major +1
The design space of agentic AI inference spans two extremes: frontier large language models (LLMs), typically hosted in the cloud and offering strong performance across a wide rang…
LaneRoPE: Positional Encoding for Collaborative Parallel Reasoning and Generation
Gabriele Cesa, Thomas Hehn, Aleix Torres-Camps +4
Parallel LLM test-time scaling techniques (e.g., best-of-) require drawing sequences conditioned on the same input prompt. These methods boost accuracy while exploiting th…
Memory-Efficient Looped Transformer: Decoupling Compute from Memory in Looped Language Models
Victor Conchello Vendrell, Arnau Padres Masdemont, Niccolò Grillo +3
Recurrent LLM architectures have emerged as a promising approach for improving reasoning, as they enable multi-step computation in the embedding space without generating intermedia…
Reasoning as Compression: Unifying Budget Forcing via the Conditional Information Bottleneck
Fabio Valerio Massoli, Andrey Kuzmin, Arash Behboodi
\ac{CoT} prompting improves LLM accuracy on complex tasks but often increases token usage and inference cost. Existing ``Budget Forcing'' methods reduce cost via fine-tuning with h…
LUMINA: Long-horizon Understanding for Multi-turn Interactive Agents
Amin Rakhsha, Thomas Hehn, Pietro Mazzaglia +3
Large language models can perform well on many isolated tasks, yet they continue to struggle on multi-turn, long-horizon agentic problems that require skills such as planning, stat…