3 papers
cs.CL2026
Component-Aware Self-Speculative Decoding in Hybrid Language Models
Hector Borobia, Elies Seguí-Mas, Guillermina Tormo-Carbó
Speculative decoding accelerates autoregressive inference by drafting candidate tokens with a fast model and verifying them in parallel with the target. Self-speculative methods av…
cs.CL2026
Where Should LoRA Go? Component-Type Placement in Hybrid Language Models
Hector Borobia, Elies Seguí-Mas, Guillermina Tormo-Carbó
Hybrid language models that interleave attention with recurrent components are increasingly competitive with pure Transformers, yet standard LoRA practice applies adapters uniforml…
cs.LG2026
How Pruning Reshapes Features: Sparse Autoencoder Analysis of Weight-Pruned Language Models
Hector Borobia, Elies Seguí-Mas, Guillermina Tormo-Carbó
Weight pruning is a standard technique for compressing large language models, yet its effect on learned internal representations remains poorly understood. We present the first sys…