Showing 2025Show all
2 papers · 1 filter
cs.LG2025
Autoregressive Language Models are Secretly Energy-Based Models: Insights into the Lookahead Capabilities of Next-Token Prediction
Mathieu Blondel, Michael E. Sander, Germain Vivier-Ardisson +2
Autoregressive models (ARMs) currently constitute the dominant paradigm for large language models (LLMs). Energy-based models (EBMs) represent another class of models, which have h…
cs.LG2025
Learning with Local Search MCMC Layers
Germain Vivier-Ardisson, Mathieu Blondel, Axel Parmentier
Integrating combinatorial optimization layers into neural networks has recently attracted significant research interest. However, many existing approaches lack theoretical guarante…