4 papers
D5P4: Partition Determinantal Point Process for Diversity in Parallel Discrete Diffusion Decoding
Jonathan Lys, Vincent Gripon, Axel Marmoret +4
Discrete diffusion models are promising alternatives to autoregressive approaches for text generation, yet their decoding methods remain under-studied. Standard autoregressive sear…
Schemato -- An LLM for Netlist-to-Schematic Conversion
Ryoga Matsuo, Stefan Uhlich, Arun Venkitaraman +7
Machine learning models are advancing circuit design, particularly in analog circuits. They typically generate netlists that lack human interpretability. This is a problem as human…
Global-Order GFlowNets
LluÃs Pastor-Pérez, Javier Alonso-Garcia, Lukas Mauch
Order-Preserving (OP) GFlowNets have demonstrated remarkable success in tackling complex multi-objective (MOO) black-box optimization problems using stochastic optimization techniq…
On multi-token prediction for efficient LLM inference
Somesh Mehra, Javier Alonso Garcia, Lukas Mauch
We systematically investigate multi-token prediction (MTP) capabilities within LLMs pre-trained for next-token prediction (NTP). We first show that such models inherently possess M…