#language modeling
5 papers match
Looped Transformers with Source-Centered State Evolution
Bum Jun Kim, Kohei Hayashi, Shunsuke Kamiya +3
The paper introduces Source‑Centered State Evolution (SCSE), a method for looped Transformers that preserves input conditioning while keeping a fixed reference point, improving rec…
Latent-Kernel Discrete Flow Maps for Few-Step Generation
Mansoor Ahmed, Yue-Tsz Fan, Hemanth Venkateswara +1
The paper proposes Latent‑Kernel Discrete Flow Maps, a flow‑based model that uses a shared latent variable to tie together multiple factorized components, enabling correlated updat…
Robust Filter Attention: Self-Attention as Precision-Weighted State Estimation
Peter Racioppo
The paper presents Robust Filter Attention, a new view of self‑attention as a robust state estimator based on linear stochastic differential equations, and shows it improves langua…
Discrete Diffusion Models: A Unified Framework from Tokenization to Generation
Ye Yuan, Weien Li, Rui Song +19
The paper proposes a unified framework for discrete denoising diffusion models that ties together tokenization, vocabulary design, and generation methods, showing how existing appr…
The Capacity of Thought: Benchmarking Llama 3.2 in Semantic fMRI Neural Language Decoding and Improving the Huth Encoding-Model Baseline
Milos Suvakovic, Dom Marhoefer, Glenn Grant-Richards +1
The paper studies decoding continuous language from fMRI signals by improving an existing ridge‑regression encoding pipeline and introducing fMRIFlamingo, which maps brain activity…