2 papers
q-fin.TR2026
Understanding the Inner Workings of a State-Space Foundation Model for Limit Order Books
Valentin Mohl, Alexandre Bismuth, Aramis Marti-Shahandeh +6
Autoregressive foundation models offer state-of-the-art capabilities to simulate the market by generating the message flow of limit order books (LOBs). Yet, without understanding t…
cs.LG2026
Why don't Graph Transformers attend to the same token?
Alexandre Bismuth
In large language models (LLMs), attention concentrates heavily on the first token. This 'attention sink' is believed to protect deep models against over-mixing. Even though graph…