4 papers
STRIDE: Post-Training LLMs to Reason and Refine Bio-Sequences via Edit Trajectories
Daiheng Zhang, Shiyang Zhang, Sizhuang He +3
Discrete biological sequence optimization often requires goal-directed, parser-valid edits to an existing protein or molecule. Diffusion models support iterative refinement but do…
Non-Markovian Discrete Diffusion with Causal Language Models
Yangtian Zhang, Sizhuang He, Daniel Levine +7
Discrete diffusion models offer a flexible, controllable approach to structured sequence generation, yet they still lag behind causal language models in expressive power. A key lim…
Intelligence at the Edge of Chaos
Shiyang Zhang, Aakash Patel, Syed A Rizvi +5
We explore the emergence of intelligent behavior in artificial systems by investigating how the complexity of rule-based systems influences the capabilities of models trained to pr…
CaLMFlow: Volterra Flow Matching using Causal Language Models
Sizhuang He, Daniel Levine, Ivan Vrkic +6
We introduce CaLMFlow (Causal Language Models for Flow Matching), a novel framework that casts flow matching as a Volterra integral equation (VIE), leveraging the power of large la…