205 citations · 421 across the 9 of their papers we have counts for
3 papers · 1 filter
Decoding Looped Transformers Better for (Almost) Free
Weihao Liu, Huangjie Zheng, Tianrong Chen +5
Looped Transformers achieve parameter efficiency by repeatedly executing a shared block across recurrent loops. Each loop yields an intermediate representation decodable for the sa…
How to Guide Your Language Flow
Rohit Dilip, Tianrong Chen, Yuyang Wang +3
We introduce a new method to guide flow matching models. Our approach, which we call probe guidance, uses the frozen internal states of an existing diffusion model to construct a g…
Adaptive Protein Tokenization
Rohit Dilip, Ayush Varshney, David Van Valen
Tokenization is a promising path to multi-modal models capable of jointly understanding protein sequences, structure, and function. Existing protein structure tokenizers create tok…