2 papers
cs.LG2026
BioArc: Discovering Optimal Neural Architectures for Biological Foundation Models
Yi Fang, Haoran Xu, Jiaxin Han +4
Foundation models have revolutionized various fields such as natural language processing (NLP) and computer vision (CV). While efforts have been made to transfer the success of the…
cs.LG2025
The Belief State Transformer
Edward S. Hu, Kwangjun Ahn, Qinghua Liu +9
We introduce the "Belief State Transformer", a next-token predictor that takes both a prefix and suffix as inputs, with a novel objective of predicting both the next token for the…