2 papers
cs.LG2026
The Effect of Layer Ordering in Hybrid Architectures
John Cooper, Mingchen Ma, Jiaqi Mo +4
Hybrid attention is rapidly becoming the dominant architectural choice for frontier models. Despite their successes, such architectures complicate model design by introducing addit…
cs.LG2026
Retrieval-guided Twin Fusion with Similarity-aware Contrast for Molecule-Text Alignment
Shunshun Gu, Shengqi Qiu, Hang Zhou +1
This paper studies the problem of molecule-text alignment, which aims to project molecules and their textual descriptions into a joint latent space for downstream tasks including m…