2 papers
cs.LG2026
Better Models, Faster Training: Sigmoid Attention for single-cell Foundation Models
Vijay Sadashivaiah, Georgios Dasoulas, Judith Mueller +1
Training stable biological foundation models requires rethinking attention mechanisms: we find that using sigmoid attention as a drop in replacement for softmax attention a) produc…
cs.LG2026
TEDDY: A Family Of Foundation Models For Understanding Single Cell Biology
Alexis Chevalier, Soumya Ghosh, Urvi Awasthi +15
Understanding the biological mechanisms of disease is crucial for medicine, and in particular, for drug discovery. AI-powered analysis of genome-scale biological data holds great p…