Beyond Conditional Computation: Retrieval-Augmented Genomic Foundation Models with Gengram

Huinan Xu, Xuyang Feng, Junhong Chen +9

Current genomic foundation models (GFMs) rely on extensive neural computation to implicitly approximate conserved biological motifs from single-nucleotide inputs. We propose Gengra…