VANDAM: Viewing a nucleotide sequence with DNA molecular priors

Jeremy Levy, Ariel Larey, Yury Nahshan +18

Contemporary Genomic Foundation Models (GFMs) rely on a DNA-as-a-string paradigm that employs masked token prediction objectives for pretraining. However, this abstraction does not…