2 papers
cs.LG2025
Gene42: Long-Range Genomic Foundation Model With Dense Attention
Kirill Vishniakov, Boulbaba Ben Amor, Engin Tekin +12
We introduce Gene42, a novel family of Genomic Foundation Models (GFMs) designed to manage context lengths of up to 192,000 base pairs (bp) at a single-nucleotide resolution. Gene4…
cs.CV2024
MixMask: Revisiting Masking Strategy for Siamese ConvNets
Kirill Vishniakov, Eric Xing, Zhiqiang Shen
The recent progress in self-supervised learning has successfully combined Masked Image Modeling (MIM) with Siamese Networks, harnessing the strengths of both methodologies. Nonethe…