Distilling Genomic Models for Efficient mRNA Representation Learning via Embedding Matching

Rasched Haidari, Sam Martin, Maxime Allard

Large Genomic Foundation Models have recently achieved remarkable results and in-vivo translation capabilities. However these models quickly grow to over a few Billion of parameter…