2 papers
q-bio.GN2026
Structure is not mechanism: high-gain gated-FFN rows across text and genomic foundation models
Alexandros Tzanakakis, Aris Karatzikos, Ilias Georgakopoulos-Soares
A small number of unusually high-gain parameters can exert disproportionate effects in transformer language models, but whether analogous structures recur in genomic foundation mod…
q-bio.GN2025
Investigating DNA words and their distributions across the tree of life
Charalampos Koilakos, Kimonas Provatas, Michail Patsakis +2
The frequency distributions of DNA k-mers are shaped by fundamental biological processes and offer a window into genome structure and evolution. Inspired by analogies to natural la…