Evaluation of Coding Schemes for Transformer-based Gene Sequence Modeling

Chenlei Gong, Yuanhe Tian, Lei Mao +1

Currently, many studies view DNA sequences as a special type of language and utilize Transformers to model them. These studies use fixed-length k-mer segmentation and BPE subword t…