BioMamba: Domain-Adaptive Biomedical Language Models

Ling Yue, Mingzhi Zhu, Sixue Xing +8

Background. Biomedical language models should improve performance on biomedical text while retaining general-language-modeling fluency. For Mamba-based models, this trade-off has n…