4 papers
ERNIE 5.0 Technical Report
Haifeng Wang, Hua Wu, Tian Wu +432
In this report, we introduce ERNIE 5.0, a natively autoregressive foundation model desinged for unified multimodal understanding and generation across text, image, video, and audio…
siDPT: siRNA Efficacy Prediction via Debiased Preference-Pair Transformer
Honggen Zhang, Xiangrui Gao, Lipeng Lai
Small interfering RNA (siRNA) is a short double-stranded RNA molecule (about 21-23 nucleotides) with the potential to cure diseases by silencing the function of target genes. Due t…
REAL: Response Embedding-based Alignment for LLMs
Honggen Zhang, Xufeng Zhao, Igor Molybog +1
Aligning large language models (LLMs) to human preferences is a crucial step in building helpful and safe AI tools, which usually involve training on supervised datasets. Popular a…
mRNA2vec: mRNA Embedding with Language Model in the 5'UTR-CDS for mRNA Design
Honggen Zhang, Xiangrui Gao, June Zhang +1
Messenger RNA (mRNA)-based vaccines are accelerating the discovery of new drugs and revolutionizing the pharmaceutical industry. However, selecting particular mRNA sequences for va…