6 citations · 6 across the 3 of their papers we have counts for
6 papers
Multi-scale Graph Autoregressive Modeling: Molecular Property Prediction via Next Token Prediction
Zhuoyang Jiang, Yaosen Min, Peiran Jin +1
We present Connection-Aware Motif Sequencing (CamS), a graph-to-sequence representation that enables decoder-only Transformers to learn molecular graphs via standard next-token pre…
MolChord: Structure-Sequence Alignment for Protein-Guided Drug Design
Wei Zhang, Zekun Guo, Yingce Xia +4
Structure-based drug design (SBDD), which maps target proteins to candidate molecular ligands, is a fundamental task in drug discovery. Effectively aligning protein structural repr…
Trust Region Preference Approximation: A simple and stable reinforcement learning algorithm for LLM reasoning
Xuerui Su, Shufang Xie, Guoqing Liu +7
Recently, Large Language Models (LLMs) have rapidly evolved, approaching Artificial General Intelligence (AGI) while benefiting from large-scale reinforcement learning to enhance H…
HybriDNA: A Hybrid Transformer-Mamba2 Long-Range DNA Language Model
Mingqian Ma, Guoqing Liu, Chuan Cao +12
Advances in natural language processing and large language models have sparked growing interest in modeling DNA, often referred to as the "language of life". However, DNA modeling…
Nature Language Model: Deciphering the Language of Nature for Scientific Discovery
Yingce Xia, Peiran Jin, Shufang Xie +43
Foundation models have revolutionized natural language processing and artificial intelligence, significantly enhancing how machines comprehend and generate human languages. Inspire…
E2Former: An Efficient and Equivariant Transformer with Linear-Scaling Tensor Products
Yunyang Li, Lin Huang, Zhihao Ding +10
Equivariant Graph Neural Networks (EGNNs) have demonstrated significant success in modeling microscale systems, including those in chemistry, biology and materials science. However…