597 citations · 1.6k across the 28 of their papers we have counts for
28 papers
HybriDNA: A Hybrid Transformer-Mamba2 Long-Range DNA Language Model
Mingqian Ma, Guoqing Liu, Chuan Cao +12
Advances in natural language processing and large language models have sparked growing interest in modeling DNA, often referred to as the "language of life". However, DNA modeling…
RetroGraph: Retrosynthetic Planning with Graph Search
Shufang Xie, Rui Yan, Peng Han +5
Retrosynthetic planning, which aims to find a reaction pathway to synthesize a target molecule, plays an important role in chemistry and drug discovery. This task is usually modele…
IOT: Instance-wise Layer Reordering for Transformer Structures
Jinhua Zhu, Lijun Wu, Yingce Xia +5
With sequentially stacked self-attention, (optional) encoder-decoder attention, and feed-forward layers, Transformer achieves big success in natural language processing (NLP), and…
COSEA: Convolutional Code Search with Layer-wise Attention
Hao Wang, Jia Zhang, Yingce Xia +3
Semantic code search, which aims to retrieve code snippets relevant to a given natural language query, has attracted many research efforts with the purpose of accelerating software…
Masked Contrastive Representation Learning for Reinforcement Learning
Jinhua Zhu, Yingce Xia, Lijun Wu +4
Improving sample efficiency is a key research problem in reinforcement learning (RL), and CURL, which uses contrastive learning to extract high-level features from raw pixels of in…
DualLip: A System for Joint Lip Reading and Generation
Weicong Chen, Xu Tan, Yingce Xia +3
Lip reading aims to recognize text from talking lip, while lip generation aims to synthesize talking lip according to text, which is a key component in talking face generation and…