2 citations · 3 across the 4 of their papers we have counts for
5 papers
MUSS: A Multi-scale and Sequence-based Model for Single-cell Gene Regulation
Kangjie Zheng, Amirhossein Vahidi, Liying Jin +7
Modeling gene regulation in single cells requires jointly representing DNA sequence, chromatin accessibility, and gene expression across regulatory scales. Sequence-based models ca…
A Decoding Algorithm for Length-Control Summarization Based on Directed Acyclic Transformers
Chenyang Huang, Hao Zhou, Cameron Jen +3
Length-control summarization aims to condense long texts into a short one within a certain length limit. Previous approaches often use autoregressive (AR) models and treat the leng…
ExLM: Rethinking the Impact of [MASK] Tokens in Masked Language Models
Kangjie Zheng, Junwei Yang, Siyue Liang +5
Masked Language Models (MLMs) have achieved remarkable success in many self-supervised representation learning tasks. MLMs are trained by randomly masking portions of the input seq…
SMI-Editor: Edit-based SMILES Language Model with Fragment-level Supervision
Kangjie Zheng, Siyue Liang, Junwei Yang +5
SMILES, a crucial textual representation of molecular structures, has garnered significant attention as a foundation for pre-trained language models (LMs). However, most existing p…
ESM All-Atom: Multi-scale Protein Language Model for Unified Molecular Modeling
Kangjie Zheng, Siyu Long, Tianyu Lu +6
Protein language models have demonstrated significant potential in the field of protein engineering. However, current protein language models primarily operate at the residue scale…