4 papers
Decouple before Integration: Test-time Synthesis of SFT and RLVR Task Vectors
Chaohao Yuan, Chenghao Xiao, Yu Rong +2
SFT and RLVR represent two fundamental yet distinct paradigms for LLM post-training, each excelling in distinct dimensions. SFT expands knowledge breadth while RLVR enhances reason…
Lingshu-Cell: A generative cellular world model for transcriptome modeling toward virtual cells
Han Zhang, Guo-Hua Yuan, Chaohao Yuan +6
Modeling cellular states and predicting their responses to perturbations are central challenges in computational biology and the development of virtual cells. Existing foundation m…
IBCircuit: Towards Holistic Circuit Discovery with Information Bottleneck
Tian Bian, Yifan Niu, Chaohao Yuan +7
Circuit discovery has recently attracted attention as a potential research direction to explain the non-trivial behaviors of language models. It aims to find the computational subg…
ParaFormer: A Generalized PageRank Graph Transformer for Graph Representation Learning
Chaohao Yuan, Zhenjie Song, Ercan Engin Kuruoglu +5
Graph Transformers (GTs) have emerged as a promising graph learning tool, leveraging their all-pair connected property to effectively capture global information. To address the ove…