8 papers
Understanding the Behaviors of Environment-aware Information Retrieval
Ruifeng Yuan, Chaohao Yuan, David Dai +4
Recent retrieval-augmented generation (RAG) approaches have demonstrated strong capability in handling complex queries, yet current research overlooks a critical challenge: differe…
Decouple before Integration: Test-time Synthesis of SFT and RLVR Task Vectors
Chaohao Yuan, Chenghao Xiao, Yu Rong +2
SFT and RLVR represent two fundamental yet distinct paradigms for LLM post-training, each excelling in distinct dimensions. SFT expands knowledge breadth while RLVR enhances reason…
Lingshu-Cell: A generative cellular world model for transcriptome modeling toward virtual cells
Han Zhang, Guo-Hua Yuan, Chaohao Yuan +6
Modeling cellular states and predicting their responses to perturbations are central challenges in computational biology and the development of virtual cells. Existing foundation m…
IBCircuit: Towards Holistic Circuit Discovery with Information Bottleneck
Tian Bian, Yifan Niu, Chaohao Yuan +7
Circuit discovery has recently attracted attention as a potential research direction to explain the non-trivial behaviors of language models. It aims to find the computational subg…
ParaFormer: A Generalized PageRank Graph Transformer for Graph Representation Learning
Chaohao Yuan, Zhenjie Song, Ercan Engin Kuruoglu +5
Graph Transformers (GTs) have emerged as a promising graph learning tool, leveraging their all-pair connected property to effectively capture global information. To address the ove…
A Survey of Graph Transformers: Architectures, Theories and Applications
Chaohao Yuan, Kangfei Zhao, Ercan Engin Kuruoglu +6
Graph Transformers (GTs) have demonstrated a strong capability in modeling graph structures by addressing the intrinsic limitations of graph neural networks (GNNs), such as over-sm…