4 papers
Towards Understanding What State Space Models Learn About Code
Jiali Wu, Abhinav Anand, Shweta Verma +1
State Space Models (SSMs) have emerged as an efficient alternative to the Transformer architecture. Prior work shows that, when trained under comparable conditions, SSMs can match…
Benchmark on Drug Target Interaction Modeling from a Drug Structure Perspective
Xinnan Zhang, Jialin Wu, Junyi Xie +2
The prediction modeling of drug-target interactions is crucial to drug discovery and design, which has seen rapid advancements owing to deep learning technologies. Recently develop…
From Parameter to Representation: A Closed-Form Approach for Controllable Model Merging
Jialin Wu, Jian Yang, Handing Wang +2
Model merging combines expert models for multitask performance but faces challenges from parameter interference. This has sparked recent interest in controllable model merging, giv…
EnchTable: Unified Safety Alignment Transfer in Fine-tuned Large Language Models
Jialin Wu, Kecen Li, Zhicong Huang +3
Many machine learning models are fine-tuned from large language models (LLMs) to achieve high performance in specialized domains like code generation, biomedical analysis, and math…