From the 1 of 5 linked papers with an AI index.
5 papers
-OPSD: Deriving with Policy Optimization, Training with Self-Distillation
Jiawei Xu, Minghui Liu, Juzheng Zhang +2
The paper proposes β‑OPSD, a generalized on‑policy self‑distillation method that treats the KL regularization weight as a tunable parameter, enabling a controlled interpolation bet…
LoRI: Reducing Cross-Task Interference in Multi-Task Low-Rank Adaptation
Juzheng Zhang, Jiacheng You, Ashwinee Panda +1
Low-Rank Adaptation (LoRA) has emerged as a popular parameter-efficient fine-tuning (PEFT) method for Large Language Models (LLMs), yet it still incurs notable overhead and suffers…
UniMoT: Unified Molecule-Text Language Model with Discrete Token Representation
Shuhan Guo, Yatao Bian, Ruibing Wang +3
The remarkable success of Large Language Models (LLMs) across diverse tasks has driven the research community to extend their capabilities to molecular applications. However, most…
HIGHT: Hierarchical Graph Tokenization for Molecule-Language Alignment
Yongqiang Chen, Quanming Yao, Juzheng Zhang +2
Recently, there has been a surge of interest in extending the success of large language models (LLMs) from texts to molecules. Most existing approaches adopt a graph neural network…
Customized Subgraph Selection and Encoding for Drug-drug Interaction Prediction
Haotong Du, Quanming Yao, Juzheng Zhang +2
Subgraph-based methods have proven to be effective and interpretable in predicting drug-drug interactions (DDIs), which are essential for medical practice and drug development. Sub…