3 papers
cs.CL2026
High-Layer Attention Pruning with Rescaling
Songtao Liu, Peng Liu
Pruning is a highly effective approach for compressing large language models (LLMs), significantly reducing inference latency. However, conventional training-free structured prunin…
cs.LG2025
Evaluating Molecule Synthesizability via Retrosynthetic Planning and Reaction Prediction
Songtao Liu, Dandan Zhang, Zhengkai Tu +2
A significant challenge in wet lab experiments with current drug design generative models is the trade-off between pharmacological properties and synthesizability. Molecules predic…
cs.LG2024
Preference Optimization for Molecule Synthesis with Conditional Residual Energy-based Models
Songtao Liu, Hanjun Dai, Yue Zhao +1
Molecule synthesis through machine learning is one of the fundamental problems in drug discovery. Current data-driven strategies employ one-step retrosynthesis models and search al…