5 papers
TRL-Bench: Standardizing Cross-Paradigm Representation-Level Evaluation of Tabular Encoders
Wei Pang, Xiangru Jian, Hehan Li +10
Tabular encoders are usually evaluated inside task-specific end-to-end pipelines, so models from different training paradigms are difficult to compare directly even when they opera…
FORGE: Fine-grained Multimodal Evaluation for Manufacturing Scenarios
Xiangru Jian, Hao Xu, Wei Pang +13
The manufacturing sector is increasingly adopting Multimodal Large Language Models (MLLMs) to transition from simple perception to autonomous execution, yet current evaluations fai…
The Underappreciated Power of Vision Models for Graph Structural Understanding
Xinjian Zhao, Wei Pang, Zhongkai Xue +6
Graph Neural Networks operate through bottom-up message-passing, fundamentally differing from human visual perception, which intuitively captures global structures first. We invest…
Chem-R: Learning to Reason as a Chemist
Weida Wang, Benteng Chen, Di Zhang +14
Although large language models (LLMs) have significant potential to advance chemical discovery, current LLMs lack core chemical knowledge, produce unreliable reasoning trajectories…
AOT*: Efficient Synthesis Planning via LLM-Empowered AND-OR Tree Search
Xiaozhuang Song, Xuanhao Pan, Xinjian Zhao +4
Retrosynthesis planning enables the discovery of viable synthetic routes for target molecules, playing a crucial role in domains like drug discovery and materials design. Multi-ste…