11 papers
Uni-XAS: Alignment-Driven Bidirectional Multimodal Learning for X-ray Absorption Spectroscopy
Suyang Zhong, Yuhao Zhao, Boying Huang +6
X-ray absorption spectroscopy (XAS) is a key technique for probing local atomic environments, yet learning based modeling must bridge two heterogeneous modalities: 1D continuous sp…
EM3M: An Electron Micrograph Dataset for Microstructural Segmentation and Generation
Nan Wang, Zhiyi Xia, Yiming Li +7
Quantitative microstructural characterization is fundamental to materials science, and electron micrographs (EMs) provide indispensable high-resolution insights. However, progress…
SpecVQA: A Benchmark for Spectral Understanding and Visual Question Answering in Scientific Images
Jialu Shen, Han Lyu, Suyang Zhong +5
Spectra are a prevalent yet highly information-dense form of scientific imagery, presenting substantial challenges to multimodal large language models (MLLMs) due to their unstruct…
Uni-Parser Technical Report
Xi Fang, Haoyi Tao, Shuwen Yang +8
This technical report introduces Uni-Parser, an industrial-grade document parsing engine tailored for scientific literature and patents, delivering high throughput, robust accuracy…
OmniScience: A Large-scale Multi-modal Dataset for Scientific Image Understanding
Haoyi Tao, Chaozheng Huang, Nan Wang +4
Multimodal Large Language Models demonstrate strong performance on natural image understanding, yet exhibit limited capability in interpreting scientific images, including but not…
RxnBench: A Multimodal Benchmark for Evaluating Large Language Models on Chemical Reaction Understanding from Scientific Literature
Hanzheng Li, Xi Fang, Yixuan Li +9
The integration of Multimodal Large Language Models (MLLMs) into chemistry promises to revolutionize scientific discovery, yet their ability to comprehend the dense, graphical lang…