3 papers
q-bio.QM2026
RadSEM: A Finding-by-Finding Metric for Clinical Consistency in Radiology Reports
Zhenhong Yang, Zhuoyun Liu, Jintao Fei +4
Radiology report evaluation must distinguish clinical compatibility from surface similarity, because negation, laterality, or normal-abnormal polarity can reverse a finding. We pro…
cs.CL2025
TCM-5CEval: Extended Deep Evaluation Benchmark for LLM's Comprehensive Clinical Research Competence in Traditional Chinese Medicine
Tianai Huang, Jiayuan Chen, Lu Lu +6
Large language models (LLMs) have demonstrated exceptional capabilities in general domains, yet their application in highly specialized and culturally-rich fields like Traditional…
cs.CL2025
TCM-3CEval: A Triaxial Benchmark for Assessing Responses from Large Language Models in Traditional Chinese Medicine
Tianai Huang, Lu Lu, Jiayuan Chen +5
Large language models (LLMs) excel in various NLP tasks and modern medicine, but their evaluation in traditional Chinese medicine (TCM) is underexplored. To address this, we introd…