4 papers
FinanceComplexQA: Benchmarking Agentic Reasoning on Industrial-grade Financial Documents
Xianfu Cheng, Shiwei Zhang, Jiyu Zhao +10
Agentic Reasoning has become a transformative force in financial analysis due to its ability to integrate large-scale information and generate reliable and accurate content. Howeve…
M3TQA: Massively Multilingual Multitask Table Question Answering
Daixin Shu, Jian Yang, Zhenhe Wu +11
Tabular data is a fundamental component of real-world information systems, yet most research in table understanding remains confined to English, leaving multilingual comprehension…
SimpleVQA: Multimodal Factuality Evaluation for Multimodal Large Language Models
Xianfu Cheng, Wei Zhang, Shiwei Zhang +16
The increasing application of multi-modal large language models (MLLMs) across various sectors have spotlighted the essence of their output reliability and accuracy, particularly t…
ECLIPSE: Semantic Entropy-LCS for Cross-Lingual Industrial Log Parsing
Wei Zhang, Xianfu Cheng, Yi Zhang +8
Log parsing, a vital task for interpreting the vast and complex data produced within software architectures faces significant challenges in the transition from academic benchmarks…