11 papers
CRAFT: A Unified Counterfactual Reasoning Framework for Tabular Question Answering and Fact Verification
Chenshuo Pan, Yu Zhao, Jie Zhang +7
Table reasoning remains challenging for large language models (LLMs), particularly in tasks that require multi-step inference over long and structured tables. Existing approaches p…
ReasonTabQA: A Comprehensive Benchmark for Table Question Answering from Real World Industrial Scenarios
Changzai Pan, Jie Zhang, Kaiwen Wei +15
Recent advancements in Large Language Models (LLMs) have significantly catalyzed table-based question answering (TableQA). However, existing TableQA benchmarks often overlook the i…
TELEVAL: A Dynamic Benchmark Designed for Spoken Language Models in Chinese Interactive Scenarios
Zehan Li, Hongjie Chen, Qing Wang +10
Spoken language models (SLMs) have advanced rapidly in recent years, accompanied by a growing number of evaluation benchmarks. However, most existing benchmarks emphasize task comp…
Emotional Support with LLM-based Empathetic Dialogue Generation
Shiquan Wang, Ruiyu Fang, Zhongjiang He +2
Emotional Support Conversation (ESC) aims to provide empathetic and effective emotional assistance through dialogue, addressing the growing demand for mental health support. This p…
Introducing Visual Scenes and Reasoning: A More Realistic Benchmark for Spoken Language Understanding
Di Wu, Liting Jiang, Ruiyu Fang +7
Spoken Language Understanding (SLU) consists of two sub-tasks: intent detection (ID) and slot filling (SF). Given its broad range of real-world applications, enhancing SLU for prac…
MR-UIE: Multi-Perspective Reasoning with Reinforcement Learning for Universal Information Extraction
Zhongqiu Li, Shiquan Wang, Ruiyu Fang +5
Large language models (LLMs) demonstrate robust capabilities across diverse research domains. However, their performance in universal information extraction (UIE) remains insuffici…