4 papers
Same Probabilities, Different Advice: Gain-Loss Framing Effects in High-Stakes LLM Decision Support
Yuyao Zhang, Yakun Cui, Han Zhu +3
Large language models (LLMs) are increasingly used to support consequential decisions, yet their reliability under equivalent representations of uncertainty remains unclear. Existi…
MMFCTUB: Multi-Modal Financial Credit Table Understanding Benchmark
Cui Yakun, Yanting Zhang, Zhu Lei +5
The advent of multi-modal language models (MLLMs) has spurred research into their application across various table understanding tasks. However, their performance in credit table u…
InsightEval: An Expert-Curated Benchmark for Assessing Insight Discovery in LLM-Driven Data Agents
Zhenghao Zhu, Yuanfeng Song, Xin Chen +5
Data analysis has become an indispensable part of scientific research. To discover the latent knowledge and insights hidden within massive datasets, we need to perform deep explora…
Perception, Understanding and Reasoning, A Multimodal Benchmark for Video Fake News Detection
Cui Yakun, Peng Qi, Fushuo Huo +6
The advent of multi-modal large language models (MLLMs) has greatly advanced research on video fake news detection (VFND) tasks. Existing benchmarks typically focus on the detectio…