works on
code generation 1coding agents 1fill-in-the-middle 1function-aware training 1mid-training 1

From the 1 of 21 linked papers with an AI index.

activity
20242026
collaborators
Showing cs.CLShow all

1 paper · 1 filter

cs.CL2024

MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI

Xiang Yue, Yuansheng Ni, Kai Zhang +19

We introduce MMMU: a new benchmark designed to evaluate multimodal models on massive multi-discipline tasks demanding college-level subject knowledge and deliberate reasoning. MMMU…