2 papers
cs.CL2026
Revisiting a Pain in the Neck: A Semantic Reasoning Benchmark for Language Models
Yang Liu, Hongming Li, Melissa Xiaohui Qin +2
We present SemanticQA, an evaluation suite designed to assess language models (LMs) in semantic phrase processing tasks. The benchmark consolidates existing multiword expression (M…
cs.CL2024
Revisiting a Pain in the Neck: Semantic Phrase Processing Benchmark for Language Models
Yang Liu, Melissa Xiaohui Qin, Hongming Li +1
We introduce LexBench, a comprehensive evaluation suite enabled to test language models (LMs) on ten semantic phrase processing tasks. Unlike prior studies, it is the first work to…