5 papers · 1 filter
OntoURL: A Benchmark for Evaluating Large Language Models on Symbolic Ontological Understanding, Reasoning and Learning
Xiao Zhang, Huiyuan Lai, Qianru Meng +1
Large language models have demonstrated remarkable capabilities across a wide range of tasks, yet their ability to process structured symbolic knowledge remains underexplored. To a…
Is neural semantic parsing good at ellipsis resolution, or isn't it?
Xiao Zhang, Johan bos
Neural semantic parsers have shown good overall performance for a variety of linguistic phenomena, reaching semantic matching scores of more than 90%. But how do such parsers perfo…
Retrieval-Augmented Semantic Parsing: Improving Generalization with Lexical Knowledge
Xiao Zhang, Qianru Meng, Johan Bos
Open-domain semantic parsing remains a challenging task, as neural models often rely on heuristics and struggle to handle unseen concepts. In this paper, we investigate the potenti…
Neural Semantic Parsing with Extremely Rich Symbolic Meaning Representations
Xiao Zhang, Gosse Bouma, Johan Bos
Current open-domain neural semantics parsers show impressive performance. However, closer inspection of the symbolic meaning representations they produce reveals significant weakne…
PMB5: Gaining More Insight into Neural Semantic Parsing with Challenging Benchmarks
Xiao Zhang, Chunliu Wang, Rik van Noord +1
The Parallel Meaning Bank (PMB) serves as a corpus for semantic processing with a focus on semantic parsing and text generation. Currently, we witness an excellent performance of n…