11 papers
Probing Semantic Alignment, Lexical Invariance, and Syntactic Influence in LLM Metaphor Processing
Fengying Ye, Shanshan Wang, Lidia S. Chao +1
Large language models (LLMs) achieve strong performance on metaphor detection and interpretation tasks, yet it remains unclear what such behavioral success reveals about metaphor p…
VisAidMath: Benchmarking Visual-Aided Mathematical Reasoning
Jingkun Ma, Runzhe Zhan, Yang Li +4
A hallmark of advanced artificial intelligence is the capacity to progress from passive visual perception to the strategic modification of visual information to facilitate complex…
Meta-Evaluation of Translation Evaluation Methods: a systematic up-to-date overview
Lifeng Han, Serge Gladkoff
Starting from the 1950s, Machine Translation (MT) was challenged by different scientific solutions, which included rule-based methods, example-based and statistical models (SMT), t…
SGIC: A Self-Guided Iterative Calibration Framework for RAG
Guanhua Chen, Yutong Yao, Lidia S. Chao +2
Recent research in retrieval-augmented generation (RAG) has concentrated on retrieving useful information from candidate documents. However, numerous methodologies frequently negle…
DetectRL: Benchmarking LLM-Generated Text Detection in Real-World Scenarios
Junchao Wu, Runzhe Zhan, Derek F. Wong +4
Detecting text generated by large language models (LLMs) is of great recent interest. With zero-shot methods like DetectGPT, detection capabilities have reached impressive levels.…
LLMCL-GEC: Advancing Grammatical Error Correction with LLM-Driven Curriculum Learning
Tao Fang, Derek F. Wong, Lusheng Zhang +5
While large-scale language models (LLMs) have demonstrated remarkable capabilities in specific natural language processing (NLP) tasks, they may still lack proficiency compared to…