2 citations · 6 across the 16 of their papers we have counts for
5 papers · 1 filter
Automatic Evaluation for Text-to-image Generation: Task-decomposed Framework, Distilled Training, and Meta-evaluation Benchmark
Rong-Cheng Tu, Zi-Ao Ma, Tian Lan +3
Driven by the remarkable progress in diffusion models, text-to-image generation has made significant strides, creating a pressing demand for automatic quality evaluation of generat…
Multi-modal Retrieval Augmented Multi-modal Generation: Datasets, Evaluation Metrics and Strong Baselines
Zi-Ao Ma, Tian Lan, Rong-Cheng Tu +6
We present a systematic investigation of Multi-modal Retrieval Augmented Multi-modal Generation (MRAG), a novel task that enables foundation models to process multi-modal web c…
Training Language Models to Critique With Multi-agent Feedback
Tian Lan, Wenwei Zhang, Chengqi Lyu +6
Critique ability, a meta-cognitive capability of humans, presents significant challenges for LLMs to improve. Recent works primarily rely on supervised fine-tuning (SFT) using crit…
Beyond Exact Match: Semantically Reassessing Event Extraction by Large Language Models
Yi-Fan Lu, Xian-Ling Mao, Tian Lan +3
Event extraction has gained extensive research attention due to its broad range of applications. However, the current mainstream evaluation method for event extraction relies on to…
CriticEval: Evaluating Large Language Model as Critic
Tian Lan, Wenwei Zhang, Chen Xu +4
Critique ability, i.e., the capability of Large Language Models (LLMs) to identify and rectify flaws in responses, is crucial for their applications in self-improvement and scalabl…