4 papers
Am I More Pointwise or Pairwise? Revealing Position Bias in Rubric-Based LLM-as-a-Judge
Yuzheng Xu, Tosho Hirasawa, Tadashi Kozuno +1
Large language models are widely employed as evaluators, a paradigm commonly referred to as LLM-as-a-judge. Prior research has predominantly examined point-wise or pair-wise evalua…
WarrantScore: Modeling Warrants between Claims and Evidence for Substantiation Evaluation in Peer Reviews
Kiyotada Mori, Shohei Tanaka, Tosho Hirasawa +3
The scientific peer-review process is facing a shortage of human resources due to the rapid growth in the number of submitted papers. The use of language models to reduce the human…
LAPPI: Interactive Optimization with LLM-Assisted Preference-Based Problem Instantiation
So Kuroki, Manami Nakagawa, Shigeo Yoshida +2
Many real-world tasks, such as trip planning or meal planning, can be formulated as combinatorial optimization problems. However, using optimization solvers is difficult for end us…
MK2 at PBIG Competition: A Prompt Generation Solution
Yuzheng Xu, Tosho Hirasawa, Seiya Kawano +2
The Patent-Based Idea Generation task asks systems to turn real patents into product ideas viable within three years. We propose MK2, a prompt-centric pipeline: Gemini 2.5 drafts a…