18 citations · 21 across the 8 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.CL2024
GALLa: Graph Aligned Large Language Models for Improved Source Code Understanding
Ziyin Zhang, Hang Yu, Shijie Li +3
Programming languages possess rich semantic information - such as data flow - that is represented by graphs and not available from the surface form of source code. Recent code lang…
cs.CL2024★ 3 cited
Multiple-Choice Questions are Efficient and Robust LLM Evaluators
Ziyin Zhang, Zhaokun Jiang, Lizhen Xu +2
We present GSM-MC, a multiple-choice (MC) dataset constructed by collecting answers and incorrect predictions on GSM8K from 60 open-source models. Through extensive experiments, we…