2 papers
cs.CL2024
Model-diff: A Tool for Comparative Study of Language Models in the Input Space
Weitang Liu, Yuelei Li, Ying Wai Li +2
Comparing two (large) language models (LMs) side-by-side and pinpointing their prediction similarities and differences on the same set of inputs are crucial in many real-world scen…
cs.LG2024
Evaluation of human-model prediction difference on the Internet Scale of Data
Weitang Liu, Ying Wai Li, Yuelei Li +3
Evaluating models on datasets often fails to capture their behavior when faced with unexpected and diverse types of inputs. It would be beneficial if we could evaluate the differen…