Showing cs.CLShow all
3 papers · 1 filter
cs.CL2026
Judging a Review by its Cover: A Reliability Analysis of LLM-based Peer Review Evaluation Metrics
Shakiba Amirshahi, Sajad Ebrahimi, Hai Son Le +2
Peer-review evaluation is increasingly being automated with LLM-as-a-judge metrics, but this creates a measurement risk. A review may receive a high score because it is fluent, org…
cs.CL2026
PeeriScope: A Multi-Faceted Framework for Evaluating Peer Review Quality
Sajad Ebrahimi, Soroush Sadeghian, Ali Ghorbanpour +6
The increasing scale and variability of peer review in scholarly venues has created an urgent need for systematic, interpretable, and extensible tools to assess review quality. We…
cs.CL2025
SocialHarmBench: Revealing LLM Vulnerabilities to Socially Harmful Requests
Punya Syon Pandey, Hai Son Le, Devansh Bhardwaj +2
Large language models (LLMs) are increasingly deployed in contexts where their failures can have direct sociopolitical consequences. Yet, existing safety benchmarks rarely test vul…