8 citations · 13 across the 9 of their papers we have counts for
4 papers · 1 filter
Anticipatory Evaluation of Language Models: Predicting LLM Benchmark Scores from Descriptions
Jungsoo Park, Ethan Mendes, Gabriel Stanovsky +1
Modern ML research increasingly faces an evaluation bottleneck: building benchmarks and running experiments is costly, slowing iteration. We ask how much can be inferred about eval…
Granular Privacy Control for Geolocation with Vision Language Models
Ethan Mendes, Yang Chen, James Hays +3
Vision Language Models (VLMs) are rapidly advancing in their capability to answer information-seeking questions. As these models are widely deployed in consumer applications, they…
Can Language Models be Instructed to Protect Personal Information?
Yang Chen, Ethan Mendes, Sauvik Das +2
Large multimodal language models have proven transformative in numerous applications. However, these models have been shown to memorize and leak pre-training data, raising serious…
Human-in-the-loop Evaluation for Early Misinformation Detection: A Case Study of COVID-19 Treatments
Ethan Mendes, Yang Chen, Wei Xu +1
We present a human-in-the-loop evaluation framework for fact-checking novel misinformation claims and identifying social media messages that support them. Our approach extracts che…