activity
20222026
most citedLiveBench: A Challenging, Contamination-Limited LLM Benchmark

20 citations · 27 across the 16 of their papers we have counts for

collaborators
Showing 2024Show all

6 papers · 1 filter

cs.CV20241 cited

Hidden in the Noise: Two-Stage Robust Watermarking for Images

Kasra Arabi, Benjamin Feuer, R. Teal Witter +2

As the quality of image generators continues to improve, deepfakes become a topic of considerable societal debate. Image watermarking allows responsible model owners to detect and…

cs.CV2024

SELECT: A Large-Scale Benchmark of Data Curation Strategies for Image Classification

Benjamin Feuer, Jiawei Xu, Niv Cohen +3

Data curation is the problem of how to collect and organize samples into a dataset that supports efficient learning. Despite the centrality of the task, little work has been devote…

cs.LG20241 cited

Style Outweighs Substance: Failure Modes of LLM Judges in Alignment Benchmarking

Benjamin Feuer, Micah Goldblum, Teresa Datta +5

The release of ChatGPT in November 2022 sparked an explosion of interest in post-training and an avalanche of new preference optimization (PO) methods. These methods claim superior…

cs.CL202420 cited

LiveBench: A Challenging, Contamination-Limited LLM Benchmark

Colin White, Samuel Dooley, Manley Roberts +15

Test set contamination, wherein test data from a benchmark ends up in a newer model's training set, is a well-documented obstacle for fair LLM evaluation and can quickly render ben…

cs.CV20242 cited

BioTrove: A Large Curated Image Dataset Enabling AI for Biodiversity

Chih-Hsuan Yang, Benjamin Feuer, Zaki Jubery +12

We introduce BioTrove, the largest publicly accessible dataset designed to advance AI applications in biodiversity. Curated from the iNaturalist platform and vetted to include only…

cs.LG2024

TuneTables: Context Optimization for Scalable Prior-Data Fitted Networks

Benjamin Feuer, Robin Tibor Schirrmeister, Valeriia Cherepanova +5

While tabular classification has traditionally relied on from-scratch training, a recent breakthrough called prior-data fitted networks (PFNs) challenges this approach. Similar to…