activity
20172023
most citedThe GEM Benchmark: Natural Language Generation, its Evaluation and Metrics

52 citations · 165 across the 14 of their papers we have counts for

collaborators

19 papers

cs.CR20223 cited

ZK-IMG: Attested Images via Zero-Knowledge Proofs to Fight Disinformation

Daniel Kang, Tatsunori Hashimoto, Ion Stoica +1

Over the past few years, AI methods of generating images have been increasing in capabilities, with recent breakthroughs enabling high-resolution, photorealistic "deepfakes" (artif…

cs.CR202212 cited

Scaling up Trustless DNN Inference with Zero-Knowledge Proofs

Daniel Kang, Tatsunori Hashimoto, Ion Stoica +1

As ML models have increased in capabilities and accuracy, so has the complexity of their deployments. Increasingly, ML model consumers are turning to service providers to serve the…

cs.CL2022

Spurious Correlations in Reference-Free Evaluation of Text Generation

Esin Durmus, Faisal Ladhak, Tatsunori Hashimoto

Model-based, reference-free evaluation metrics have been proposed as a fast and cost-effective approach to evaluate Natural Language Generation (NLG) systems. Despite promising rec…

math.ST2021

Proof: Accelerating Approximate Aggregation Queries with Expensive Predicates

Daniel Kang, John Guibas, Peter Bailis +3

Given a dataset , we are interested in computing the mean of a subset of which matches a predicate. ABae leverages stratified sampling and proxy models t…

cs.CL20211 cited

Measuring Conversational Uptake: A Case Study on Student-Teacher Interactions

Dorottya Demszky, Jing Liu, Zid Mancenido +4

In conversation, uptake happens when a speaker builds on the contribution of their interlocutor by, for example, acknowledging, repeating or reformulating what they have said. In e…

cs.CL20213 cited

On the Inductive Bias of Masked Language Modeling: From Statistical to Syntactic Dependencies

Tianyi Zhang, Tatsunori Hashimoto

We study how masking and predicting tokens in an unsupervised fashion can give rise to linguistic structures and downstream performance gains. Recent theories have suggested that p…