activity
20162024
most citedBeyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

565 citations · 658 across the 5 of their papers we have counts for

collaborators

5 papers

cs.CL2024★ 3 cited

Rel-A.I.: An Interaction-Centered Approach To Measuring Human-LM Reliance

Kaitlyn Zhou, Jena D. Hwang, Xiang Ren +3

The ability to communicate uncertainty, risk, and limitation is crucial for the safety of large language models. However, current evaluations of these abilities rely on simple cali…

cs.CL2022★ 565 cited

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao +448

Language models demonstrate both quantitative improvement and new qualitative capabilities with increasing scale. Despite their potentially transformative impact, these new capabil…

cs.CL2019★ 1 cited

Specificity-Based Sentence Ordering for Multi-Document Extractive Risk Summarization

Berk Ekmekci, Eleanor Hagerman, Blake Howald

Risk mining technologies seek to find relevant textual extractions that capture entity-risk relationships. However, when high volume data sets are processed, a multitude of relevan…

cs.CL2019

A Consolidated System for Robust Multi-Document Entity Risk Extraction and Taxonomy Augmentation

Berk Ekmekci, Eleanor Hagerman, Blake Howald

We introduce a hybrid human-automated system that provides scalable entity-risk relation extractions across large data sets. Given an expert-defined keyword taxonomy, entities, and…

q-bio.OT2016★ 89 cited

An Introduction to Programming for Bioscientists: A Python-based Primer

Berk Ekmekci, Charles E. McAnany, Cameron Mura

Computing has revolutionized the biological sciences over the past several decades, such that virtually all contemporary research in the biosciences utilizes computer programs. The…