activity
20202024
most citedUnderspecification Presents Challenges for Credibility in Modern Machine Learning

430 citations · 817 across the 12 of their papers we have counts for

collaborators

12 papers

cs.CL2024

Seed-Free Synthetic Data Generation Framework for Instruction-Tuning LLMs: A Case Study in Thai

Parinthapat Pengpun, Can Udomcharoenchaikit, Weerayut Buaphet +1

We present a synthetic data approach for instruction-tuning large language models (LLMs) for low-resource languages in a data-efficient manner, specifically focusing on Thai. We id…

cs.CL2024★ 1 cited

Beyond Performance: Quantifying and Mitigating Label Bias in LLMs

Yuval Reif, Roy Schwartz

Large language models (LLMs) have shown remarkable adaptability to diverse tasks, by leveraging context prompts containing instructions, or minimal input-output examples. However,…

cs.CL2024★ 297 cited

Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context

Gemini Team, Petko Georgiev, Ving Ian Lei +1132

In this report, we introduce the Gemini 1.5 family of models, representing the next generation of highly compute-efficient multimodal models capable of recalling and reasoning over…

cs.CL2023★ 8 cited

Batch Calibration: Rethinking Calibration for In-Context Learning and Prompt Engineering

Han Zhou, Xingchen Wan, Lev Proleev +4

Prompting and in-context learning (ICL) have become efficient learning paradigms for large language models (LLMs). However, LLMs suffer from prompt brittleness and various bias fac…

cs.SI2023

STUDY: Socially Aware Temporally Causal Decoder Recommender Systems

Eltayeb Ahmed, Diana Mincu, Lauren Harrell +2

Recommender systems are widely used to help people find items that are tailored to their interests. These interests are often influenced by social networks, making it important to…

cs.LG2023★ 1 cited

Benchmarking Continuous Time Models for Predicting Multiple Sclerosis Progression

Alexander Norcliffe, Lev Proleev, Diana Mincu +3

Multiple sclerosis is a disease that affects the brain and spinal cord, it can lead to severe disability and has no known cure. The majority of prior work in machine learning for m…

cs.LG2022★ 4 cited

Disability prediction in multiple sclerosis using performance outcome measures and demographic data

Subhrajit Roy, Diana Mincu, Lev Proleev +8

Literature on machine learning for multiple sclerosis has primarily focused on the use of neuroimaging data such as magnetic resonance imaging and clinical laboratory tests for dis…

cs.AI2022★ 9 cited

Healthsheet: Development of a Transparency Artifact for Health Datasets

Negar Rostamzadeh, Diana Mincu, Subhrajit Roy +7

Machine learning (ML) approaches have demonstrated promising results in a wide range of healthcare applications. Data plays a crucial role in developing ML-based healthcare systems…

cs.LG2022★ 32 cited

Diagnosing failures of fairness transfer across distribution shift in real-world medical settings

Jessica Schrouff, Natalie Harris, Oluwasanmi Koyejo +14

Diagnosing and mitigating changes in model fairness under distribution shift is an important component of the safe deployment of machine learning in healthcare settings. Importantl…

cs.LG2021★ 14 cited

Best of both worlds: local and global explanations with human-understandable concepts

Jessica Schrouff, Sebastien Baur, Shaobo Hou +6

Interpretability techniques aim to provide the rationale behind a model's decision, typically by explaining either an individual prediction (local explanation, e.g. 'why is this pa…

cs.LG2020★ 21 cited

Concept-based model explanations for Electronic Health Records

Diana Mincu, Eric Loreaux, Shaobo Hou +7

Recurrent Neural Networks (RNNs) are often used for sequential modeling of adverse outcomes in electronic health records (EHRs) due to their ability to encode past clinical states.…

cs.LG2020★ 430 cited

Underspecification Presents Challenges for Credibility in Modern Machine Learning

Alexander D'Amour, Katherine Heller, Dan Moldovan +37

ML models often exhibit unexpectedly poor behavior when they are deployed in real-world domains. We identify underspecification as a key reason for these failures. An ML pipeline i…