activity
20242026
most citedAILuminate: Introducing v1.0 of the AI Risk and Reliability Benchmark from MLCommons

4 citations · 8 across the 6 of their papers we have counts for

collaborators

7 papers

cs.LG2026

Mixture of Complementary Agents for Robust LLM Ensemble

Yichi Zhang, Kevin Lu, Yuang Zhang +3

Multi-AI collaboration, such as ensembling or debating large language models (LLMs), is a promising paradigm for aggregating information and boosting performance. A foundational st…

cs.LG2026★ 1 cited

Two Stages of Folding: Convergent Mechanisms in AI Protein Folding Trunks

Kevin Lu, Jannik Brinkmann, Stefan Huber +4

How do protein structure prediction models fold proteins? We investigate this question through causal interventions on the folding trunks of ESMFold, OpenFold, and Boltz-1. Across…

cs.LG2025

When Are Concepts Erased From Diffusion Models?

Kevin Lu, Nicky Kriplani, Rohit Gandikota +4

In concept erasure, a model is modified to selectively prevent it from generating a target concept. Despite the rapid development of new methods, it remains unclear how thoroughly…

cs.CY2025★ 4 cited

AILuminate: Introducing v1.0 of the AI Risk and Reliability Benchmark from MLCommons

Shaona Ghosh, Heather Frase, Adina Williams +99

The rapid advancement and deployment of AI systems have created an urgent need for standard safety-evaluation frameworks. This paper introduces AILuminate v1.0, the first comprehen…

cs.CL2025★ 1 cited

LAG-MMLU: Benchmarking Frontier LLM Understanding in Latvian and Giriama

Naome A. Etori, Kevin Lu, Randu Karisa +1

As large language models (LLMs) rapidly advance, evaluating their performance is critical. LLMs are trained on multilingual data, but their reasoning abilities are mainly evaluated…

cs.SE2024

Rapid Mobile App Development for Generative AI Agents on MIT App Inventor

Jaida Gao, Calab Su, Etai Miller +2

The evolution of Artificial Intelligence (AI) stands as a pivotal force shaping our society, finding applications across diverse domains such as education, sustainability, and safe…

cs.LG2024★ 2 cited

Empowering Federated Learning for Massive Models with NVIDIA FLARE

Holger R. Roth, Ziyue Xu, Yuan-Ting Hsieh +12

In the ever-evolving landscape of artificial intelligence (AI) and large language models (LLMs), handling and leveraging data effectively has become a critical challenge. Most stat…