activity
20242026
most citedProject MPG: towards a generalized performance benchmark for LLM capabilities

3 citations · 3 across the 6 of their papers we have counts for

collaborators

6 papers

cs.LG2026

First-Order In-Context Shapley: Scalable Data Auditing for LLM Alignment and Evaluation

Yunting Song, Matthew Watson, Moustafa Farid Alzantot +2

Post-training alignment of Large Language Models is increasingly bottlenecked by data quality: preference and instruction-tuning corpora accumulate label noise, safety inversions,…

cs.LG2025

Beyond Markovian: Reflective Exploration via Bayes-Adaptive RL for LLM Reasoning

Shenao Zhang, Yaqing Wang, Yinxiao Liu +5

Large Language Models (LLMs) trained via Reinforcement Learning (RL) have exhibited strong reasoning capabilities and emergent reflective behaviors, such as rethinking and error co…

cs.CL2025

Revisiting Funnel Transformers for Modern LLM Architectures with Comprehensive Ablations in Training and Inference Configurations

DongHyun Choi, Lucas Spangher, Chris Hidey +2

Transformer-based Large Language Models, which suffer from high computational costs, advance so quickly that techniques proposed to streamline earlier iterations are not guaranteed…

cs.AI2025

Factored Agents: Decoupling In-Context Learning and Memorization for Robust Tool Use

Nicholas Roth, Christopher Hidey, Lucas Spangher +6

In this paper, we propose a novel factored agent architecture designed to overcome the limitations of traditional single-agent systems in agentic AI. Our approach decomposes the ag…

cs.SE2024★ 3 cited

Project MPG: towards a generalized performance benchmark for LLM capabilities

Lucas Spangher, Tianle Li, William F. Arnold +6

There exists an extremely wide array of LLM benchmarking tasks, whereas oftentimes a single number is the most actionable for decision-making, especially by non-experts. No such ag…

cs.CL2024

Improving Multi-Agent Debate with Sparse Communication Topology

Yunxuan Li, Yibing Du, Jiageng Zhang +4

Multi-agent debate has proven effective in improving large language models quality for reasoning and factuality tasks. While various role-playing strategies in multi-agent debates…