activity
20232026
most citedDesigning Large Foundation Models for Efficient Training and Inference: A Survey

5 citations · 10 across the 11 of their papers we have counts for

collaborators

13 papers

cs.LG2026

SleuthBench: Benchmarking Statistical LLM Evaluation Using Tabular Hidden Signals

Jingyun Jia, Antoine Remond-Tiedrez, Aaron Alvarez +3

Evaluating statistical discovery by large language model (LLM) agents requires verifiable analytical ground truth. Establishing such ground truth for real-world datasets is costly,…

cs.LG2026

RUBRIC: Realism--Utility Balanced Ranking for Imbalanced Classification

Yanxuan Yu, Dong Liu, Shu Wang +9

Class imbalance poses a fundamental challenge in risk-sensitive applications such as fraud detection and medical diagnosis, where minority-class samples are scarce yet critical for…

cs.LG2026

Retrieval-Augmented Interpretable Learning: Towards Task-Specific Zero-Shot Models in Healthcare

Sazan Mahbub, Caleb N. Ellington, Caleb Ellington +5

We introduce Retrieval-Augmented Interpretable Learning (RAIL), a probabilistic meta-learning framework for zero-shot generation of task-specific interpretable models that synthesi…

stat.ML2026

Context-Adaptive Inference: A Unified Statistical and Foundation-Model View

Yue Yao, Caleb N. Ellington, Jingyun Jia +9

Modern predictive systems are expected to adapt their behavior to the specific situation they are facing. A clinical model should not treat every patient the same; a retrieval-augm…

cs.RO2026

OLIVE: Online Low-Rank Incremental Learning for Efficient Adaptive Exoskeletons

Dong Liu, Yanxuan Yu, Ben Lengerich +2

Wearable exoskeleton systems hold promise for restoring mobility in individuals with physical impairments, yet most existing controllers rely on static gait policies that cannot ad…

cs.LG2026

MKA: Memory-Keyed Attention for Efficient Long-Context Reasoning

Dong Liu, Yanxuan Yu, Ben Lengerich +1

As long-context language modeling becomes increasingly important, the cost of maintaining and attending to large Key/Value (KV) caches grows rapidly, becoming a major bottleneck in…

cs.CV2026

AdaCorrection: Adaptive Offset Cache Correction for Accurate Diffusion Transformers

Dong Liu, Yanxuan Yu, Ben Lengerich +1

Diffusion Transformers (DiTs) achieve state-of-the-art performance in high-fidelity image and video generation but suffer from expensive inference due to their iterative denoising…

cs.CL2025

CSV-Decode: Certifiable Sub-Vocabulary Decoding for Efficient Large Language Model Inference

Dong Liu, Shu Wang, Yanxuan Yu +2

Large language models face significant computational bottlenecks during inference due to the expensive output layer computation over large vocabularies. We present CSV-Decode, a no…

cs.DC2025

PiKV: KV Cache Management System for Mixture of Experts

Dong Liu, Yanxuan Yu, Ben Lengerich +1

As large-scale language models continue to scale up in both size and context length, the memory and communication cost of key-value (KV) cache storage has become a major bottleneck…

cs.LG2025

FastCache: Fast Caching for Diffusion Transformer Through Learnable Linear Approximation

Dong Liu, Yanxuan Yu, Jiayi Zhang +3

Diffusion Transformers (DiT) are powerful generative models but remain computationally intensive due to their iterative structure and deep transformer stacks. To alleviate this ine…

cs.DC2024★ 5 cited

Designing Large Foundation Models for Efficient Training and Inference: A Survey

Dong Liu, Yanxuan Yu, Yite Wang +5

This paper focuses on modern efficient training and inference technologies on foundation models and illustrates them from two perspectives: model and system design. Model and Syste…

stat.ML2023★ 3 cited

Contextualized Machine Learning

Benjamin Lengerich, Caleb N. Ellington, Andrea Rubbi +2

We examine Contextualized Machine Learning (ML), a paradigm for learning heterogeneous and context-dependent effects. Contextualized ML estimates heterogeneous functions by applyin…

stat.ML2023★ 2 cited

LLMs Understand Glass-Box Models, Discover Surprises, and Suggest Repairs

Benjamin J. Lengerich, Sebastian Bordt, Harsha Nori +4

We show that large language models (LLMs) are remarkably good at working with interpretable models that decompose complex outcomes into univariate graph-represented components. By…