4 papers · 1 filter
Matching Rates and Optimal Allocation for Federated Probe-Logit Distillation under Heterogeneous Bandwidth Budgets
Prasanjit Dubey, Xiaoming Huo
In federated language modeling, nodes each hold samples but cannot pool data or exchange full-precision gradients or weights. We study the minimax rate at which a condition…
Anytime-Valid Federated Conformal RAG for LLM Swarms
Prasanjit Dubey, Xiaoming Huo
Federated Conformal RAG (FC-RAG) provides distribution-free coverage for a bandwidth-limited swarm of weak language models, but only at a fixed horizon. We extend it to anytime-val…
Federated Language Models Under Bandwidth Budgets: Distillation Rates and Conformal Coverage
Prasanjit Dubey, Xiaoming Huo
Training a language model on data scattered across bandwidth-limited nodes that cannot be centralized is a setting that arises in clinical networks, enterprise knowledge bases, and…
LLmFPCA-detect: LLM-powered Multivariate Functional PCA for Anomaly Detection in Sparse Longitudinal Texts
Prasanjit Dubey, Aritra Guha, Zhengyi Zhou +3
Sparse longitudinal (SL) textual data arises when individuals generate text repeatedly over time (e.g., customer reviews, occasional social media posts, electronic medical records…