4 papers · 2 filters
Byzantine-Robust Federated RAG via Aligned Calibration and Fixed-Membership Conformal Prediction
Prasanjit Dubey, Xiaoming Huo, Aritra Guha
Retrieval-augmented generation (RAG) lets language models answer questions more accurately by consulting relevant documents. Many valuable collections, such as medical records, can…
Matching Rates and Optimal Allocation for Federated Probe-Logit Distillation under Heterogeneous Bandwidth Budgets
Prasanjit Dubey, Xiaoming Huo
In federated language modeling, nodes each hold samples but cannot pool data or exchange full-precision gradients or weights. We study the minimax rate at which a condition…
Certified Adaptive Refresh: Anytime-Valid Monitoring for Federated Conformal RAG
Prasanjit Dubey, Xiaoming Huo
Question-answering services built on retrieval-augmented generation (RAG), in which a language model answers from retrieved documents, are inspected continuously and upgraded repea…
Federated Language Models Under Bandwidth Budgets: Distillation Rates and Conformal Coverage
Prasanjit Dubey, Xiaoming Huo
Hospitals, companies, and research consortia want language models that learn from, and answer questions over, data that must stay where it is held, over links with limited bandwidt…