From the 1 of 12 linked papers with an AI index.
5 papers · 1 filter
Faster Synchronous On-Policy RL via Straggler-Aware Group Sizing
Azal Ahmad Khan, Ammar Ahmed, Zeshan Fayyaz +3
Synchronous reinforcement learning methods such as Group Relative Policy Optimization (GRPO) provide stable and reproducible on-policy training, but they are highly vulnerable to s…
Accelerating LLM Reasoning via Early Rejection with Partial Reward Modeling
Seyyed Saeid Cheshmi, Azal Ahmad Khan, Xinran Wang +2
Large Language Models (LLMs) are increasingly relied upon for solving complex reasoning tasks in domains such as mathematics, logic, and multi-step question answering. A growing li…
Personalized Federated Learning Techniques: Empirical Analysis
Azal Ahmad Khan, Ahmad Faraz Khan, Haider Ali +1
Personalized Federated Learning (pFL) holds immense promise for tailoring machine learning models to individual users while preserving data privacy. However, achieving optimal perf…
DynamicFL: Federated Learning with Dynamic Communication Resource Allocation
Qi Le, Enmao Diao, Xinran Wang +3
Federated Learning (FL) is a collaborative machine learning framework that allows multiple users to train models utilizing their local data in a distributed manner. However, consid…
ColA: Collaborative Adaptation with Gradient Learning
Enmao Diao, Qi Le, Suya Wu +4
A primary function of back-propagation is to compute both the gradient of hidden representations and parameters for optimization with gradient descent. Training large models requir…