4 citations · 4 across the 2 of their papers we have counts for
3 papers
Overcoming Scaling Limits in On-Policy Self-Distillation for LLM Reasoning
Md. Ismail Hossain, Humaira Kousar, Isidora Chara Tourni
On-policy self-distillation (OPSD) trains a student to match a privileged teacher distribution along its own sampled trajectory. Standard OPSD applies this supervision to unverifie…
Pruning-based Data Selection and Network Fusion for Efficient Deep Learning
Humaira Kousar, Hasnain Irshad Bhatti, Jaekyun Moon
Efficient data selection is essential for improving the training efficiency of deep neural networks and reducing the associated annotation costs. However, traditional methods tend…
EvoFed: Leveraging Evolutionary Strategies for Communication-Efficient Federated Learning
Mohammad Mahdi Rahimi, Hasnain Irshad Bhatti, Younghyun Park +2
Federated Learning (FL) is a decentralized machine learning paradigm that enables collaborative model training across dispersed nodes without having to force individual nodes to sh…