Longbo Huang

activity

20222024

most citedEffective Multi-User Delay-Constrained Scheduling with Deep Recurrent Reinforcement Learning

9 citations · 20 across the 14 of their papers we have counts for

collaborators

Showing 2024Show all

2 papers · 1 filter

cs.LG2024

Value-Based Deep Multi-Agent Reinforcement Learning with Dynamic Sparse Training

Pihe Hu, Shaolong Li, Zhuoran Li +2

Deep Multi-agent Reinforcement Learning (MARL) relies on neural networks with numerous parameters in multi-agent scenarios, often incurring substantial computational overhead. Cons…

cs.LG2024

Mixed Sparsity Training: Achieving 4 $\times$ FLOP Reduction for Transformer Pretraining

Pihe Hu, Shaolong Li, Longbo Huang

Large language models (LLMs) have made significant strides in complex tasks, yet their widespread adoption is impeded by substantial computational demands. With hundreds of billion…

Value-Based Deep Multi-Agent Reinforcement Learning with Dynamic Sparse Training

Mixed Sparsity Training: Achieving 4× FLOP Reduction for Transformer Pretraining

Mixed Sparsity Training: Achieving 4 $\times$ FLOP Reduction for Transformer Pretraining