85 citations · 85 across the 2 of their papers we have counts for
2 papers
cs.DC2026
FCDP: Fully Cached Data Parallel for Communication-Avoiding Large-Scale Training
Gyeongseo Park, Eungyeong Lee, Song-woo Sok +5
Training billion-parameter models requires distributing model states across GPUs using fully sharded data parallel (i.e., ZeRO-3). While ZeRO-3 succeeds on clusters with high-bandw…
quant-ph2023★ 85 cited
Quantum-centric Supercomputing for Materials Science: A Perspective on Challenges and Future Directions
Yuri Alexeev, Maximilian Amsler, Paul Baity +124
Computational models are an essential tool for the design, characterization, and discovery of novel materials. Hard computational tasks in materials science stretch the limits of e…