11 citations · 16 across the 10 of their papers we have counts for
3 papers · 1 filter
APOLLO: SGD-like Memory, AdamW-level Performance
Hanqing Zhu, Zhenyu Zhang, Wenyan Cong +7
Large language models (LLMs) are notoriously memory-intensive during training, particularly with the popular AdamW optimizer. This memory burden necessitates using more or higher-e…
PACE: Pacing Operator Learning to Accurate Optical Field Simulation for Complicated Photonic Devices
Hanqing Zhu, Wenyan Cong, Guojin Chen +4
Electromagnetic field simulation is central to designing, optimizing, and validating photonic devices and circuits. However, costly computation associated with numerical simulation…
Photonic-Electronic Integrated Circuits for High-Performance Computing and AI Accelerators
Shupeng Ning, Hanqing Zhu, Chenghao Feng +8
In recent decades, the demand for computational power has surged, particularly with the rapid expansion of artificial intelligence (AI). As we navigate the post-Moore's law era, th…