ChipLight: Cross-Layer Optimization of Chiplet Design with Optical Interconnects for LLM Training

Kangbo Bai, Zhantong Zhu, Yifan Ding +1

In large-scale distributed LLM training, communication between devices becomes the key performance bottleneck. Chiplet technology can integrate multiple dies into a package to scal…