What Is Next for LLMs? Next-Generation AI Computing Hardware Using Photonic Chips

Renjie Li, Wenjie Wei, Qi Xin +7

Large language models (LLMs) are rapidly pushing the limits of contemporary computing hardware. For example, training GPT-3 has been estimated to consume around 1300 MWh of electri…