PALM: A Efficient Performance Simulator for Tiled Accelerators with Large-scale Model Training

Jiahao Fang, Huizheng Wang, Qize Yang +5

Deep learning (DL) models are piquing high interest and scaling at an unprecedented rate. To this end, a handful of tiled accelerators have been proposed to support such large-scal…