Exploiting Block Coordinate Descent for Cost-Effective LLM Model Training

Zeyu Liu, Yan Li, Yunquan Zhang +6

Training large language models typically demands extensive GPU memory and substantial financial investment, which poses a barrier for many small- to medium-sized teams. In this pap…