A Survey on Memory-Efficient Transformer-Based Model Training in AI for Science

Kaiyuan Tian, Linbo Qiao, Baihui Liu +3

Scientific research faces high costs and inefficiencies with traditional methods, but the rise of deep learning and large language models (LLMs) offers innovative solutions. This s…