Spectrum: Targeted Training on Signal to Noise Ratio

Eric Hartford, Lucas Atkins, Fernando Fernandes Neto +1

Efficiently post-training large language models remains a challenging task due to the vast computational resources required. We present Spectrum, a method that accelerates LLM trai…