Teach the Way It Thinks: Guiding LLM Post-training Data Engineering with Sparse Autoencoders

Yi Jing, Zao Dai, Jinwu Hu +4

Data engineering for large language model (LLM) reinforcement learning (RL) decides which samples to train on, when to present them, and which to batch together. Existing methods m…