The Model Knows When to Stop: Training-Free Early Stopping for Long-Context Reading

Muath Alyobi, Mohamed Eltahir, Almoayyad Abuljdail +3

Language models often process long inputs sequentially in chunks, but continuing to read after sufficient evidence has been acquired wastes computation. Existing stopping mechanism…