vSkipper: Translating Dynamic Layer Skipping into LLM Serving Gains

Wei Da, Yavuz Ferhatosmanoglu, Evangelia Kalyvianaki

Dynamic layer skipping reduces LLM computation by allowing each token to execute only a subset of the model's layers. However, existing skippers rely on specialized generation loop…