activity
20232026
most citedPyramidKV: Dynamic KV Cache Compression based on Pyramidal Information Funneling

2 citations · 4 across the 7 of their papers we have counts for

collaborators
Showing 2026Show all

1 paper · 1 filter

cs.CL2026

Next Concept Prediction in Discrete Latent Space Leads to Stronger Language Models

Yuliang Liu, Yunchong Song, Yixuan Wang +6

We propose Next Concept Prediction (NCP), a generative pretraining paradigm built on top of Next Token Prediction (NTP). NCP predicts discrete concepts that span multiple tokens, t…