PARTREP: Learning What to Repeat for Decoder-only LLMs

Andikawati P Widjaja, Yongjun Kim, Hyounghun Kim +1

While decoder-only LLMs excel at a vast array of natural language tasks, it suffers from an asymmetric information flow induced by causal attention: later tokens are richer in cont…