21 citations · 69 across the 11 of their papers we have counts for
5 papers · 1 filter
Thought-Aware KV Cache Compaction for Reasoning via Adaptive Attention Matching
Yang Liu, Bin Chong, Chongyang Zhang +3
Reasoning language models generate lengthy chain-of-thought (CoT) sequences whose key-value (KV) cache grows linearly and becomes a memory bottleneck during decoding. Existing comp…
Real-World Compositional Generalization with Disentangled Sequence-to-Sequence Learning
Hao Zheng, Mirella Lapata
Compositional generalization is a basic mechanism in human language learning, which current neural networks struggle with. A recently proposed Disentangled sequence-to-sequence mod…
Disentangled Sequence to Sequence Learning for Compositional Generalization
Hao Zheng, Mirella Lapata
There is mounting evidence that existing neural network models, in particular the very popular sequence-to-sequence architecture, struggle to systematically generalize to unseen co…
Compositional Generalization via Semantic Tagging
Hao Zheng, Mirella Lapata
Although neural sequence-to-sequence models have been successfully applied to semantic parsing, they fail at compositional generalization, i.e., they are unable to systematically g…
Sentence Centrality Revisited for Unsupervised Summarization
Hao Zheng, Mirella Lapata
Single document summarization has enjoyed renewed interests in recent years thanks to the popularity of neural network models and the availability of large-scale datasets. In this…