4 papers · 1 filter
Curse of High Dimensionality Issue in Transformer for Long-context Modeling
Shuhai Zhang, Zeng You, Yaofo Chen +5
Transformer-based large language models (LLMs) excel in natural language processing tasks by capturing long-range dependencies through self-attention mechanisms. However, long-cont…
Test-Time Learning for Large Language Models
Jinwu Hu, Zhitian Zhang, Guohao Chen +6
While Large Language Models (LLMs) have exhibited remarkable emergent capabilities through extensive pre-training, they still face critical limitations in generalizing to specializ…
Dynamic Compressing Prompts for Efficient Inference of Large Language Models
Jinwu Hu, Wei Zhang, Yufeng Wang +4
Large Language Models (LLMs) have shown outstanding performance across a variety of tasks, partly due to advanced prompting techniques. However, these techniques often require leng…
Generating Long-form Story Using Dynamic Hierarchical Outlining with Memory-Enhancement
Qianyue Wang, Jinwu Hu, Zhengping Li +4
Long-form story generation task aims to produce coherent and sufficiently lengthy text, essential for applications such as novel writingand interactive storytelling. However, exist…