4 citations · 10 across the 8 of their papers we have counts for
5 papers · 1 filter
Effective Length Extrapolation via Dimension-Wise Positional Embeddings Manipulation
Yi Lu, Wanxu Zhao, Xin Zhou +9
Large Language Models (LLMs) often struggle to process and generate coherent context when the number of input tokens exceeds the pre-trained length. Recent advancements in long-con…
LongHeads: Multi-Head Attention is Secretly a Long Context Processor
Yi Lu, Xin Zhou, Wei He +5
Large language models (LLMs) have achieved impressive performance in numerous domains but often struggle to process lengthy inputs effectively and efficiently due to limited length…
Are Large Language Models Good Prompt Optimizers?
Ruotian Ma, Xiaolei Wang, Xin Zhou +5
LLM-based Automatic Prompt Optimization, which typically utilizes LLMs as Prompt Optimizers to self-reflect and refine prompts, has shown promising performance in recent studies. D…
Learning "O" Helps for Learning More: Handling the Concealed Entity Problem for Class-incremental NER
Ruotian Ma, Xuanting Chen, Lin Zhang +6
As the categories of named entities rapidly increase, the deployed NER models are required to keep updating toward recognizing more entity types, creating a demand for class-increm…
Plug-Tagger: A Pluggable Sequence Labeling Framework Using Language Models
Xin Zhou, Ruotian Ma, Tao Gui +3
Plug-and-play functionality allows deep learning models to adapt well to different tasks without requiring any parameters modified. Recently, prefix-tuning was shown to be a plug-a…