53 citations · 54 across the 5 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.CL2024
CItruS: Chunked Instruction-aware State Eviction for Long Sequence Modeling
Yu Bai, Xiyuan Zou, Heyan Huang +4
Long sequence modeling has gained broad interest as large language models (LLMs) continue to advance. Recent research has identified that a large portion of hidden states within th…
cs.CL2024
Identifying and Analyzing Performance-Critical Tokens in Large Language Models
Yu Bai, Heyan Huang, Cesare Spinoso-Di Piano +4
In-context learning (ICL) has emerged as an effective solution for few-shot learning with large language models (LLMs). However, how LLMs leverage demonstrations to specify a task…