Showing cs.CLShow all
2 papers · 1 filter
cs.CL2026
Distilling Sequential Computation in Transformer Language Models
Zixuan Lan, Jessica Yang, Yanhong Li +2
Transformer language models process sequences token by token in an autoregressive manner, making growing contexts increasingly expensive. Yet many adjacent token spans are highly p…
cs.CL2025
Text or Pixels? It Takes Half: On the Token Efficiency of Visual Text Inputs in Multimodal LLMs
Yanhong Li, Zixuan Lan, Jiawei Zhou
Large language models (LLMs) and their multimodal variants can now process visual inputs, including images of text. This raises an intriguing question: can we compress textual inpu…