FastE: Readout-Triggered Token Compression for LLM Embedding Inference

Jinsong Shu, Jinyong Wen, Baokun Wang +4

In this study, we identify depth-dependent prefix redundancy in final-readout LLM embedding models, notably across representative backbones including Qwen3-Embedding and Qwen3-VL-E…