works on
ai accelerators 1attention fusion 1kv cache management 1llm inference 1low-precision computing 1token-phase optimization 1

From the 1 of 1 linked paper with an AI index.

collaborators

1 paper

cs.LG2026

FastTPS: An Optimized Method for LLM Token Phase for AI accelerators

Wenzong Yang, Danyang Zhang, Kun Cao +17

FastTPS is a set of techniques that reduce memory traffic and fuse operations during the token‑phase of large language model inference on AI accelerators, achieving up to a 6× spee…