2 papers
cs.LG2026
Operator Fusion for LLM Inference on the Tensix Architecture
Qingbo Wu, Ke Li, Wenzhu Wang +3
This study addresses on-device inference bottlenecks of Transformer models on Tenstorrent's Tensix architecture and proposes an operator fusion strategy that enhances data locality…
cs.MA2024
KAOS: Large Model Multi-Agent Operating System
Zhao Zhuo, Rongzhen Li, Kai Liu +5
The intelligent interaction model based on large models reduces the differences in user experience across various system platforms but faces challenges in multi-agent collaboration…