works on
attention mechanisms 1attention reranking 1language model sampling 1linear-time models 1long-context recall 1masked diffusion 1parallel decoding 1sequence modeling 1sparse memory 1training-free methods 1

From the 2 of 58 linked papers with an AI index.

activity
20242026
collaborators
Showing cs.AIShow all

1 paper · 1 filter

cs.AI2024

Inference Optimization of Foundation Models on AI Accelerators

Youngsuk Park, Kailash Budhathoki, Liangfu Chen +7

Powerful foundation models, including large language models (LLMs), with Transformer architectures have ushered in a new era of Generative AI across various industries. Industry an…