2 papers
cs.DC2025
FIRST: Federated Inference Resource Scheduling Toolkit for Scientific AI Model Access
Aditya Tanikanti, Benoit Côté, Yanfei Guo +9
We present the Federated Inference Resource Scheduling Toolkit (FIRST), a framework enabling Inference-as-a-Service across distributed High-Performance Computing (HPC) clusters. FI…
cs.LG2024
LLM-Inference-Bench: Inference Benchmarking of Large Language Models on AI Accelerators
Krishna Teja Chitty-Venkata, Siddhisanket Raskar, Bharat Kale +6
Large Language Models (LLMs) have propelled groundbreaking advancements across several domains and are commonly used for text generation applications. However, the computational de…