activity
20212026
most citedScheduling Optimization Techniques for Neural Network Training

1 citations · 1 across the 4 of their papers we have counts for

collaborators
Showing 2024Show all

1 paper · 1 filter

cs.DC2024

ExeGPT: Constraint-Aware Resource Scheduling for LLM Inference

Hyungjun Oh, Kihong Kim, Jaemin Kim +4

This paper presents ExeGPT, a distributed system designed for constraint-aware LLM inference. ExeGPT finds and runs with an optimal execution schedule to maximize inference through…