1 citations · 1 across the 2 of their papers we have counts for
2 papers
cs.DC2024
ExeGPT: Constraint-Aware Resource Scheduling for LLM Inference
Hyungjun Oh, Kihong Kim, Jaemin Kim +4
This paper presents ExeGPT, a distributed system designed for constraint-aware LLM inference. ExeGPT finds and runs with an optimal execution schedule to maximize inference through…
cs.LG2021★ 1 cited
Scheduling Optimization Techniques for Neural Network Training
Hyungjun Oh, HyeongJu Kim, Jiwon Seo
Neural network training requires a large amount of computation and thus GPUs are often used for the acceleration. While they improve the performance, GPUs are underutilized during…