69 citations · 134 across the 7 of their papers we have counts for
3 papers · 1 filter
Taming Speculative Search for Test-Time Scaling in LLM Serving
Jinwoo Jeong, Woohyung Choi, Myeongjae Jeon +1
Test-time scaling has recently emerged as a powerful approach for improving LLM reasoning by allocating additional computation during inference, substantially enhancing accuracy on…
Accelerated Training for CNN Distributed Deep Learning through Automatic Resource-Aware Layer Placement
Jay H. Park, Sunghwan Kim, Jinwon Lee +2
The Convolutional Neural Network (CNN) model, often used for image classification, requires significant training time to obtain high accuracy. To this end, distributed training is…
Analysis of Large-Scale Multi-Tenant GPU Clusters for DNN Training Workloads
Myeongjae Jeon, Shivaram Venkataraman, Amar Phanishayee +3
With widespread advances in machine learning, a number of large enterprises are beginning to incorporate machine learning models across a number of products. These models are typic…