2 papers
cs.DC2026
Efficient Expert-Parallel Communication on PCIe-Connected Consumer GPUs
Jaehwan Lee, Sangmin Lee, Chaewon Kim +2
Expert parallelism (EP) enables inference of large Mixture-of-Experts (MoE) models by placing their experts across multiple GPUs, but requires substantial communication between GPU…
cs.CL2025
SEDD: Scalable and Efficient Dataset Deduplication with GPUs
Youngjun Son, Chaewon Kim, Jaejin Lee
Dataset deduplication is widely recognized as a crucial preprocessing step that enhances data quality and improves the performance of large language models. A commonly used method…