7 citations · 24 across the 18 of their papers we have counts for
4 papers · 1 filter
Energy-Efficient Wireless LLM Inference via Uncertainty and Importance-Aware Speculative Decoding
Jihoon Park, Seungeun Oh, Seong-Lyun Kim
To address the growing demand for on-device LLM inference in resource-constrained environments, hybrid language models (HLM) have emerged, combining lightweight local models with p…
Uncertainty-Aware Hybrid Inference with On-Device Small and Remote Large Language Models
Seungeun Oh, Jinhyuk Kim, Jihong Park +3
This paper studies a hybrid language model (HLM) architecture that integrates a small language model (SLM) operating on a mobile device with a large language model (LLM) hosted at…
Semantics Alignment via Split Learning for Resilient Multi-User Semantic Communication
Jinhyuk Choi, Jihong Park, Seung-Woo Ko +3
Recent studies on semantic communication commonly rely on neural network (NN) based transceivers such as deep joint source and channel coding (DeepJSCC). Unlike traditional transce…
Visual Transformer Meets CutMix for Improved Accuracy, Communication Efficiency, and Data Privacy in Split Learning
Sihun Baek, Jihong Park, Praneeth Vepakomma +3
This article seeks for a distributed learning solution for the visual transformer (ViT) architectures. Compared to convolutional neural network (CNN) architectures, ViTs often have…