activity
20132025
most citedCommunication-Efficient On-Device Machine Learning: Federated Distillation and Augmentation under Non-IID Private Data

434 citations · 1.3k across the 83 of their papers we have counts for

collaborators
Showing cs.LGShow all

26 papers · 1 filter

cs.LG2023

Semantics Alignment via Split Learning for Resilient Multi-User Semantic Communication

Jinhyuk Choi, Jihong Park, Seung-Woo Ko +3

Recent studies on semantic communication commonly rely on neural network (NN) based transceivers such as deep joint source and channel coding (DeepJSCC). Unlike traditional transce…

cs.LG2022★ 10 cited

Slimmable Quantum Federated Learning

Won Joon Yun, Jae Pyoung Kim, Soyi Jung +3

Quantum federated learning (QFL) has recently received increasing attention, where quantum neural networks (QNNs) are integrated into federated learning (FL). In contrast to the ex…

cs.LG2022★ 4 cited

Visual Transformer Meets CutMix for Improved Accuracy, Communication Efficiency, and Data Privacy in Split Learning

Sihun Baek, Jihong Park, Praneeth Vepakomma +3

This article seeks for a distributed learning solution for the visual transformer (ViT) architectures. Compared to convolutional neural network (CNN) architectures, ViTs often have…

cs.LG2022

SlimFL: Federated Learning with Superposition Coding over Slimmable Neural Networks

Won Joon Yun, Yunseok Kwak, Hankyul Baek +5

Federated learning (FL) is a key enabler for efficient communication and computing, leveraging devices' distributed computing capabilities. However, applying FL in practice is chal…

cs.LG2021★ 2 cited

Attention Based Communication and Control for Multi-UAV Path Planning

Hamid Shiri, Hyowoon Seo, Jihong Park +1

Inspired by the multi-head attention (MHA) mechanism in natural language processing, this letter proposes an iterative single-head attention (ISHA) mechanism for multi-UAV path pla…

cs.LG2021★ 12 cited

Server-Side Local Gradient Averaging and Learning Rate Acceleration for Scalable Split Learning

Shraman Pal, Mansi Uniyal, Jihong Park +5

In recent years, there have been great advances in the field of decentralized learning with private data. Federated learning (FL) and split learning (SL) are two spearheads possess…

cs.LG2021★ 2 cited

Communication and Energy Efficient Slimmable Federated Learning via Superposition Coding and Successive Decoding

Hankyul Baek, Won Joon Yun, Soyi Jung +4

Mobile devices are indispensable sources of big data. Federated learning (FL) has a great potential in exploiting these private data by exchanging locally trained models instead of…

cs.LG2021

Joint Superposition Coding and Training for Federated Learning over Multi-Width Neural Networks

Hankyul Baek, Won Joon Yun, Yunseok Kwak +5

This paper aims to integrate two synergetic technologies, federated learning (FL) and width-adjustable slimmable neural network (SNN) architectures. FL preserves data privacy by ex…

cs.LG2021

Robust Reconfigurable Intelligent Surfaces via Invariant Risk and Causal Representations

Sumudu Samarakoon, Jihong Park, Mehdi Bennis

In this paper, the problem of robust reconfigurable intelligent surface (RIS) system design under changes in data distributions is investigated. Using the notion of invariant risk…

cs.LG2021

Communication-Efficient and Personalized Federated Lottery Ticket Learning

Sejin Seo, Seung-Woo Ko, Jihong Park +2

The lottery ticket hypothesis (LTH) claims that a deep neural network (i.e., ground network) contains a number of subnetworks (i.e., winning tickets), each of which exhibiting iden…

cs.LG2021

Split Learning Meets Koopman Theory for Wireless Remote Monitoring and Prediction

Abanoub M. Girgis, Hyowoon Seo, Jihong Park +2

Remote state monitoring over wireless is envisaged to play a pivotal role in enabling beyond 5G applications ranging from remote drone control to remote surgery. One key challenge…

cs.LG2021★ 37 cited

Robust Blockchained Federated Learning with Model Validation and Proof-of-Stake Inspired Consensus

Hang Chen, Syed Ali Asif, Jihong Park +2

Federated learning (FL) is a promising distributed learning solution that only exchanges model parameters without revealing raw data. However, the centralized architecture of FL is…

cs.LG2020★ 34 cited

Federated Knowledge Distillation

Hyowoon Seo, Jihong Park, Seungeun Oh +2

Distributed learning frameworks often rely on exchanging model parameters across workers, instead of revealing their raw data. A prime example is federated learning that exchanges…

cs.LG2020★ 3 cited

Robustness and Diversity Seeking Data-Free Knowledge Distillation

Pengchao Han, Jihong Park, Shiqiang Wang +1

Knowledge distillation (KD) has enabled remarkable progress in model compression and knowledge transfer. However, KD requires a large volume of original data or their representatio…

cs.LG2020★ 11 cited

Communication Efficient Distributed Learning with Censored, Quantized, and Generalized Group ADMM

Chaouki Ben Issaid, Anis Elgabli, Jihong Park +2

In this paper, we propose a communication-efficiently decentralized machine learning framework that solves a consensus optimization problem defined over a network of inter-connecte…

cs.LG2020

Communication-Efficient and Distributed Learning Over Wireless Networks: Principles and Applications

Jihong Park, Sumudu Samarakoon, Anis Elgabli +4

Machine learning (ML) is a promising enabler for the fifth generation (5G) communication systems and beyond. By imbuing intelligence into the network edge, edge nodes can proactive…

cs.LG2020

Harnessing Wireless Channels for Scalable and Privacy-Preserving Federated Learning

Anis Elgabli, Jihong Park, Chaouki Ben Issaid +1

Wireless connectivity is instrumental in enabling scalable federated learning (FL), yet wireless channels bring challenges for model training, in which channel randomness perturbs…

cs.LG2020★ 1 cited

Mix2FLD: Downlink Federated Learning After Uplink Federated Distillation With Two-Way Mixup

Seungeun Oh, Jihong Park, Eunjeong Jeong +3

This letter proposes a novel communication-efficient and privacy-preserving distributed machine learning framework, coined Mix2FLD. To address uplink-downlink capacity asymmetry, l…

cs.LG2020★ 57 cited

XOR Mixup: Privacy-Preserving Data Augmentation for One-Shot Federated Learning

MyungJae Shin, Chihoon Hwang, Joongheon Kim +3

User-generated data distributions are often imbalanced across devices and labels, hampering the performance of federated learning (FL). To remedy to this non-independent and identi…

cs.LG2020

Proxy Experience Replay: Federated Distillation for Distributed Reinforcement Learning

Han Cha, Jihong Park, Hyesung Kim +2

Traditional distributed deep reinforcement learning (RL) commonly relies on exchanging the experience replay memory (RM) of each agent. Since the RM contains all state observations…

cs.LG2019

L-FGADMM: Layer-Wise Federated Group ADMM for Communication Efficient Decentralized Deep Learning

Anis Elgabli, Jihong Park, Sabbir Ahmed +1

This article proposes a communication-efficient decentralized deep learning algorithm, coined layer-wise federated group ADMM (L-FGADMM). To minimize an empirical risk, every worke…

cs.LG2019

Q-GADMM: Quantized Group ADMM for Communication Efficient Decentralized Machine Learning

Anis Elgabli, Jihong Park, Amrit S. Bedi +3

In this article, we propose a communication-efficient decentralized machine learning (ML) algorithm, coined quantized group ADMM (Q-GADMM). To reduce the number of communication li…

cs.LG2019★ 43 cited

GADMM: Fast and Communication Efficient Framework for Distributed Machine Learning

Anis Elgabli, Jihong Park, Amrit S. Bedi +2

When the data is distributed across multiple servers, lowering the communication cost between the servers (or workers) while solving the distributed learning problem is an importan…

cs.LG2019★ 21 cited

Multi-hop Federated Private Data Augmentation with Sample Compression

Eunjeong Jeong, Seungeun Oh, Jihong Park +3

On-device machine learning (ML) has brought about the accessibility to a tremendous amount of data from the users while keeping their local data private instead of storing it in a…