4 papers
Hyperbolic Contrastive Learning for Hierarchical 3D Point Cloud Embedding
Yingjie Liu, Pengyu Zhang, Ziyao He +3
Hyperbolic spaces allow for more efficient modeling of complex, hierarchical structures, which is particularly beneficial in tasks involving multi-modal data. Although hyperbolic g…
CyclicFL: A Cyclic Model Pre-Training Approach to Efficient Federated Learning
Pengyu Zhang, Yingbo Zhou, Ming Hu +2
Federated learning (FL) has been proposed to enable distributed learning on Artificial Intelligence Internet of Things (AIoT) devices with guarantees of high-level data privacy. Si…
When Foresight Pruning Meets Zeroth-Order Optimization: Efficient Federated Learning for Low-Memory Devices
Pengyu Zhang, Yingjie Liu, Yingbo Zhou +4
Although Federated Learning (FL) enables collaborative learning in Artificial Intelligence of Things (AIoT) design, it fails to work on low-memory AIoT devices due to its heavy mem…
Personalized Federated Instruction Tuning via Neural Architecture Search
Pengyu Zhang, Yingbo Zhou, Ming Hu +3
Federated Instruction Tuning (FIT) has shown the ability to achieve collaborative model instruction tuning among massive data owners without sharing private data. However, it still…