From the 1 of 4 linked papers with an AI index.
4 papers
Inverting the Hidden: Unveiling Multimodal Privacy Leakage in Collaborative LVLM Inference
Shuaifan Jin, Zhibo Wang, Qiyuan Wang +5
Collaborative inference deploys Large Vision-Language Models (LVLMs) by partitioning computation between edge devices and the cloud. While withholding raw inputs supposedly ensures…
Attention-Free and Lightweight Token Reduction for Efficient Vision-Language Models
Xuanyi Hao, Zuoyuan Zhang, Zhibo Wang +4
The paper introduces a plug‑and‑play, attention‑free token reduction module for vision‑language models that selects informative and diverse visual tokens using an entropy‑based imp…
Safeguarding LLM Embeddings in End-Cloud Collaboration via Entropy-Driven Perturbation
Shuaifan Jin, Xiaoyi Pang, Zhibo Wang +4
Recent studies improve on-device language model (LM) inference through end-cloud collaboration, where the end device retrieves useful information from cloud databases to enhance lo…
SoK: On Gradient Leakage in Federated Learning
Jiacheng Du, Jiahui Hu, Zhibo Wang +4
Federated learning (FL) facilitates collaborative model training among multiple clients without raw data exposure. However, recent studies have shown that clients' private training…