5 papers
pFedNavi: Structure-Aware Personalized Federated Vision-Language Navigation for Embodied AI
Qingqian Yang, Hao Wang, Sai Qian Zhang +6
Vision-Language Navigation VLN requires large-scale trajectory instruction data from private indoor environments, raising significant privacy concerns. Federated Learning FL mitiga…
First Demonstration of Second-order Training of Deep Neural Networks with In-memory Analog Matrix Computing
Saitao Zhang, Yubiao Luo, Shiqing Wang +5
Second-order optimization methods, which leverage curvature information, offer faster and more stable convergence than first-order methods such as stochastic gradient descent (SGD)…
ESCA: Enabling Seamless Codec Avatar Execution through Algorithm and Hardware Co-Optimization for Virtual Reality
Mingzhi Zhu, Ding Shang, Sai Qian Zhang
Photorealistic Codec Avatars (PCA), which generate high-fidelity human face renderings, are increasingly being used in Virtual Reality (VR) environments to enable immersive communi…
QSVD: Efficient Low-rank Approximation for Unified Query-Key-Value Weight Compression in Low-Precision Vision-Language Models
Yutong Wang, Haiyu Wang, Sai Qian Zhang
Vision-Language Models (VLMs) are integral to tasks such as image captioning and visual question answering, but their high computational cost, driven by large memory footprints and…
Rethinking the Outlier Distribution in Large Language Models: An In-depth Study
Rahul Raman, Khushi Sharma, Sai Qian Zhang
Investigating outliers in large language models (LLMs) is crucial due to their significant impact on various aspects of LLM performance, including quantization and compression. Out…