8 papers
SpecFed: Accelerating Federated LLM Inference with Speculative Decoding and Compressed Transmission
Ce Zheng, Xinghan Wang, Jiahong Ning +3
Federated inference enhances LLM performance in edge computing through weighted averaging of distributed model predictions. However, autoregressive LLM inference requires frequent…
Lightweight Adaptive Feature Composition for Heterogeneous Downstream Adaptation of Wireless Foundation Models
Yuxuan Shi, Tingting Yang, Kangning Ma +4
Mobile systems increasingly rely on heterogeneous learning-enabled wireless functions, for which separate taskspecific models incur redundant training and model-management overhead…
SpikeWFM: Spiking-Aided Wireless Foundation Model for Robust Channel Prediction
Liwen Jing, Yisha Lu, Tingting Yang +5
This paper proposes SpikeWFM, a novel hybrid architecture that integrates spiking neural networks (SNNs) with conventional artificial neural network (ANN)-based transformers for wi…
The MiniMax-M2 Series: Mini Activations Unleashing Max Real-World Intelligence
MiniMax, :, Aili Chen +219
We introduce the MiniMax-M2 series, a family of Mixture-of-Experts language models built around the principle that mini activations can unleash maximum real-world intelligence. The…
Prism: A Plug-in Reproducible Infrastructure for Scalable Multimodal Continual Instruction Tuning
Jun-Tao Tang, Yu-Cheng Shi, Zhen-Hao Xie +1
Multimodal Large Language Models (MLLMs) achieve versatility by reformulating diverse tasks into a unified instruction-following framework via instruction tuning. However, real-wor…
Filter-and-Attend: Wireless Channel Foundation Model with Noise-Plus-Interference Suppression Structure
Yuwei Wang, Li Sun, Tingting Yang +3
Wireless channel foundation model (WCFM) is a task-agnostic AI model that is pre-trained to learn a universal channel representation for a wide range of communications and sensing…