8 papers
SpecFed: Accelerating Federated LLM Inference with Speculative Decoding and Compressed Transmission
Ce Zheng, Xinghan Wang, Jiahong Ning +3
Federated inference enhances LLM performance in edge computing through weighted averaging of distributed model predictions. However, autoregressive LLM inference requires frequent…
A Unified Adaptive Feature Composition Framework for Multi-Task Generalization in Wireless Foundation Models
Yuxuan Shi, Tingting Yang, Kangning Ma +4
Though wireless foundation models (WFMs) have shown strong potential in learning universal channel representations, their adaptation to various downstream tasks remains constrained…
SpikeWFM: Spiking-Aided Wireless Foundation Model for Robust Channel Prediction
Liwen Jing, Yisha Lu, Tingting Yang +5
This paper proposes SpikeWFM, a novel hybrid architecture that integrates spiking neural networks (SNNs) with conventional artificial neural network (ANN)-based transformers for wi…
The MiniMax-M2 Series: Mini Activations Unleashing Max Real-World Intelligence
MiniMax, :, Aili Chen +219
We introduce the MiniMax-M2 series, a family of Mixture-of-Experts language models built around the principle that mini activations can unleash maximum real-world intelligence. The…
Prism: A Plug-in Reproducible Infrastructure for Scalable Multimodal Continual Instruction Tuning
Jun-Tao Tang, Yu-Cheng Shi, Zhen-Hao Xie +1
Multimodal Large Language Models (MLLMs) achieve versatility by reformulating diverse tasks into a unified instruction-following framework via instruction tuning. However, real-wor…
Filter-and-Attend: Wireless Channel Foundation Model with Noise-Plus-Interference Suppression Structure
Yuwei Wang, Li Sun, Tingting Yang +3
Wireless channel foundation model (WCFM) is a task-agnostic AI model that is pre-trained to learn a universal channel representation for a wide range of communications and sensing…