4 papers
The MiniMax-M2 Series: Mini Activations Unleashing Max Real-World Intelligence
MiniMax, :, Aili Chen +219
We introduce the MiniMax-M2 series, a family of Mixture-of-Experts language models built around the principle that mini activations can unleash maximum real-world intelligence. The…
Compensation-free Machine Unlearning in Text-to-Image Diffusion Models by Eliminating the Mutual Information
Xinwen Cheng, Jingyuan Zhang, Zhehao Huang +2
The powerful generative capabilities of diffusion models have raised growing privacy and safety concerns regarding generating sensitive or undesired content. In response, machine u…
Simple Yet Effective: Extracting Private Data Across Clients in Federated Fine-Tuning of Large Language Models
Yingqi Hu, Zhuo Zhang, Jingyuan Zhang +4
Federated large language models (FedLLMs) enable cross-silo collaborative training among institutions while preserving data locality, making them appealing for privacy-sensitive do…
FewFedPIT: Towards Privacy-preserving and Few-shot Federated Instruction Tuning
Zhuo Zhang, Jingyuan Zhang, Jintao Huang +5
Instruction tuning has been identified as a crucial technique for optimizing the performance of large language models (LLMs) in generating human-aligned responses. Nonetheless, gat…