4 papers
The MiniMax-M2 Series: Mini Activations Unleashing Max Real-World Intelligence
Aili Chen, Aonian Li, Baichuan Zhou +215
We introduce the MiniMax-M2 series, a family of Mixture-of-Experts language models built around the principle that mini activations can unleash maximum real-world intelligence. The…
Building Retrieval Systems for the ClueWeb22-B Corpus
Harshit Mehrotra, Jamie Callan, Zhen Fan
The ClueWeb22 dataset containing nearly 10 billion documents was released in 2022 to support academic and industry research. The goal of this project was to build retrieval baselin…
Combating Adversarial Attacks with Multi-Agent Debate
Steffi Chern, Zhen Fan, Andy Liu
While state-of-the-art language models have achieved impressive results, they remain susceptible to inference-time adversarial attacks, such as adversarial prompts generated by red…
A Self-enhancement Approach for Domain-specific Chatbot Training via Knowledge Mining and Digest
Ruohong Zhang, Luyu Gao, Chen Zheng +6
Large Language Models (LLMs), despite their great power in language generation, often encounter challenges when dealing with intricate and knowledge-demanding queries in specific d…