22 papers
Scaling Participation in Modular AI Systems
Shangbin Feng, Yike Wang, Weijia Shi +3
Humanity is a mosaic of multifaceted talents and needs, and any truly intelligent AI must reflect that richness. Yet the LLMs used by all are built by the few -- a centralized mark…
MoCo: A One-Stop Shop for Model Collaboration Research
Shangbin Feng, Yuyang Bai, Ziyuan Yang +17
Advancing beyond single monolithic language models (LMs), recent research increasingly recognizes the importance of model collaboration, where multiple LMs collaborate, compose, an…
Biased AI can Influence Political Decision-Making
Jillian Fisher, Shangbin Feng, Robert Aron +6
As modern large language models (LLMs) become integral to everyday tasks, concerns about their inherent biases and their potential impact on human decision-making have emerged. Whi…
Small Reward Models via Backward Inference
Yike Wang, Faeze Brahman, Shangbin Feng +3
Reward models (RMs) play a central role throughout the language model (LM) pipeline, particularly in non-verifiable domains. However, the dominant LLM-as-a-Judge paradigm relies on…
The Single-Multi Evolution Loop for Self-Improving Model Collaboration Systems
Shangbin Feng, Kishan Panaganti, Yulia Tsvetkov +1
Model collaboration -- systems where multiple language models (LMs) collaborate -- combines the strengths of diverse models with cost in loading multiple LMs. We improve efficiency…
MentorCollab: Large-to-Small Inference-Time Mentorship for Concise Reasoning in Language Models
Haojin Wang, Yike Wang, Shangbin Feng +2
Large reasoning models (LRMs) have demonstrated impressive reasoning capabilities, but their solutions are often verbose and computationally expensive, and taxing for users to read…