11 papers
Among Us: Measuring and Mitigating Malicious Contributions in Model Collaboration Systems
Ziyuan Yang, Wenxuan Ding, Shangbin Feng +1
Language models (LMs) are increasingly used in collaboration: multiple LMs trained by different parties collaborate through routing systems, multi-agent debate, model merging, and…
Don't Throw Away Your Pretrained Model
Shangbin Feng, Wenhao Yu, Yike Wang +3
Alignment training has tradeoffs: it helps language models (LMs) gain in reasoning and instruction following but might lose out on skills such as creativity and calibration, where…
Interactive Reasoning: Visualizing and Controlling Chain-of-Thought Reasoning in Large Language Models
Rock Yuren Pang, K. J. Kevin Feng, Shangbin Feng +5
The output quality of large language models (LLMs) can be improved via "reasoning": generating segments of chain-of-thought (CoT) content to further condition the model prior to pr…
Escaping the SpuriVerse: Can Large Vision-Language Models Generalize Beyond Seen Spurious Correlations?
Yiwei Yang, Chung Peng Lee, Shangbin Feng +5
Finetuning can cause spurious correlations to arise between non-essential features and the target labels, but benchmarks to study these effects involve contrived settings and narro…
GuessBench: Sensemaking Multimodal Creativity in the Wild
Zifeng Zhu, Shangbin Feng, Herun Wan +3
We propose GuessBench, a novel benchmark that evaluates Vision Language Models (VLMs) on modeling the pervasive, noisy, and pluralistic human creativity. GuessBench sources data fr…
Data Swarms: Optimizable Generation of Synthetic Evaluation Data
Shangbin Feng, Yike Wang, Weijia Shi +1
We propose Data Swarms, an algorithm to optimize the generation of synthetic evaluation data and advance quantitative desiderata of LLM evaluation. We first train a swarm of initia…