7 citations · 7 across the 9 of their papers we have counts for
4 papers · 1 filter
WhiteMatter: All-to-All Cross-Layer Connections via KV Source Mixing
Wenbo Zhang, Xiang Ren
When generating text, a Transformer produces representations of past tokens at every layer, but each layer can normally use only representations from the same depth. This restricti…
OpaqueToolsBench: Learning Nuances of Tool Behavior Through Interaction
Skyler Hallinan, Thejas Venkatesh, Xiang Ren +4
Tool-calling is essential for Large Language Model (LLM) agents to complete real-world tasks. While most existing benchmarks assume simple, perfectly documented tools, real-world t…
Attributing Culture-Conditioned Generations to Pretraining Corpora
Huihan Li, Arnav Goel, Keyu He +1
In open-ended generative tasks like narrative writing or dialogue, large language models often exhibit cultural biases, showing limited knowledge and generating templated outputs f…
DOMINO: A Dual-System for Multi-step Visual Language Reasoning
Peifang Wang, Olga Golovneva, Armen Aghajanyan +4
Visual language reasoning requires a system to extract text or numbers from information-dense images like charts or plots and perform logical or arithmetic reasoning to arrive at a…