322 citations · 432 across the 23 of their papers we have counts for
3 papers · 1 filter
Activation Denoising: A Robustness View on Parallel vs Sequential LLM Quantization
Yan Scholten, Rachel Lawrence, James Hensman +3
Post-training quantization is a powerful tool for compressing large language models. The most scalable methods quantize every layer in parallel, but quantization errors then compou…
Subagents vs Agent Skills: Executing Reusable Knowledge for Long-Horizon Agentic Tasks
Wasu Top Piriyakulkij, Rachel Lawrence, Alicia Curth +2
How can language model agents effectively leverage libraries of reusable knowledge to solve long-horizon tasks? Recent work has increasingly focused on agent skills: reusable capab…
Do Transformers Use their Depth Adaptively? Evidence from a Relational Reasoning Task
Alicia Curth, Rachel Lawrence, Sushrut Karmalkar +1
We investigate whether transformers use their depth adaptively across tasks of increasing difficulty. Using a controlled multi-hop relational reasoning task based on family stories…