12 citations · 13 across the 6 of their papers we have counts for
4 papers · 1 filter
CodeMonkeys: Scaling Test-Time Compute for Software Engineering
Ryan Ehrlich, Bradley Brown, Jordan Juravsky +3
Scaling test-time compute is a promising axis for improving LLM capabilities. However, test-time compute can be scaled in a variety of ways, and effectively combining different app…
Large Language Monkeys: Scaling Inference Compute with Repeated Sampling
Bradley Brown, Jordan Juravsky, Ryan Ehrlich +4
Scaling the amount of compute used to train language models has dramatically improved their capabilities. However, when it comes to inference, we often limit models to making only…
Hydragen: High-Throughput LLM Inference with Shared Prefixes
Jordan Juravsky, Bradley Brown, Ryan Ehrlich +3
Transformer-based large language models (LLMs) are now deployed to hundreds of millions of users. LLM inference is commonly performed on batches of sequences that share a prefix, s…
Relating Regularization and Generalization through the Intrinsic Dimension of Activations
Bradley C. A. Brown, Jordan Juravsky, Anthony L. Caterini +1
Given a pair of models with similar training set performance, it is natural to assume that the model that possesses simpler internal representations would exhibit better generaliza…