5 papers · 1 filter
Limitations of refinement methods for weak to strong generalization
Seamus Somerstep, Ya'acov Ritov, Mikhail Yurochkin +2
Standard techniques for aligning large language models (LLMs) utilize human-produced data, which could limit the capability of any aligned LLM to human level. Label refinement and…
CARROT: A Cost Aware Rate Optimal Router
Seamus Somerstep, Felipe Maia Polo, Allysson Flavio Melo de Oliveira +5
With the rapid growth in the number of Large Language Models (LLMs), there has been a recent interest in LLM routing, or directing queries to the cheapest LLM that can deliver a su…
Microfoundation Inference for Strategic Prediction
Daniele Bracale, Subha Maity, Felipe Maia Polo +3
Often in prediction tasks, the predictive model itself can influence the distribution of the target variable, a phenomenon termed performative prediction. Generally, this influence…
Learning the Distribution Map in Reverse Causal Performative Prediction
Daniele Bracale, Subha Maity, Moulinath Banerjee +1
In numerous predictive scenarios, the predictive model affects the sampling distribution; for example, job applicants often meticulously craft their resumes to navigate through a s…
Weak Supervision Performance Evaluation via Partial Identification
Felipe Maia Polo, Subha Maity, Mikhail Yurochkin +2
Programmatic Weak Supervision (PWS) enables supervised model training without direct access to ground truth labels, utilizing weak labels from heuristics, crowdsourcing, or pre-tra…