15 citations · 23 across the 10 of their papers we have counts for
5 papers · 1 filter
Identity-Link IRT for Label-Free LLM Evaluation: Preserving Additivity in TVD-MI Scores
Zachary Robertson
Pairwise comparisons of large language models using total variation distance mutual information (TVD-MI) produce binary critic decisions per pair. We show that averaging TVD-MI's b…
Let's Measure Information Step-by-Step: AI-Based Evaluation Beyond Vibes
Zachary Robertson, Sanmi Koyejo
We evaluate artificial intelligence (AI) systems without ground truth by exploiting a link between strategic gaming and information loss. Building on established information theory…
Implicit Regularization in Feedback Alignment Learning Mechanisms for Neural Networks
Zachary Robertson, Oluwasanmi Koyejo
Feedback Alignment (FA) methods are biologically inspired local learning rules for training neural networks with reduced communication between layers. While FA has potential applic…
Double Descent Demystified: Identifying, Interpreting & Ablating the Sources of a Deep Learning Puzzle
Rylan Schaeffer, Mikail Khona, Zachary Robertson +5
Double descent is a surprising phenomenon in machine learning, in which as the number of model parameters grows relative to the number of data, test error drops as models grow ever…
Concurrent Training Improves the Performance of Behavioral Cloning from Observation
Zachary W. Robertson, Matthew R. Walter
Learning from demonstration is widely used as an efficient way for robots to acquire new skills. However, it typically requires that demonstrations provide full access to the state…