4 papers
General Recurrence Multidimensional Zeckendorf Representations
Jiarui Cheng, Steven J. Miller, Sebastian Rodriguez-Labastida +3
We present a multidimensional generalization of Zeckendorf's Theorem (any positive integer can be written uniquely as a sum of non-adjacent Fibonacci numbers) to a large family of…
Circuit Stability Characterizes Language Model Generalization
Alan Sun
Extensively evaluating the capabilities of (large) language models is difficult. Rapid development of state-of-the-art models induce benchmark saturation, while creating more chall…
Algorithmic Phase Transitions in Language Models: A Mechanistic Case Study of Arithmetic
Alan Sun, Ethan Sun, Warren Shepard
Zero-shot capabilities of large language models make them powerful tools for solving a range of tasks without explicit training. It remains unclear, however, how these models achie…
Achieving Domain-Independent Certified Robustness via Knowledge Continuity
Alan Sun, Chiyu Ma, Kenneth Ge +1
We present knowledge continuity, a novel definition inspired by Lipschitz continuity which aims to certify the robustness of neural networks across input domains (such as continuou…