Showing 2024Show all
3 papers · 1 filter
cs.CL2024
Algorithmic Phase Transitions in Language Models: A Mechanistic Case Study of Arithmetic
Alan Sun, Ethan Sun, Warren Shepard
Zero-shot capabilities of large language models make them powerful tools for solving a range of tasks without explicit training. It remains unclear, however, how these models achie…
cs.LG2024
Achieving Domain-Independent Certified Robustness via Knowledge Continuity
Alan Sun, Chiyu Ma, Kenneth Ge +1
We present knowledge continuity, a novel definition inspired by Lipschitz continuity which aims to certify the robustness of neural networks across input domains (such as continuou…
cs.RO2024
On the Exploration of LM-Based Soft Modular Robot Design
Weicheng Ma, Luyang Zhao, Chun-Yi She +5
Recent large language models (LLMs) have demonstrated promising capabilities in modeling real-world knowledge and enhancing knowledge-based generation tasks. In this paper, we furt…