5 papers
Muon Operates Beyond the Edge of Stability
Niko Covic, Baraq Lipshitz, Alexander Padula +1
We study the Muon optimizer using sharpness and provide the first empirical evidence that the Flat Minima Hypothesis also applies to Muon. Further, we derive Muon's implicit precon…
Fetch Me If You Can: A Comprehensive Analysis of Fetch Metadata
Pedro Bernardo, Alex Ploner, Marco Squarcina +2
Effective server-side defenses against cross-site attacks depend on understanding the context in which browser requests are generated. However, servers often lack the information n…
Ludax: A GPU-Accelerated Domain Specific Language for Board Games
Graham Todd, Alexander G. Padula, Dennis J. N. J. Soemers +1
Games have long been used as benchmarks and testing environments for research in artificial intelligence. A key step in supporting this research was the development of game descrip…
Exploring RL-based LLM Training for Formal Language Tasks with Programmed Rewards
Alexander G. Padula, Dennis J. N. J. Soemers
Proximal Policy Optimization (PPO) is commonly used in Reinforcement Learning from Human Feedback to align large language models (LLMs) with downstream tasks. This paper investigat…
GAVEL: Generating Games Via Evolution and Language Models
Graham Todd, Alexander Padula, Matthew Stephenson +3
Automatically generating novel and interesting games is a complex task. Challenges include representing game rules in a computationally workable form, searching through the large s…