4 papers
Spectral Reach: Understanding Neural Scaling as Progress into the Spectral Tail
Konstantin Nikolaou, Jonas Scheunemann, Sven Krippendorf +2
Neural scaling laws describe predictable power-law relationships between model size, dataset size, compute, and performance. While these laws guide the development of modern founda…
Open Source Planning & Control System with Language Agents for Autonomous Scientific Discovery
Licong Xu, Milind Sarkar, Anto I. Lonappan +23
We present a multi-agent system for automation of scientific research tasks, cmbagent (https://github.com/CMBAgents/cmbagent). The system is formed by about 30 Large Language Model…
Beyond Scaling Curves: Internal Dynamics of Neural Networks Through the NTK Lens
Konstantin Nikolaou, Sven Krippendorf, Samuel Tovey +1
Scaling laws offer valuable insights into the relationship between neural network performance and computational cost, yet their underlying mechanisms remain poorly understood. In t…
Solving inverse problems of Type IIB flux vacua with conditional generative models
Sven Krippendorf, Zhimei Liu
We address the inverse problem in Type IIB flux compactifications of identifying flux vacua with targeted phenomenological properties such as specific superpotential values or tadp…