5 papers
Faster Predictive Coding Networks via Better Initialization
Luca Pinchetti, Simon Frieder, Thomas Lukasiewicz +1
Research aimed at scaling up neuroscience inspired learning algorithms for neural networks is accelerating. Recently, a key research area has been the study of energy-based learnin…
Towards the Training of Deeper Predictive Coding Neural Networks
Chang Qi, Matteo Forasassi, Thomas Lukasiewicz +1
Predictive coding networks are neural models that perform inference through an iterative energy minimization process, whose operations are local in space and time. While effective…
Shh, don't say that! Domain Certification in LLMs
Cornelius Emde, Alasdair Paren, Preetham Arvind +6
Large language models (LLMs) are often deployed to perform constrained tasks, with narrow domains. For example, customer support bots can be built on top of LLMs, relying on their…
Data for Mathematical Copilots: Better Ways of Presenting Proofs for Machine Learning
Simon Frieder, Jonas Bayer, Sam Looi +13
The datasets and benchmarks commonly used to train and evaluate the mathematical capabilities of AI-based mathematical copilots (primarily large language models) exhibit several sh…
Dimension-independent learning rates for high-dimensional classification problems
Andres Felipe Lerma-Pineda, Philipp Petersen, Simon Frieder +1
We study the problem of approximating and estimating classification functions that have their decision boundary in the space. Functions of type arise naturally as s…