14 citations · 33 across the 22 of their papers we have counts for
12 papers · 1 filter
On Foundation Models for Temporal Point Processes to Accelerate Scientific Discovery
David Berghaus, Patrick Seifner, Kostadin Cvejoski +1
Many scientific fields, from medicine to seismology, rely on analyzing sequences of events over time to understand complex systems. Traditionally, machine learning models must be b…
Towards Fast Coarse-graining and Equation Discovery with Foundation Inference Models
Manuel Hinz, Maximilian Mauel, Patrick Seifner +3
High-dimensional recordings of dynamical processes are often characterized by a much smaller set of effective variables, evolving on low-dimensional manifolds. Identifying these la…
In-Context Learning of Temporal Point Processes with Foundation Inference Models
David Berghaus, Patrick Seifner, Kostadin Cvejoski +2
Modeling event sequences of multiple event types with marked temporal point processes (MTPPs) provides a principled way to uncover governing dynamical rules and predict future even…
In-Context Learning of Stochastic Differential Equations with Foundation Inference Models
Patrick Seifner, Kostadin Cvejoski, David Berghaus +2
Stochastic differential equations (SDEs) describe dynamical systems where deterministic flows, governed by a drift function, are superimposed with random fluctuations, dictated by…
Foundation Inference Models for Markov Jump Processes
David Berghaus, Kostadin Cvejoski, Patrick Seifner +2
Markov jump processes are continuous-time stochastic processes which describe dynamical systems evolving in discrete state spaces. These processes find wide application in the natu…
Zero-shot Imputation with Foundation Inference Models for Dynamical Systems
Patrick Seifner, Kostadin Cvejoski, Antonia Körner +1
Dynamical systems governed by ordinary differential equations (ODEs) serve as models for a vast number of natural and social phenomena. In this work, we offer a fresh perspective o…
Informed Pre-Training on Prior Knowledge
Laura von Rueden, Sebastian Houben, Kostadin Cvejoski +2
When training data is scarce, the incorporation of additional prior knowledge can assist the learning process. While it is common to initialize neural networks with weights that ha…
Knowledge Augmented Machine Learning with Applications in Autonomous Driving: A Survey
Julian Wörmann, Daniel Bogdoll, Christian Brunner +49
The availability of representative datasets is an essential prerequisite for many successful artificial intelligence and machine learning models. However, in real life applications…
Combining expert knowledge and neural networks to model environmental stresses in agriculture
Kostadin Cvejoski, Jannis Schuecker, Anne-Katrin Mahlein +1
In this work we combine representation learning capabilities of neural network with agricultural knowledge from experts to model environmental heat and drought stresses. We first d…
Generative Deep Learning Techniques for Password Generation
David Biesner, Kostadin Cvejoski, Bogdan Georgiev +2
Password guessing approaches via deep learning have recently been investigated with significant breakthroughs in their ability to generate novel, realistic password candidates. In…
Recurrent Point Review Models
Kostadin Cvejoski, Ramses J. Sanchez, Bogdan Georgiev +2
Deep neural network models represent the state-of-the-art methodologies for natural language processing. Here we build on top of these methodologies to incorporate temporal informa…
Recurrent Point Processes for Dynamic Review Models
Kostadin Cvejoski, Ramses J. Sanchez, Bogdan Georgiev +3
Recent progress in recommender system research has shown the importance of including temporal representations to improve interpretability and performance. Here, we incorporate temp…