10 papers · 1 filter
LieSolver: PDE-Constrained Learning for IBVPs via Lie Symmetries
René P. Klausen, Ivan Timofeev, Jonas Naujoks +4
Initial-boundary value problems (IBVPs) provide the essential framework for modelling a wide range of phenomena in physics and engineering. We introduce a novel method for efficien…
PINNfluence: Interpreting PINNs through Influence Functions
Aleksander Krasowski, Jonas R. Naujoks, Moritz Weckbecker +5
Physics-informed neural networks (PINNs) have emerged as a powerful deep learning approach for solving partial differential equations (PDEs) in the physical sciences, yet their beh…
Attribution-Guided Pruning for Insight and Control: Circuit Discovery and Targeted Correction in Small-scale LLMs
Sayed Mohammad Vakilzadeh Hatefi, Maximilian Dreyer, Reduan Achtibat +5
Large Language Models (LLMs) are widely deployed in real-world applications, yet their internal mechanisms remain difficult to interpret and control, limiting our ability to diagno…
Attribution-Guided Decoding
Piotr Komorowski, Elena Golimblevskaia, Reduan Achtibat +3
The capacity of Large Language Models (LLMs) to follow complex instructions and generate factually accurate text is critical for their real-world application. However, standard dec…
Sparse, Efficient and Explainable Data Attribution with DualXDA
Galip Ãmit Yolcu, Moritz Weckbecker, Thomas Wiegand +2
Data Attribution (DA) is an emerging approach in the field of eXplainable Artificial Intelligence (XAI), aiming to identify influential training datapoints which determine model ou…
FADE: Why Bad Descriptions Happen to Good Features
Bruno Puri, Aakriti Jain, Elena Golimblevskaia +4
Recent advances in mechanistic interpretability have highlighted the potential of automating interpretability pipelines in analyzing the latent representations within LLMs. While t…