4 papers
Thomson: Continual Learning of Frontier Models for SovereignAI
Shengzhuang Chen, Jerrod Parker, Yejin Bang +23
The development of frontier models is commonly perceived to be the exclusive remit of a small number of heavily funded players, creating an information, economic and power asymmetr…
Knowledge Graph-Assisted LLM Post-Training for Enhanced Legal Reasoning
Dezhao Song, Guglielmo Bonifazi, Frank Schilder +1
LLM post-training has primarily relied on large text corpora and human feedback, without capturing the structure of domain knowledge. This has caused models to struggle dealing wit…
Measuring the Groundedness of Legal Question-Answering Systems
Dietrich Trautmann, Natalia Ostapuk, Quentin Grail +4
In high-stakes domains like legal question-answering, the accuracy and trustworthiness of generative AI systems are of paramount importance. This work presents a comprehensive benc…
Can We Understand Plasticity Through Neural Collapse?
Guglielmo Bonifazi, Iason Chalas, Gian Hess +1
This paper explores the connection between two recently identified phenomena in deep learning: plasticity loss and neural collapse. We analyze their correlation in different scenar…