4 papers
Biomedical reasoning in action: Multi-agent System for Auditable Biomedical Evidence Synthesis
Oskar Wysocki, Magdalena Wysocka, Mauricio Jacobo +2
We present M-Reason, a demonstration system for transparent, agent-based reasoning and evidence integration in the biomedical domain, with a focus on cancer research. M-Reason leve…
Integrating Expert Knowledge into Logical Programs via LLMs
Franciszek Górski, Oskar Wysocki, Marco Valentino +1
This paper introduces ExKLoP, a novel framework designed to evaluate how effectively Large Language Models (LLMs) integrate expert knowledge into logical reasoning systems. This ca…
SylloBio-NLI: Evaluating Large Language Models on Biomedical Syllogistic Reasoning
Magdalena Wysocka, Danilo Carvalho, Oskar Wysocki +2
Syllogistic reasoning is crucial for Natural Language Inference (NLI). This capability is particularly significant in specialized domains such as biomedicine, where it can support…
Large Language Models, scientific knowledge and factuality: A framework to streamline human expert evaluation
Magdalena Wysocka, Oskar Wysocki, Maxime Delmas +2
The paper introduces a framework for the evaluation of the encoding of factual scientific knowledge, designed to streamline the manual evaluation process typically conducted by dom…