4 papers
The Aloe Family Recipe for Open and Specialized Healthcare LLMs
Dario Garcia-Gasulla, Jordi Bayarri-Planas, Ashwin Kumar Gururajan +10
Purpose: With advancements in Large Language Models (LLMs) for healthcare, the need arises for competitive open-source models to protect the public interest. This work contributes…
Pareto-Optimized Open-Source LLMs for Healthcare via Context Retrieval
Jordi Bayarri-Planas, Ashwin Kumar Gururajan, Dario Garcia-Gasulla
This study leverages optimized context retrieval to enhance open-source Large Language Models (LLMs) for cost-effective, high performance healthcare AI. We demonstrate that this ap…
Efficient Safety Retrofitting Against Jailbreaking for LLMs
Dario Garcia-Gasulla, Adrian Tormos, Anna Arias-Duart +4
Direct Preference Optimization (DPO) is an efficient alignment technique that steers LLMs towards preferable outputs by training on preference data, bypassing the need for explicit…
Automatic Evaluation of Healthcare LLMs Beyond Question-Answering
Anna Arias-Duart, Pablo Agustin Martin-Torres, Daniel Hinjos +7
Current Large Language Models (LLMs) benchmarks are often based on open-ended or close-ended QA evaluations, avoiding the requirement of human labor. Close-ended measurements evalu…