activity
20202026
most citedAutomated Evaluation of Retrieval-Augmented Language Models with Task-Specific Exam Generation

6 citations · 14 across the 11 of their papers we have counts for

collaborators

11 papers

cs.CL2026

Shieldstral

Antonia Calvi, Avinash Sooriyarachchi, Giada Pistilli +273

We introduce Shieldstral, a 3B-parameter policy-adaptive multimodal safety classifier that matches or outperforms models nearly 7 its size on text safety benchmarks and set…

cs.AI2026

Voxtral TTS

Mistral-AI, :, Alexander H. Liu +186

We introduce Voxtral TTS, an expressive multilingual text-to-speech model that generates natural speech from as little as 3 seconds of reference audio. Voxtral TTS adopts a hybrid…

cs.AI2026

Voxtral Realtime

Mistral-AI, :, Alexander H. Liu +166

We introduce Voxtral Realtime, a natively streaming automatic speech recognition model that matches offline transcription quality at sub-second latency. Unlike approaches that adap…

cs.CL2026★ 1 cited

Ministral 3

Alexander H. Liu, Kartik Khandelwal, Sandeep Subramanian +116

We introduce the Ministral 3 series, a family of parameter-efficient dense language models designed for compute and memory constrained applications, available in three model sizes:…

cs.SE2025★ 2 cited

Devstral: Fine-tuning Language Models for Coding Agent Applications

Abhinav Rastogi, Adam Yang, Albert Q. Jiang +100

We introduce Devstral-Small, a lightweight open source model for code agents with the best performance among models below 100B size. In this technical report, we give an overview o…

cs.CL2025

Large Language Model Critics for Execution-Free Evaluation of Code Changes

Aashish Yadavally, Hoan Nguyen, Laurent Callot +1

Large language models (LLMs) offer a promising way forward for automating software engineering tasks, such as bug fixes, feature additions, etc., via multi-step LLM-based agentic w…

cs.CL2024★ 6 cited

Automated Evaluation of Retrieval-Augmented Language Models with Task-Specific Exam Generation

Gauthier Guinet, Behrooz Omidvar-Tehrani, Anoop Deoras +1

We propose a new method to measure the task-specific accuracy of Retrieval-Augmented Large Language Models (RAG). Evaluation is performed by scoring the RAG on an automatically-gen…

cs.CL2024

Semi-Supervised Learning for Bilingual Lexicon Induction

Paul Garnier, Gauthier Guinet

We consider the problem of aligning two sets of continuous word representations, corresponding to languages, to a common space in order to infer a bilingual lexicon. It was recentl…

cs.LG2024

MELODY: Robust Semi-Supervised Hybrid Model for Entity-Level Online Anomaly Detection with Multivariate Time Series

Jingchao Ni, Gauthier Guinet, Peihong Jiang +2

In large IT systems, software deployment is a crucial process in online services as their code is regularly updated. However, a faulty code change may degrade the target service's…

cs.LG2023

Effective Dimension in Bandit Problems under Censorship

Gauthier Guinet, Saurabh Amin, Patrick Jaillet

In this paper, we study both multi-armed and contextual bandit problems in censored environments. Our goal is to estimate the performance loss due to censorship in the context of c…

cs.LG2020★ 5 cited

Pareto-efficient Acquisition Functions for Cost-Aware Bayesian Optimization

Gauthier Guinet, Valerio Perrone, Cédric Archambeau

Bayesian optimization (BO) is a popular method to optimize expensive black-box functions. It efficiently tunes machine learning algorithms under the implicit assumption that hyperp…