activity
20212026
most citedClassifier Calibration: A survey on how to assess and improve predicted class probabilities

194 citations · 214 across the 8 of their papers we have counts for

collaborators

8 papers

cs.CL2026

Teaching Language Models to Check Grounded Claim Factuality with Human Test-Taking Strategies

Yuxuan Ye, Raul Santos-Rodriguez, Edwin Simpson

Grounded claim factuality checking is important for large language model (LLM) applications such as retrieval-augmented generation, as it helps users assess the correctness of gene…

cs.LG2024★ 4 cited

Safe and Robust Reinforcement Learning: Principles and Practice

Taku Yamagata, Raul Santos-Rodriguez

Reinforcement Learning (RL) has shown remarkable success in solving relatively complex tasks, yet the deployment of RL systems in real-world scenarios poses significant challenges…

cs.SD2023★ 1 cited

MIDI-Draw: Sketching to Control Melody Generation

Tashi Namgyal, Peter Flach, Raul Santos-Rodriguez

We describe a proof-of-principle implementation of a system for drawing melodies that abstracts away from a note-level input representation via melodic contours. The aim is to allo…

cs.LG2023

When the Ground Truth is not True: Modelling Human Biases in Temporal Annotations

Taku Yamagata, Emma L. Tonkin, Benjamin Arana Sanchez +5

In supervised learning, low quality annotations lead to poorly performing classification and detection models, while also rendering evaluation unreliable. This is particularly appa…

cs.LG2022★ 12 cited

Q-learning Decision Transformer: Leveraging Dynamic Programming for Conditional Sequence Modelling in Offline RL

Taku Yamagata, Ahmed Khalil, Raul Santos-Rodriguez

Recent works have shown that tackling offline reinforcement learning (RL) with a conditional policy produces promising results. The Decision Transformer (DT) combines the condition…

cs.LG2022★ 1 cited

The Weak Supervision Landscape

Rafael Poyiadzi, Daniel Bacaicoa-Barber, Jesus Cid-Sueiro +3

Many ways of annotating a dataset for machine learning classification tasks that go beyond the usual class labels exist in practice. These are of interest as they can simplify or f…

cs.LG2021★ 194 cited

Classifier Calibration: A survey on how to assess and improve predicted class probabilities

Telmo Silva Filho, Hao Song, Miquel Perello-Nieto +3

This paper provides both an introduction to and a detailed overview of the principles and practice of classifier calibration. A well-calibrated classifier correctly quantifies the…

cs.LG2021★ 2 cited

Reinforcement Learning with Feedback from Multiple Humans with Diverse Skills

Taku Yamagata, Ryan McConville, Raul Santos-Rodriguez

A promising approach to improve the robustness and exploration in Reinforcement Learning is collecting human feedback and that way incorporating prior knowledge of the target envir…