activity
20102026
most citedBeyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

565 citations · 908 across the 35 of their papers we have counts for

collaborators
Showing 2018Show all

5 papers · 1 filter

cs.AI2018★ 20 cited

Analysing Results from AI Benchmarks: Key Indicators and How to Obtain Them

Fernando Martínez-Plumed, José Hernández-Orallo

Item response theory (IRT) can be applied to the analysis of the evaluation of results from AI benchmarks. The two-parameter IRT model provides two indicators (difficulty and discr…

cs.AI2018★ 3 cited

General-purpose Declarative Inductive Programming with Domain-Specific Background Knowledge for Data Wrangling Automation

Lidia Contreras-Ochando, César Ferri, José Hernández-Orallo +3

Given one or two examples, humans are good at understanding how to solve a problem independently of its domain, because they are able to detect what the problem is and to choose th…

cs.AI2018★ 9 cited

A multidisciplinary task-based perspective for evaluating the impact of AI autonomy and generality on the future of work

Enrique Fernández-Macías, Emilia Gómez, José Hernández-Orallo +4

This paper presents a multidisciplinary task approach for assessing the impact of artificial intelligence on the future of work. We provide definitions of a task from two main pers…

cs.AI2018★ 6 cited

Assessing the impact of machine intelligence on human behaviour: an interdisciplinary endeavour

Emilia Gómez, Carlos Castillo, Vicky Charisi +23

This document contains the outcome of the first Human behaviour and machine intelligence (HUMAINT) workshop that took place 5-6 March 2018 in Barcelona, Spain. The workshop was org…

cs.AI2018

Finite Biased Teaching with Infinite Concept Classes

Jose Hernandez-Orallo, Jan Arne Telle

We investigate the teaching of infinite concept classes through the effect of the learning bias (which is used by the learner to prefer some concepts over others and by the teacher…