82 citations · 155 across the 8 of their papers we have counts for
7 papers · 1 filter
Predicting Social Media User Actions: A Hybrid Approach for Common and Rare Behavior Prediction on Bluesky
Benjamin White, Anastasia Shimorina
Understanding and predicting user behavior on social media platforms is crucial for content recommendation and platform design. While existing approaches focus primarily on common…
Multi-domain Multilingual Sentiment Analysis in Industry: Predicting Aspect-based Opinion Quadruples
Benjamin White, Anastasia Shimorina
This paper explores the design of an aspect-based sentiment analysis system using large language models (LLMs) for real-world use. We focus on quadruple opinion extraction -- ident…
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics
Sebastian Gehrmann, Tosin Adewumi, Karmanya Aggarwal +53
We introduce GEM, a living benchmark for natural language Generation (NLG), its Evaluation, and Metrics. Measuring progress in NLG relies on a constantly evolving ecosystem of auto…
A Systematic Review of Reproducibility Research in Natural Language Processing
Anya Belz, Shubham Agarwal, Anastasia Shimorina +1
Against the background of what has been termed a reproducibility crisis in science, the NLP field is becoming increasingly interested in, and conscientious about, the reproducibili…
The Human Evaluation Datasheet 1.0: A Template for Recording Details of Human Evaluation Experiments in NLP
Anastasia Shimorina, Anya Belz
This paper introduces the Human Evaluation Datasheet, a template for recording the details of individual human evaluation experiments in Natural Language Processing (NLP). Original…
Human vs Automatic Metrics: on the Importance of Correlation Design
Anastasia Shimorina
This paper discusses two existing approaches to the correlation analysis between automatic evaluation metrics and human scores in the area of natural language generation. Our exper…
Split and Rephrase
Shashi Narayan, Claire Gardent, Shay B. Cohen +1
We propose a new sentence simplification task (Split-and-Rephrase) where the aim is to split a complex sentence into a meaning preserving sequence of shorter sentences. Like senten…