3 papers
cs.IR2025
Building Russian Benchmark for Evaluation of Information Retrieval Models
Grigory Kovalev, Mikhail Tikhomirov, Evgeny Kozhevnikov +2
We introduce RusBEIR, a comprehensive benchmark designed for zero-shot evaluation of information retrieval (IR) models in the Russian language. Comprising 17 datasets from various…
cs.CL2025
RuOpinionNE-2024: Extraction of Opinion Tuples from Russian News Texts
Natalia Loukachevitch, Natalia Tkachenko, Anna Lapanitsyna +2
In this paper, we introduce the Dialogue Evaluation shared task on extraction of structured opinions from Russian news texts. The task of the contest is to extract opinion tuples f…
cs.CL2024
Exploring Prompt-Based Methods for Zero-Shot Hypernym Prediction with Large Language Models
Mikhail Tikhomirov, Natalia Loukachevitch
This article investigates a zero-shot approach to hypernymy prediction using large language models (LLMs). The study employs a method based on text probability calculation, applyin…