output
20062026
most citedEfficient Estimation of Word Representations in Vector Space

25.8k citations

Showing 2024 · cs.CLShow all

7 papers · 2 filters

cs.CL2024★ 1 cited

Task Prompt Vectors: Effective Initialization through Multi-Task Soft-Prompt Transfer

Robert Belanec, Simon Ostermann, Ivan Srba +1

Prompt tuning is an efficient solution for training large language models (LLMs). However, current soft-prompt-based methods often sacrifice multi-task modularity, requiring the tr…

cs.CL2024★ 1 cited

Soft Language Prompts for Language Transfer

Ivan Vykopal, Simon Ostermann, Marián Šimko

Cross-lingual knowledge transfer, especially between high- and low-resource languages, remains challenging in natural language processing (NLP). This study offers insights for impr…

cs.CL2024★ 1 cited

Fighting Randomness with Randomness: Mitigating Optimisation Instability of Fine-Tuning using Delayed Ensemble and Noisy Interpolation

Branislav Pecher, Jan Cegin, Robert Belanec +3

While fine-tuning of pre-trained language models generally helps to overcome the lack of labelled training samples, it also displays model performance instability. This instability…

cs.CL2024★ 24 cited

DAIC-WOZ: On the Validity of Using the Therapist's prompts in Automatic Depression Detection from Clinical Interviews

Sergio Burdisso, Ernesto Reyes-Ramírez, Esaú Villatoro-Tello +3

Automatic depression detection from conversational data has gained significant interest in recent years. The DAIC-WOZ dataset, interviews conducted by a human-controlled virtual ag…

cs.CL2024★ 2 cited

Reliability Estimation of News Media Sources: Birds of a Feather Flock Together

Sergio Burdisso, Dairazalia Sánchez-Cortés, Esaú Villatoro-Tello +1

Evaluating the reliability of news sources is a routine task for journalists and organizations committed to acquiring and disseminating accurate information. Recent research has sh…

cs.CL2024★ 1 cited

On Sensitivity of Learning with Limited Labelled Data to the Effects of Randomness: Impact of Interactions and Systematic Choices

Branislav Pecher, Ivan Srba, Maria Bielikova

While learning with limited labelled data can improve performance when the labels are lacking, it is also sensitive to the effects of uncontrolled randomness introduced by so-calle…

cs.CL2024★ 6 cited

Effects of diversity incentives on sample diversity and downstream model performance in LLM-based text augmentation

Jan Cegin, Branislav Pecher, Jakub Simko +3

The latest generative large language models (LLMs) have found their application in data augmentation tasks, where small numbers of text samples are LLM-paraphrased and then used to…