1 citations · 1 across the 11 of their papers we have counts for
7 papers · 1 filter
GAW-PO: Preference Optimization with Gradient-Aligned Token Weights
Andreea Dutulescu, Stefan Ruseti, Mihai Masala +2
Most preference optimization methods, such as Direct Preference Optimization (DPO), apply preference supervision at the response level, although autoregressive language models are…
"Înţelegi Româneşte?'' A Recipe for Romanian Vision-Language Models
Mihai Masala, Marius Leordeanu, Mihai Dascalu +1
Vision-Language Models (VLMs) largely follow the text-only LLM trajectory, excelling on English benchmarks but sharply degrading on low-resource languages, where neither large-scal…
Improving Romanian LLM Pretraining Data using Diversity and Quality Filtering
Vlad Negoita, Mihai Masala, Traian Rebedea
Large Language Models (LLMs) have recently exploded in popularity, often matching or outperforming human abilities on many tasks. One of the key factors in training LLMs is the ava…
"Vorbeşti Româneşte?" A Recipe to Train Powerful Romanian LLMs with English Instructions
Mihai Masala, Denis C. Ilie-Ablachim, Alexandru Dima +10
In recent years, Large Language Models (LLMs) have achieved almost human-like performance on various tasks. While some LLMs have been trained on multilingual data, most of the trai…
OpenLLM-Ro -- Technical Report on Open-source Romanian LLMs
Mihai Masala, Denis C. Ilie-Ablachim, Dragos Corlatescu +6
In recent years, Large Language Models (LLMs) have achieved almost human-like performance on various tasks. While some LLMs have been trained on multilingual data, most of the trai…
Improving Legal Judgement Prediction in Romanian with Long Text Encoders
Mihai Masala, Traian Rebedea, Horia Velicu
In recent years,the entire field of Natural Language Processing (NLP) has enjoyed amazing novel results achieving almost human-like performance on a variety of tasks. Legal NLP dom…
GEST: the Graph of Events in Space and Time as a Common Representation between Vision and Language
Mihai Masala, Nicolae Cudlenco, Traian Rebedea +1
One of the essential human skills is the ability to seamlessly build an inner representation of the world. By exploiting this representation, humans are capable of easily finding c…