9 citations · 15 across the 9 of their papers we have counts for
Showing 2026Show all
3 papers · 1 filter
cs.CL2026
Continued Pretraining of FinBERT on Finnish Histopathological Reports: Train-Time Signals and Proxy Downstream Correlations
Rami Luisto, Liisa Petäinen, Tommi Grönholm +5
In Natural Language Processing (NLP) classification tasks where a lack of labeled data is an issue, continued pretraining (CPT) of transformer models on unlabeled data is an establ…
cs.CL2026
A visual observation on the geometry of UMAP projections of the difference vectors of antonym and synonym word pair embeddings
Rami Luisto
Antonyms, or opposites, are sometimes defined as \emph{word pairs that have all of the same contextually relevant properties but one}. Seeing how transformer models seem to encode…
physics.soc-ph2026
Observing rurality of a geographical area from road graph geometry -- a qualitative study
Rami Luisto
In this paper we analyze the Finnish road network as a graph in order to measure whether the "rurality" or "urbanity" of an area correlates with local geometrical properties of the…