4 papers
Observing rurality of a geographical area from road graph geometry -- a qualitative study
Rami Luisto
In this paper we analyze the Finnish road network as a graph in order to measure whether the "rurality" or "urbanity" of an area correlates with local geometrical properties of the…
Domain Fine-Tuning FinBERT on Finnish Histopathological Reports: Train-Time Signals and Downstream Correlations
Rami Luisto, Liisa Petäinen, Tommi Grönholm +5
In NLP classification tasks where little labeled data exists, domain fine-tuning of transformer models on unlabeled data is an established approach. In this paper we have two aims.…
A visual observation on the geometry of UMAP projections of the difference vectors of antonym and synonym word pair embeddings
Rami Luisto
Antonyms, or opposites, are sometimes defined as \emph{word pairs that have all of the same contextually relevant properties but one}. Seeing how transformer models seem to encode…
A short survey on almost orthogonal vectors in a few specific large dimensions
Rami Luisto
The concept of \emph{almost orthogonal vectors}, i.e.\ vectors whose cosine similarity is close to , relates to topics both in pure mathematics and in coding theory under the gu…