29 citations · 97 across the 12 of their papers we have counts for
12 papers
Surpassing state of the art on AMD area estimation from RGB fundus images through careful selection of U-Net architectures and loss functions for class imbalance
Valentyna Starodub, Mantas Lukoševičius
Age-related macular degeneration (AMD) is one of the leading causes of irreversible vision impairment in people over the age of 60. This research focuses on semantic segmentation f…
Extracting Sentence Embeddings from Pretrained Transformer Models
Lukas Stankevičius, Mantas Lukoševičius
Pre-trained transformer models shine in many natural language processing tasks and therefore are expected to bear the representation of the input sentence or text meaning. These se…
Inference acceleration for large language models using "stairs" assisted greedy generation
Domas Grigaliūnas, Mantas Lukoševičius
Large Language Models (LLMs) with billions of parameters are known for their impressive predicting capabilities but require lots of resources to run. With their massive rise in pop…
Sentiment Analysis of Lithuanian Online Reviews Using Large Language Models
Brigita Vileikytė, Mantas Lukoševičius, Lukas Stankevičius
Sentiment analysis is a widely researched area within Natural Language Processing (NLP), attracting significant interest due to the advent of automated solutions. Despite this, the…
Optimizing Large Language Models for OpenAPI Code Completion
Bohdan Petryshyn, Mantas Lukoševičius
Recent advancements in Large Language Models (LLMs) and their utilization in code generation tasks have significantly reshaped the field of software development. Despite the remark…
Correcting diacritics and typos with a ByT5 transformer model
Lukas Stankevičius, Mantas Lukoševičius, Jurgita Kapočiūtė-Dzikienė +2
Due to the fast pace of life and online communications and the prevalence of English and the QWERTY keyboard, people tend to forgo using diacritics, make typographical errors (typo…
Automated age-related macular degeneration area estimation -- first results
Rokas Pečiulis, Mantas Lukoševičius, Algimantas Kriščiukaitis +2
This work aims to research an automatic method for detecting Age-related Macular Degeneration (AMD) lesions in RGB eye fundus images. For this, we align invasively obtained eye fun…
Generating abstractive summaries of Lithuanian news articles using a transformer model
Lukas Stankevičius, Mantas Lukoševičius
In this work, we train the first monolingual Lithuanian transformer model on a relatively large corpus of Lithuanian news articles and compare various output decoding algorithms fo…
Efficient implementations of echo state network cross-validation
Mantas Lukoševičius, Arnas Uselis
Background/introduction: Cross-Validation (CV) is still uncommon in time series modeling. Echo State Networks (ESNs), as a prime example of Reservoir Computing (RC) models, are kno…
Localized convolutional neural networks for geospatial wind forecasting
Arnas Uselis, Mantas Lukoševičius, Lukas Stasytis
Convolutional Neural Networks (CNN) possess many positive qualities when it comes to spatial raster data. Translation invariance enables CNNs to detect features regardless of their…
Testing pre-trained Transformer models for Lithuanian news clustering
Lukas Stankevičius, Mantas Lukoševičius
A recent introduction of Transformer deep learning architecture made breakthroughs in various natural language processing tasks. However, non-English languages could not leverage s…
Efficient Cross-Validation of Echo State Networks
Mantas Lukoševičius, Arnas Uselis
Echo State Networks (ESNs) are known for their fast and precise one-shot learning of time series. But they often need good hyper-parameter tuning for best performance. For this goo…