2 citations · 3 across the 4 of their papers we have counts for
5 papers · 1 filter
SigmaScale: LLM Compression with SVD-based Low-Rank Decomposition and Learned Scaling Matrices
Ernests Lavrinovics, Marco Letizia, Roy Janco +3
We present SigmaScale, a method for learning auxiliary scaling matrices to aid truncated Singular Value Decomposition (SVD) based Large Language Model (LLM) compression. Instea…
Limited-Resource Adapters Are Regularizers, Not Linguists
Marcell Fekete, Nathaniel R. Robinson, Ernests Lavrinovics +4
Cross-lingual transfer from related high-resource languages is a well-established strategy to enhance low-resource language technologies. Prior work has shown that adapters show pr…
MultiHal: Multilingual Dataset for Knowledge-Graph Grounded Evaluation of LLM Hallucinations
Ernests Lavrinovics, Russa Biswas, Katja Hose +1
Large Language Models (LLMs) have inherent limitations of faithfulness and factuality, commonly referred to as hallucinations. Several benchmarks have been developed that provide a…
Knowledge Graphs, Large Language Models, and Hallucinations: An NLP Perspective
Ernests Lavrinovics, Russa Biswas, Johannes Bjerva +1
Large Language Models (LLMs) have revolutionized Natural Language Processing (NLP) based applications including automated text generation, question answering, chatbots, and others.…
CreoleVal: Multilingual Multitask Benchmarks for Creoles
Heather Lent, Kushal Tatariya, Raj Dabre +18
Creoles represent an under-explored and marginalized group of languages, with few available resources for NLP research.While the genealogical ties between Creoles and a number of h…