5 papers · 1 filter
SigmaScale: LLM Compression with SVD-based Low-Rank Decomposition and Learned Scaling Matrices
Ernests Lavrinovics, Marco Letizia, Roy Janco +3
We present SigmaScale, a method for learning auxiliary scaling matrices to aid truncated Singular Value Decomposition (SVD) based Large Language Model (LLM) compression. Instea…
MultiHal: Multilingual Dataset for Knowledge-Graph Grounded Evaluation of LLM Hallucinations
Ernests Lavrinovics, Russa Biswas, Katja Hose +1
Large Language Models (LLMs) have inherent limitations of faithfulness and factuality, commonly referred to as hallucinations. Several benchmarks have been developed that provide a…
Limited-Resource Adapters Are Regularizers, Not Linguists
Marcell Fekete, Nathaniel R. Robinson, Ernests Lavrinovics +4
Cross-lingual transfer from related high-resource languages is a well-established strategy to enhance low-resource language technologies. Prior work has shown that adapters show pr…
Knowledge Graphs, Large Language Models, and Hallucinations: An NLP Perspective
Ernests Lavrinovics, Russa Biswas, Johannes Bjerva +1
Large Language Models (LLMs) have revolutionized Natural Language Processing (NLP) based applications including automated text generation, question answering, chatbots, and others.…
CreoleVal: Multilingual Multitask Benchmarks for Creoles
Heather Lent, Kushal Tatariya, Raj Dabre +18
Creoles represent an under-explored and marginalized group of languages, with few available resources for NLP research.While the genealogical ties between Creoles and a number of h…