4 papers
SigmaScale: LLM Compression with SVD-based Low-Rank Decomposition and Learned Scaling Matrices
Ernests Lavrinovics, Marco Letizia, Roy Janco +3
We present SigmaScale, a method for learning auxiliary scaling matrices to aid truncated Singular Value Decomposition (SVD) based Large Language Model (LLM) compression. Instea…
MultiHal: Multilingual Dataset for Knowledge-Graph Grounded Evaluation of LLM Hallucinations
Ernests Lavrinovics, Russa Biswas, Katja Hose +1
Large Language Models (LLMs) have inherent limitations of faithfulness and factuality, commonly referred to as hallucinations. Several benchmarks have been developed that provide a…
Limited-Resource Adapters Are Regularizers, Not Linguists
Marcell Fekete, Nathaniel R. Robinson, Ernests Lavrinovics +4
Cross-lingual transfer from related high-resource languages is a well-established strategy to enhance low-resource language technologies. Prior work has shown that adapters show pr…
Knowledge Graphs, Large Language Models, and Hallucinations: An NLP Perspective
Ernests Lavrinovics, Russa Biswas, Johannes Bjerva +1
Large Language Models (LLMs) have revolutionized Natural Language Processing (NLP) based applications including automated text generation, question answering, chatbots, and others.…