4 papers
Retro-li: Small-Scale Retrieval Augmented Generation Supporting Noisy Similarity Searches and Domain Shift Generalization
Gentiana Rashiti, Geethan Karunaratne, Mrinmaya Sachan +2
The retrieval augmented generation (RAG) system such as Retro has been shown to improve language modeling capabilities and reduce toxicity and hallucinations by retrieving from a d…
On the Role of Noise in Factorizers for Disentangling Distributed Representations
Geethan Karunaratne, Michael Hersche, Abu Sebastian +1
To efficiently factorize high-dimensional distributed representations to the constituent atomic vectors, one can exploit the compute-in-superposition capabilities of vector-symboli…
Factorizers for Distributed Sparse Block Codes
Michael Hersche, Aleksandar Terzic, Geethan Karunaratne +6
Distributed sparse block codes (SBCs) exhibit compact representations for encoding and manipulating symbolic data structures using fixed-width vectors. One major challenge however…
Zero-shot Classification using Hyperdimensional Computing
Samuele Ruffino, Geethan Karunaratne, Michael Hersche +3
Classification based on Zero-shot Learning (ZSL) is the ability of a model to classify inputs into novel classes on which the model has not previously seen any training examples. P…