4 papers
Subliminal Learning is Non-Semantic Distillation
Ethan Hadley, Eren Gultepe
Subliminal Learning (SL) is a surprising type of generalization displayed by modern language models. It allows the transfer of a bias or behavior from a teacher model to a student…
SPQ: An Ensemble Technique for Large Language Model Compression
Jiamin Yao, Eren Gultepe
This study presents an ensemble technique, SPQ (SVD-Pruning-Quantization), for large language model (LLM) compression that combines variance-retained singular value decomposition (…
LLMs in the Classroom: Outcomes and Perceptions of Questions Written with the Aid of AI
Gavin Witsken, Igor Crk, Eren Gultepe
We randomly deploy questions constructed with and without use of the LLM tool and gauge the ability of the students to correctly answer, as well as their ability to correctly perce…
Mapping Hymns and Organizing Concepts in the Rigveda: Quantitatively Connecting the Vedic Suktas
Venkatesh Bollineni, Igor Crk, Eren Gultepe
Accessing and gaining insight into the Rigveda poses a non-trivial challenge due to its extremely ancient Sanskrit language, poetic structure, and large volume of text. By using NL…