2 papers
cs.CL2024
Task-Agnostic Language Model Watermarking via High Entropy Passthrough Layers
Vaden Masrani, Mohammad Akbari, David Ming Xuan Yue +2
In the era of costly pre-training of large language models, ensuring the intellectual property rights of model owners, and insuring that said models are responsibly deployed, is be…
cs.CL2024
GOLD: Generalized Knowledge Distillation via Out-of-Distribution-Guided Language Data Generation
Mohsen Gholami, Mohammad Akbari, Cindy Hu +3
Knowledge distillation from LLMs is essential for the efficient deployment of language models. Prior works have proposed data generation using LLMs for preparing distilled models.…