2 citations · 3 across the 11 of their papers we have counts for
3 papers · 1 filter
Task-Agnostic Language Model Watermarking via High Entropy Passthrough Layers
Vaden Masrani, Mohammad Akbari, David Ming Xuan Yue +2
In the era of costly pre-training of large language models, ensuring the intellectual property rights of model owners, and insuring that said models are responsibly deployed, is be…
GOLD: Generalized Knowledge Distillation via Out-of-Distribution-Guided Language Data Generation
Mohsen Gholami, Mohammad Akbari, Cindy Hu +3
Knowledge distillation from LLMs is essential for the efficient deployment of language models. Prior works have proposed data generation using LLMs for preparing distilled models.…
ArchBERT: Bi-Modal Understanding of Neural Architectures and Natural Languages
Mohammad Akbari, Saeed Ranjbar Alvar, Behnam Kamranian +2
Building multi-modal language models has been a trend in the recent years, where additional modalities such as image, video, speech, etc. are jointly learned along with natural lan…