157 citations · 929 across the 89 of their papers we have counts for
3 papers · 1 filter
Beyond Perplexity: A Lightweight Benchmark for Knowledge Retention in Supervised Fine-Tuning
Soheil Zibakhsh Shabgahi, Pedram Aghazadeh, Farinaz Koushanfar
Supervised Fine-Tuning (SFT) is a standard approach for injecting domain knowledge into Large Language Models (LLMs). However, relying on validation perplexity to monitor training…
Key, Value, Compress: A Systematic Exploration of KV Cache Compression Techniques
Neusha Javidnia, Bita Darvish Rouhani, Farinaz Koushanfar
Large language models (LLMs) have demonstrated exceptional capabilities in generating text, images, and video content. However, as context length grows, the computational cost of a…
Text Revealer: Private Text Reconstruction via Model Inversion Attacks against Transformers
Ruisi Zhang, Seira Hidano, Farinaz Koushanfar
Text classification has become widely used in various natural language processing applications like sentiment analysis. Current applications often use large transformer-based langu…