4 papers · 1 filter
Black-Box Detection of LLM-Generated Text Using Generalized Jensen-Shannon Divergence
Shuangyi Chen, Ashish Khisti
We study black-box detection of machine-generated text under practical constraints: the scoring model (proxy LM) may mismatch the unknown source model, and per-input contrastive ge…
Multi-Bitwidth Quantization for LLMs Using Additive Codebooks
Liza Babaoglu, Shuangyi Chen, Ashish Khisti
As large language models (LLMs) are increasingly deployed across heterogeneous hardware with varying resource constraints, the ability to adaptively manage the trade-off between pe…
Robust Federated Finetuning of LLMs via Alternating Optimization of LoRA
Shuangyi Chen, Yuanxin Guo, Yue Ju +3
Parameter-Efficient Fine-Tuning (PEFT) methods like Low-Rank Adaptation (LoRA) optimize federated training by reducing computational and communication costs. We propose RoLoRA, a f…
Robust Federated Finetuning of Foundation Models via Alternating Minimization of LoRA
Shuangyi Chen, Yue Ju, Hardik Dalal +2
Parameter-Efficient Fine-Tuning (PEFT) has risen as an innovative training strategy that updates only a select few model parameters, significantly lowering both computational and m…