5 citations · 21 across the 22 of their papers we have counts for
5 papers · 1 filter
Kernelized Activation Steering
Laziz U. Abdullaev, Minh-Hieu Pham, Bach Do +2
Activation steering provides a simple, training-free mechanism for controlling attributes of generative models such as sentiment, style, and helpfulness. However, standard approach…
Reservoir of Importance: Learning Semi-Structured Sparsity with Differentiable Subset Sampling
Ha Dinh, Xuan Duy Ta, Khoat Than +1
Semi-structured : sparsity has emerged as a practical direction for accelerating large language models (LLMs). However, existing learnable-mask approaches incur substantial p…
No-Free-Fairness: Fundamental Limits and Trade-offs in Learning Systems
Khoat Than
In this paper, we establish a set of theoretical impossibility results, termed the No-Free-Fairness theorems, that identify three fundamental sources of disparity in learning syste…
High-Dimensional Random Projection for Activation Steering in Language Models
Minh-Hieu Pham, Bach Do, Laziz Abdullaev +2
Activation steering has emerged as a key methodology for controlling the behavior of large language models (LLMs). Existing difference-in-means based methods, however, are fundamen…
LCA: Local Classifier Alignment for Continual Learning
Tung Tran, Danilo Vasconcellos Vargas, Khoat Than
A fundamental requirement for intelligent systems is the ability to learn continuously under changing environments. However, models trained in this regime often suffer from catastr…