11 citations · 15 across the 15 of their papers we have counts for
4 papers · 1 filter
One Token Can Be Enough: Bridging Prompting and Activation Steering with Prefix Steering
Xudong Zhu, Zhihui Zhu
Prompting guides language model behavior through the initial context, whereas activation steering often intervenes throughout generation. A natural question is whether steering can…
From Emergence to Control: Probing and Modulating Self-Reflection in Language Models
Xudong Zhu, Jiachen Jiang, Mohammad Mahdi Khalili +1
Self-reflection -- the ability of a large language model (LLM) to revisit, evaluate, and revise its own reasoning -- has recently emerged as a powerful behavior enabled by reinforc…
Understanding Task Vectors in In-Context Learning: Emergence, Functionality, and Limitations
Yuxin Dong, Jiachen Jiang, Zhihui Zhu +1
Task vectors offer a compelling mechanism for accelerating inference in in-context learning (ICL) by distilling task-specific information into a single, reusable representation. De…
OTOv3: Automatic Architecture-Agnostic Neural Network Training and Compression from Structured Pruning to Erasing Operators
Tianyi Chen, Tianyu Ding, Zhihui Zhu +4
Compressing a predefined deep neural network (DNN) into a compact sub-network with competitive performance is crucial in the efficient machine learning realm. This topic spans vari…