2 citations · 3 across the 20 of their papers we have counts for
4 papers · 1 filter
Random Attention: Rethinking KV Cache Eviction for Efficient Reasoning
Heng Wang, Jielin Qiu, Wenting Zhao +8
Large language models achieve superior performance on tasks that require extended reasoning, but long chains of thought make the KV cache a severe memory bottleneck. Existing KV ca…
Position: Vector Prompt Interfaces Should Be Exposed to Enable Customization of Large Language Models
Liangwei Yang, Shiyu Wang, Haolin Chen +12
As large language models (LLMs) transition from research prototypes to real-world systems, customization has emerged as a central bottleneck. While text prompts can already customi…
Prompt Optimization Via Diffusion Language Models
Shiyu Wang, Haolin Chen, Liangwei Yang +8
We propose a diffusion-based framework for prompt optimization that leverages Diffusion Language Models (DLMs) to iteratively refine system prompts through masked denoising. By con…
Promptomatix: An Automatic Prompt Optimization Framework for Large Language Models
Rithesh Murthy, Ming Zhu, Liangwei Yang +6
Large Language Models (LLMs) perform best with well-crafted prompts, yet prompt engineering remains manual, inconsistent, and inaccessible to non-experts. We introduce Promptomatix…