28 citations · 43 across the 15 of their papers we have counts for
3 papers · 1 filter
Selective Attention: Enhancing Transformer through Principled Context Control
Xuechen Zhang, Xiangyu Chang, Mingchen Li +3
The attention mechanism within the transformer architecture enables the model to weigh and combine tokens based on their relevance to the query. While self-attention has enjoyed ma…
Efficient Contextual LLM Cascades through Budget-Constrained Policy Learning
Xuechen Zhang, Zijian Huang, Ege Onur Taga +3
Recent successes in natural language processing have led to the proliferation of large language models (LLMs) by multiple providers. Each LLM offering has different inference accur…
Class-attribute Priors: Adapting Optimization to Heterogeneity and Fairness Objective
Xuechen Zhang, Mingchen Li, Jiasi Chen +2
Modern classification problems exhibit heterogeneities across individual classes: Each class may have unique attributes, such as sample size, label quality, or predictability (easy…