4 papers
Optimal Online and Offline Algorithms for Contextual MNL with Applications to Assortment and Pricing
Yunfan Zhang, Yuxuan Han, Hongyu Shan +2
Selecting which products to display and at what prices is a central decision in retail and e-commerce operations. In many applications, these two choices must be made jointly under…
Structural Reward Model: Enhancing Interpretability, Efficiency, and Scalability in Reward Modeling
Xiaoyu Liu, Di Liang, Chang Dai +9
Reward Models (RMs) are key components for evaluating and guiding language model outputs. However, traditional scalar RMs often struggle with incorporating contextual and backgroun…
R-Capsule: Compressing High-Level Plans for Efficient Large Language Model Reasoning
Hongyu Shan, Mingyang Song, Chang Dai +2
Chain-of-Thought (CoT) prompting helps Large Language Models (LLMs) tackle complex reasoning by eliciting explicit step-by-step rationales. However, CoT's verbosity increases laten…
HoPE: Hyperbolic Rotary Positional Encoding for Stable Long-Range Dependency Modeling in Large Language Models
Chang Dai, Hongyu Shan, Mingyang Song +1
Positional encoding mechanisms enable Transformers to model sequential structure and long-range dependencies in text. While absolute positional encodings struggle with extrapolatio…