From the 1 of 4 linked papers with an AI index.
4 papers
Revisiting Lossy Verification in Speculative Decoding: Mechanisms, Trade-offs, and Failure Modes
Tianyu Wang, Yuxuan Zhou, Wenbin Wang +3
The paper analyzes lossy verification techniques used in speculative decoding for large language models, categorizing them into truncation‑based and collaborative methods, identify…
Overcoming Joint Intractability with Lossless Hierarchical Speculative Decoding
Yuxuan Zhou, Fei Huang, Heng Li +5
Verification is a key bottleneck in improving inference speed while maintaining distribution fidelity in Speculative Decoding. Recent work has shown that sequence-level verificatio…
OneTrans: Unified Feature Interaction and Sequence Modeling with One Transformer in Industrial Recommender
Zhaoqi Zhang, Haolei Pei, Jun Guo +5
In recommendation systems, scaling up feature-interaction modules (e.g., Wukong, RankMixer) or user-behavior sequence modules (e.g., LONGER) has achieved notable success. However,…
DRO: A Python Library for Distributionally Robust Optimization in Machine Learning
Jiashuo Liu, Tianyu Wang, Henry Lam +2
We introduce dro, an open-source Python library for distributionally robust optimization (DRO) for regression and classification problems. The library implements 14 DRO formulation…