9 papers
OPTD: On-Policy Transition Distillation with Consistency-Guided Adaptive Compression for Few-Step Diffusion Language Models
Xiaocheng Lu, Hualei Zhang, Shuhan Guo +8
Diffusion language models (dLLMs) can predict many tokens in parallel, but accurate generation still requires many iterative denoising steps. Few-step distillation accelerates deco…
Beyond Entropy: Learning from Token-Level Distributional Deviations for LLM Reasoning
Xuanzhi Feng, Zhengyang Li, Zeyu Liu +6
Reinforcement Learning with Verifiable Rewards (RLVR) has significantly advanced Large Language Model (LLM) reasoning; however, it faces a fundamental optimization instability: uni…
Mitigating Bias in Low-SNR Financial Reinforcement Learning via Quantum Representations
Zeyu Liu, Xuanzhi Feng, Sing Kwong Lai +6
The financial market is a typical low signal-to-noise ratio (SNR) setting, which often destabilizes off-policy maximum-entropy methods like Soft Actor-Critic (SAC). Specifically, n…
Second-Order Path Kernel Interpolation Formulas in Machine Learning
Jin Guo, Roy Y. He, Jean-Michel Morel
Understanding how training data shape neural network predictions is a central problem in modern learning theory. In 2020, Pedro Domingos proposed an interpolation formula valid for…
AdaTok: Self-Budgeting Image Tokenization with Quality-Preserving Dynamic Tokens
Xiaocheng Lu, Yuxi Chen, Jie Zhang +5
Image tokenizers, from 2D grids to recent 1D sequences, typically encode every image with the same fixed number of tokens. Yet visual complexity is highly heterogeneous, so a unifo…
Consistent-Inversion: Reverse Consistency Guidance for Structure-Preserving Visual Editing
Xiaocheng Lu, Jingcai Guo, Song Guo
Text-guided diffusion models have become effective tools for real-image visual editing, where the edited image must follow a target instruction while preserving editing-irrelevant…