5 papers · 1 filter
Hesitation Has a Geometry: Entropy-Trained Hyperbolic Probes for Sparse Activation Steering
Zeyong Zhang, Tung Sum Thomas Kwok, Tengfei Ma +1
When a large language model solves a mathematical problem, its reasoning is largely hierarchical, and the solution often branches at a few tokens where the next-token entropy is hi…
Entropy Can Flow, or It Can Guide. Be Entropy. LEDFlow: Introducing Entropy-guided Generation Order into Uniform Discrete Flow
Tung Sum Thomas Kwok, Yidong Ouyang, Yingjia Wan +3
Uniform discrete flow permits repeated updates at every generation position. While continued revision supports correction of wrong tokens, it also exposes correct intermediate pred…
Co-Evolution of Policy and Internal Reward for Language Agents
Xinyu Wang, Hanwei Wu, Jingwei Song +8
Large language model (LLM) agents learn by interacting with environments, but long-horizon training remains fundamentally bottlenecked by sparse and delayed rewards. Existing metho…
Towards High Supervised Learning Utility Training Data Generation: Data Pruning and Column Reordering
Tung Sum Thomas Kwok, Zeyong Zhang, Chi-Hua Wang +1
Tabular data synthesis for supervised learning ('SL') model training is gaining popularity in industries such as healthcare, finance, and retail. Despite the progress made in tabul…
GReaTER: Generate Realistic Tabular data after data Enhancement and Reduction
Tung Sum Thomas Kwok, Chi-Hua Wang, Guang Cheng
Tabular data synthesis involves not only multi-table synthesis but also generating multi-modal data (e.g., strings and categories), which enables diverse knowledge synthesis. Howev…