8 citations · 13 across the 19 of their papers we have counts for
Showing cs.LGShow all
3 papers · 1 filter
cs.LG2026
Certain Head, Uncertain Tail: Expert-Sample for Test-Time Scaling in Fine-Grained MoE
Yuanteng Chen, Peisong Wang, Nanxin Zeng +5
Test-time scaling improves LLM performance by generating multiple candidate solutions, yet token-level sampling requires temperature tuning that trades off diversity against stabil…
cs.LG2025
Layer Specialization Underlying Compositional Reasoning in Transformers
Jing Liu
Transformers exhibit compositional reasoning on sequences not observed during training, a capability often attributed to in-context learning (ICL) and skill composition. We investi…
cs.LG2025
Circuit-Aware Reward Training: A Mechanistic Framework for Longtail Robustness in RLHF
Jing Liu
Reinforcement Learning from Human Feedback (RLHF) reward models exhibit systematic failures on longtail distributions, leading to reward hacking and misalignment. We propose a mech…