1 citations · 1 across the 5 of their papers we have counts for
Showing cs.LGShow all
3 papers · 1 filter
cs.LG2026
GRRR: The Geometry of Reshaping, Rotation, and Routing in Decoder LLM post-training
Jianing Qi, Hao Tang, Zhigang Zhu
We study how post-training changes the weights of Large Language Models (LLMs) relative to their pretrained weights. Across 12 post-training chains with supervised fine-tuning (SFT…
cs.LG2025
Policy Gradient Guidance Enables Test Time Control
Jianing Qi, Hao Tang, Zhigang Zhu
We introduce Policy Gradient Guidance (PGG), a simple extension of classifier-free guidance from diffusion models to classical policy gradient methods. PGG augments the policy grad…
cs.LG2024
VerifierQ: Enhancing LLM Test Time Compute with Q-Learning-based Verifiers
Jianing Qi, Hao Tang, Zhigang Zhu
Recent advancements in test time compute, particularly through the use of verifier models, have significantly enhanced the reasoning capabilities of Large Language Models (LLMs). T…