2 citations · 3 across the 7 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Does On-Policy Distillation Need to Complete Every Rollout?
Zhengxin Zhang, Maosen Tang, Ning Wang +6
On-policy distillation (OPD) transfers teacher knowledge to a student through feedback on student-generated rollouts, but generating complete rollouts and computing per-token teach…
cs.LG2026
Rational Neural Networks have Expressivity Advantages
Maosen Tang, Alex Townsend
We study neural networks with trainable low-degree rational activation functions and show that they are more expressive and parameter-efficient than modern piecewise-linear and smo…