5 papers
Beyond Accuracy: Prefix-Invariant Realizations of Low-Precision Fast Matrix Multiplication
Shuxiao Xie, Shuyang Xie, Yuan Cao +3
Fast matrix multiplication saves multiplications through exact cancellation, but rounding sums that mix token rows can leave contributions from later tokens in earlier language mod…
Backward-State Policy Is Part of the Learning Algorithm
Shuxiao Xie, Shuyang Xie, Dezhi Ran +2
Low-precision training rounds tensors that the backward pass reads again, often for several gradients; each use can read the forward's rounded value, the original, or a new random…
Fast Matrix Multiplication in fp8: Certified Coefficient Optimization and Measured Error
Shuxiao Xie, Shuyang Xie, Yuan Cao +3
A Strassen-type algorithm has many realizations with the same exact product and multiplication count yet different fp8 error because basis changes reshape coefficient geometry, pos…
Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch
Shuyang Xie, Shuxiao Xie, Feng Zhu +2
Online-judge verdicts and the datasets and benchmarks built on them are treated as ground truth for evaluating and training large language models for code. Yet prior audits have so…
OPERA: An Agent for Image Restoration with End-to-End Joint Planning-Execution Optimization
Feng Zhu, Shuyang Xie, Yihan Zeng +2
Real-world image restoration is challenging due to complex and interacting mixed degradations. Recent agent-based approaches address this problem by composing multiple task-specifi…