27 citations · 33 across the 18 of their papers we have counts for
10 papers · 1 filter
Terrarium: Growing Personal Assistants via Scalable Synthesis of App Worlds
Mengzhou Wu, Yuzhe Guo, Jiawen Tao +9
Advances in large language models (LLMs) have brought the vision of a general-purpose personal assistant closer to reality. Such assistants could provide a unified natural-language…
TileCas: Cascading Kernel Development Across Programming Abstractions
Xinyu Xiao, Zihe Song, Dezhi Ran +2
Programming abstractions have traditionally been designed for humans, but code generation is increasingly performed by models and autonomous agents. We investigate abstractions for…
Beyond Accuracy: Prefix-Invariant Realizations of Low-Precision Fast Matrix Multiplication
Shuxiao Xie, Shuyang Xie, Yuan Cao +3
Fast matrix multiplication saves multiplications through exact cancellation, but rounding sums that mix token rows can leave contributions from later tokens in earlier language mod…
Backward-State Policy Is Part of the Learning Algorithm
Shuxiao Xie, Shuyang Xie, Dezhi Ran +2
Low-precision training rounds tensors that the backward pass reads again, often for several gradients; each use can read the forward's rounded value, the original, or a new random…
Fast Matrix Multiplication in fp8: Certified Coefficient Optimization and Measured Error
Shuxiao Xie, Shuyang Xie, Yuan Cao +3
A Strassen-type algorithm has many realizations with the same exact product and multiplication count yet different fp8 error because basis changes reshape coefficient geometry, pos…
One QK Channel, Many Sources: Tracing Low-Precision Attention Collapse
Shuxiao Xie, Shuyang Xie, Yuan Cao +3
A bfloat16 transformer can train normally, then collapse abruptly. Prior work links collapse to structured attention errors and shows QK normalization disrupts their compounding. D…
BackendForge: Benchmarking Agentic End-to-End Code Generation with Backend Services
Yuzhe Guo, Mengzhou Wu, Yuan Cao +4
Large language models (LLMs) are increasingly used in agentic coding settings, where they can inspect files, execute commands, run tests, observe failures, and iteratively revise c…
UI-Oceanus: Scaling GUI Agents with Synthetic Environmental Dynamics
Mengzhou Wu, Yuzhe Guo, Yuan Cao +16
Scaling generalist GUI agents is hindered by the data scalability bottleneck of expensive human demonstrations and the "distillation ceiling" of synthetic teacher supervision. To t…
An Empirical Study and Theoretical Explanation on Task-Level Model-Merging Collapse
Yuan Cao, Dezhi Ran, Yuzhe Guo +5
Model merging unifies independently fine-tuned LLMs from the same base, enabling reuse and integration of parallel development efforts without retraining. However, in practice we o…
GUI-GENESIS: Automated Synthesis of Efficient Environments with Verifiable Rewards for GUI Agent Post-Training
Yuan Cao, Dezhi Ran, Mengzhou Wu +9
Post-training GUI agents in interactive environments is critical for developing generalization and long-horizon planning capabilities. However, training on real-world applications…