From Visual Widgets to UI Code: Efficient Tool-Grounded Generation

Houston H. Zhang, Tao Zhang, Li Gu +5

Existing screenshot-to-code systems face a trade-off between flexibility and controllability. Direct multimodal generation can hallucinate visible details, whereas structured pipel…