Decoupling What from Where: How Should a Small GUI Grounding Model Receive the Action Type?

Aadi Chauhan, Arthur Ilyasov

A GUI agent decides which action to take and where to take it; we ask how a small grounding model should receive the action type. Fine-tuning Qwen2-VL-2B with LoRA on Android in th…