9 papers · 1 filter
FinCUABuild: Can Agents Build Reliable Benchmarks for Dynamic Financial Computer Use?
Jingpu Yang, Fengxian Ji, Jinri Guo +7
Financial scenarios are diverse and complex, spanning varying data conditions, tool configurations, and workflows. Yet existing CUA, Computer-Using Agent, evaluation tasks remain l…
Style Wins, Substance Loses: A Diagnosis of LLM-as-Judge in Idea Generation
Fengxian Ji, Yuke Li, Jingpu Yang +8
However, whether these judges truly evaluate the scientific substance of ideas or are influenced by superficial stylistic presentation remains an open question. To address this que…
LabGuard: Grounding Natural-Language Laboratory Rules into Runtime Guards for Embodied Laboratory Agents
Jingpu Yang, Fengxian Ji, Zhengzhao Lai +8
Scientific embodied agents are increasingly capable of carrying out laboratory procedures, but executing these procedures safely in dynamic laboratory environments remains challeng…
OmniFood-Bench: Evaluating VLMs for Nutrient Reasoning and Personalized Health Advice
Qian Jiang, Zhecheng Shi, Jingpu Yang +2
The rapid integration of Large Vision-Language Models (VLMs) into critical infrastructure promises to revolutionize personalized healthcare and dietary management. However, in the…
Parametric Memory Decoding for Zero-Shot Routing in LoRA-Based External Parametric Memory
Fengxian Ji, Zhuohan Xie, Jingpu Yang +3
With the rise of parametric memory, LoRA-based External Parametric Memory (EPM) has emerged as a modular solution, but existing routing methods often introduce additional training,…
TextAlign: Preference Alignment for Text Rendering with Hierarchical Rewards
Mingxuan Cui, Jingpu Yang, Fengxian Ji +7
Faithful text rendering remains a persistent weakness of large text-to-image generative models, as it requires both semantic instruction following and fine-grained glyph-level stru…
From Reach to Insert: Tactile-Augmented Precision Assembly under Sub-Millimeter Tolerances
Xinpan Meng, Siyao Huang, JingPu Yang +6
High-precision assembly frequently involves tight-tolerance insertions, where even slight pose errors can cause jamming or excessive interaction forces, making robust and safe inse…
FineState-Bench: Benchmarking State-Conditioned Grounding for Fine-grained GUI State Setting
Fengxian Ji, Jingpu Yang, Zirui Song +5
Despite the rapid progress of large vision-language models (LVLMs), fine-grained, state-conditioned GUI interaction remains challenging. Current evaluations offer limited coverage,…
ServImage: An Image Generation and Editing Benchmark from Real-world Commercial Imaging Services
Fengxian Ji, Jingpu Yang, Zirui Song +5
Recent image generation and editing models demonstrate robust adherence to instructions and high visual quality on academic benchmarks. However, their performance on paid, real-wor…