6 papers
VistaHop: Benchmarking Long-Horizon Visual DeepSearch
Hang He, Chuhuai Yue, Chengqi Dong +6
Visual DeepSearch tasks require multimodal large language models (MLLMs) to resolve complex visual queries by repeatedly inspecting image regions, grounding reasoning in visual evi…
LocalSearchBench: Benchmarking Agentic Search in Real-World Local Life Services
Hang He, Chuhuai Yue, Chengqi Dong +12
Recent advances in large reasoning models LRMs have enabled agentic search systems to perform complex multi-step reasoning across multiple sources. However, most studies focus on g…
Assessing the Impact of Requirement Ambiguity on LLM-based Function-Level Code Generation
Di Yang, Xinou Xie, Xiuwen Yang +7
Software requirement ambiguity is ubiquitous in real-world development, stemming from the inherent imprecision of natural language and the varying interpretations of stakeholders.…
Improving Random Testing via LLM-powered UI Tarpit Escaping for Mobile Apps
Mengqian Xu, Yiheng Xiong, Le Chang +3
Random GUI testing is a widely-used technique for testing mobile apps. However, its effectiveness is limited by the notorious issue -- UI exploration tarpits, where the exploration…
Automated detection of atomicity violations in large-scale systems
Hang He, Yixing Luo, Chengcheng Wan +3
Atomicity violations in interrupt-driven programs pose a significant threat to software reliability in safety-critical systems. These violations occur when the execution sequence o…
Are LLMs Correctly Integrated into Software Systems?
Yuchen Shao, Yuheng Huang, Jiawei Shen +3
Large language models (LLMs) provide effective solutions in various application scenarios, with the support of retrieval-augmented generation (RAG). However, developers face challe…