5 papers
Chart Specification: Structural Representations for Incentivizing VLM Reasoning in Chart-to-Code Generation
Minggui He, Mingchen Dai, Jian Zhang +5
Vision-Language Models (VLMs) have shown promise in generating plotting code from chart images, yet achieving structural fidelity remains challenging. Existing approaches largely r…
ReInAgent: A Context-Aware GUI Agent Enabling Human-in-the-Loop Mobile Task Navigation
Haitao Jia, Ming He, Zimo Yin +3
Mobile GUI agents exhibit substantial potential to facilitate and automate the execution of user tasks on mobile phones. However, exist mobile GUI agents predominantly privilege au…
Attention Mechanisms Perspective: Exploring LLM Processing of Graph-Structured Data
Zhong Guan, Likang Wu, Hongke Zhao +2
Attention mechanisms are critical to the success of large language models (LLMs), driving significant advancements in multiple fields. However, for graph-structured data, which req…
Multi-View Empowered Structural Graph Wordification for Language Models
Zipeng Liu, Likang Wu, Ming He +3
Significant efforts have been dedicated to integrating the powerful Large Language Models (LLMs) with diverse modalities, particularly focusing on the fusion of language, vision an…
GANPrompt: Enhancing Robustness in LLM-Based Recommendations with GAN-Enhanced Diversity Prompts
Xinyu Li, Chuang Zhao, Hongke Zhao +2
In recent years, Large Language Models (LLMs) have demonstrated remarkable proficiency in comprehending and generating natural language, with a growing prevalence in the domain of…