5 papers
Experience-Evolving Multi-Turn Tool-Use Agent with Hybrid Episodic-Procedural Memory
Sijia Li, Yuchen Huang, Zifan Liu +6
As intents unfold and environments change, multi-turn agents face continuously shifting decision contexts. Although reusing past experience is intuitively appealing, existing appro…
See Less, See Right: Bi-directional Perceptual Shaping For Multimodal Reasoning
Shuoshuo Zhang, Yizhen Zhang, Jingjing Fu +4
Large vision-language models (VLMs) often benefit from intermediate visual cues, either injected via external tools or generated as latent visual tokens during reasoning, but these…
PixelCraft: A Multi-Agent System for High-Fidelity Visual Reasoning on Structured Images
Shuoshuo Zhang, Zijian Li, Yizhen Zhang +6
Structured images (e.g., charts and geometric diagrams) remain challenging for multimodal large language models (MLLMs), as perceptual slips can cascade into erroneous conclusions.…
Chain of Functions: A Programmatic Pipeline for Fine-Grained Chart Reasoning Data
Zijian Li, Jingjing Fu, Lei Song +3
Visual reasoning is crucial for multimodal large language models (MLLMs) to address complex chart queries, yet high-quality rationale data remains scarce. Existing methods leverage…
Graph Neural Network Enhanced Retrieval for Question Answering of LLMs
Zijian Li, Qingyan Guo, Jiawei Shao +4
Retrieval augmented generation has revolutionized large language model (LLM) outputs by providing factual supports. Nevertheless, it struggles to capture all the necessary knowledg…