7 papers
LookStep: Efficient Vision-Language Navigation with Linguistic Foresight and Event Driven Memory
Kun-Yang Yu, Yingzhe Li, Hongyu Xu +8
Vision-Language Navigation (VLN) requires an embodied agent to follow natural-language instructions in unseen environments. Recent progress has been largely driven by Multimodal La…
SymboLLM-FE: LLM-Accelerated Symbolic Regression for Automated Feature Engineering on Tabular Data
Zi-Jian Cheng, Zi-Yi Jia, Zhi Zhou +2
Tabular data, as a core data format in machine learning, often lacks the discriminative power needed for high-performance modeling due to insufficient feature informativeness. Auto…
Self-Evolving Neuro-Symbolic Skills for Tool-Augmented Spatial Reasoning
Shi-Yu Tian, Zhuo-Xia Wang, Xuan-Yi Zhu +6
Large vision-language models have achieved strong performance in multimodal reasoning, but they remain unreliable on fine-grained spatial tasks that demand both precise spatial per…
On the Learnability of Test-Time Adaptation: A Recovery Complexity Perspective
Zhi Zhou, Ming Yang, Shi-Yu Tian +3
Test-time adaptation (TTA) aims to adapt models to maintain reliable performance on non-stationary test streams without requiring labeled data. Despite its empirical success, the l…
VT-Bench: A Unified Benchmark for Visual-Tabular Multi-Modal Learning
Zi-Yi Jia, Zi-Jian Cheng, Xin-Yue Zhang +4
Multi-model learning has attracted great attention in visual-text tasks. However, visual-tabular data, which plays a pivotal role in high-stakes domains like healthcare and industr…
NeSy-Route: A Neuro-Symbolic Benchmark for Constrained Route Planning in Remote Sensing
Ming Yang, Zhi Zhou, Shi-Yu Tian +3
Remote sensing underpins crucial applications such as disaster relief and ecological field surveys, where systems must understand complex scenes and constraints and make reliable d…
Shift-Aware Calibration for Fine-Tuned CLIP: Leveraging Image-Text Alignment
Song-Lin Lv, Yu-Yang Chen, Zhi Zhou +1
Vision-language models (VLMs), such as CLIP, adapt effectively to downstream tasks through prompt tuning, but fine-tuning can misalign predictive confidence and accuracy, particula…