6 papers
Contrastive Heliophysical Image Pretraining for Solar Dynamics Observatory Records
Shiyu Shen, Zhe Gao, Taifeng Chai +2
Deep learning has revolutionized solar image analysis, yet most approaches train task-specific encoders from scratch or rely on natural-image pretraining that ignores the unique ch…
VideoTIR: Accurate Understanding for Long Videos with Efficient Tool-Integrated Reasoning
Zhe Gao, Shiyu Shen, Taifeng Chai +7
Existing Multimodal Large Language Models (MLLMs) often suffer from hallucinations in long video understanding (LVU), primarily due to the imbalance between textual and visual toke…
Preserving Domain Generalization in Fine-Tuning via Joint Parameter Selection
Bin Pan, Shiyu Shen, Zongbin Wang +2
Domain generalization seeks to develop models trained on a limited set of source domains that are capable of generalizing effectively to unseen target domains. While the predominan…
Hyperspectral Image Generation with Unmixing Guided Diffusion Model
Shiyu Shen, Bin Pan, Ziye Zhang +1
We address hyperspectral image (HSI) synthesis, a problem that has garnered growing interest yet remains constrained by the conditional generative paradigms that limit sample diver…
A Pretrained Probabilistic Transformer for City-Scale Traffic Volume Prediction
Shiyu Shen, Bin Pan, Guirong Xue
City-scale traffic volume prediction plays a pivotal role in intelligent transportation systems, yet remains a challenge due to the inherent incompleteness and bias in observationa…
Self-control: A Better Conditional Mechanism for Masked Autoregressive Model
Qiaoying Qu, Shiyu Shen
Autoregressive conditional image generation algorithms are capable of generating photorealistic images that are consistent with given textual or image conditions, and have great po…