5 papers
Robot Collapse: Supply Chain Backdoor Attacks Against VLM-based Robotic Manipulation
Xianlong Wang, Hewen Pan, Hangtao Zhang +8
Robotic manipulation policies are increasingly empowered by \textit{large language models} (LLMs) and \textit{vision-language models} (VLMs), leveraging their understanding and per…
UFVideo: Towards Unified Fine-Grained Video Cooperative Understanding with Large Language Models
Hewen Pan, Cong Wei, Dashuang Liang +8
With the advancement of multi-modal Large Language Models (LLMs), Video LLMs have been further developed to perform on holistic and specialized video understanding. However, existi…
ADVEDM:Fine-grained Adversarial Attack against VLM-based Embodied Agents
Yichen Wang, Hangtao Zhang, Hewen Pan +7
Vision-Language Models (VLMs), with their strong reasoning and planning capabilities, are widely used in embodied decision-making (EDM) tasks in embodied agents, such as autonomous…
Uncertainty-Aware Metabolic Stability Prediction with Dual-View Contrastive Learning
Peijin Guo, Minghui Li, Hewen Pan +6
Accurate prediction of molecular metabolic stability (MS) is critical for drug research and development but remains challenging due to the complex interplay of molecular interactio…
Multi-Modality Representation Learning for Antibody-Antigen Interactions Prediction
Peijin Guo, Minghui Li, Hewen Pan +6
While deep learning models play a crucial role in predicting antibody-antigen interactions (AAI), the scarcity of publicly available sequence-structure pairings constrains their ge…