Publications (47)
ODYSSEY: Open-World Quadrupeds Exploration and Manipulation for Long-Horizon Tasks
Kaijun Wang, Liqin Lu, Mingyu Liu +7
Language-guided long-horizon mobile manipulation has long been a grand challenge in embodied semantic reasoning, generalizable manipulation, and adaptive locomotion. Three fundamen…
Retrieval-Enhanced Visual Prompt Learning for Few-shot Classification
Jintao Rong, Hao Chen, Linlin Ou +3
The Contrastive Language-Image Pretraining (CLIP) model has been widely used in various downstream vision tasks. The few-shot learning paradigm has been widely adopted to augment i…
Multi-stream Cell Segmentation with Low-level Cues for Multi-modality Images
Wei Lou, Xinyi Yu, Chenyu Liu +4
Cell segmentation for multi-modal microscopy images remains a challenge due to the complex textures, patterns, and cell shapes in these images. To tackle the problem, we first deve…
ShiftNAS: Improving One-shot NAS via Probability Shift
Mingyang Zhang, Xinyi Yu, Haodong Zhao +1
One-shot Neural architecture search (One-shot NAS) has been proposed as a time-efficient approach to obtain optimal subnet architectures and weights under different complexity case…
Efficient Re-parameterization Operations Search for Easy-to-Deploy Network Based on Directional Evolutionary Strategy
Xinyi Yu, Xiaowei Wang, Jintao Rong +2
Structural re-parameterization (Rep) methods has achieved significant performance improvement on traditional convolutional network. Most current Rep methods rely on prior knowledge…
Pedestrian Attribute Recognition in Video Surveillance Scenarios Based on View-attribute Attention Localization
Weichen Chen, Xinyi Yu, Linlin Ou
Pedestrian attribute recognition in surveillance scenarios is still a challenging task due to the inaccurate localization of specific attributes. In this paper, we propose a novel…
Model Predictive Control for Signal Temporal Logic Specifications with Time Interval Decomposition
Xinyi Yu, Chuwei Wang, Dingran Yuan +2
In this paper, we investigate the problem of Model Predictive Control (MPC) of dynamic systems for high-level specifications described by Signal Temporal Logic (STL) formulae. Rece…
Conformal Predictive Programming for Chance Constrained Optimization
Yiqi Zhao, Xinyi Yu, Matteo Sesia +2
We propose conformal predictive programming (CPP), a framework to solve chance constrained optimization problems, i.e., optimization problems with constraints that are functions of…
Boxer: Interactive Comparison of Classifier Results
Michael Gleicher, Aditya Barve, Xinyi Yu +1
Machine learning practitioners often compare the results of different classifiers to help select, diagnose and tune models. We present Boxer, a system to enable such comparison. Ou…
Beyond Monologue: Interactive Talking-Listening Avatar Generation with Conversational Audio Context-Aware Kernels
Yuzhe Weng, Haotian Wang, Xinyi Yu +4
Audio-driven human video generation has achieved remarkable success in monologue scenarios, largely driven by advancements in powerful video generation foundation models. Moving be…
A Self-adaptive SAC-PID Control Approach based on Reinforcement Learning for Mobile Robots
Xinyi Yu, Yuehai Fan, Siyu Xu +1
Proportional-integral-derivative (PID) control is the most widely used in industrial control, robot control and other fields. However, traditional PID control is not competent when…
Safe-by-Construction Autonomous Vehicle Overtaking using Control Barrier Functions and Model Predictive Control
Dingran Yuan, Xinyi Yu, Shaoyuan Li +1
Ensuring safety for vehicle overtaking systems is one of the most fundamental and challenging tasks in autonomous driving. This task is particularly intricate when the vehicle must…
CrossFusion: Interleaving Cross-modal Complementation for Noise-resistant 3D Object Detection
Yang Yang, Weijie Ma, Hao Chen +2
The combination of LiDAR and camera modalities is proven to be necessary and typical for 3D object detection according to recent studies. Existing fusion strategies tend to overly…
Conditional Generative Data-free Knowledge Distillation
Xinyi Yu, Ling Yan, Yang Yang +2
Knowledge distillation has made remarkable achievements in model compression. However, most existing methods require the original training data, which is usually unavailable due to…
Graph Pruning for Model Compression
Mingyang Zhang, Xinyi Yu, Jingtao Rong +1
Previous AutoML pruning works utilized individual layer features to automatically prune filters. We analyze the correlation for two layers from the different blocks which have a sh…
Formal Verification and Control with Conformal Prediction
Lars Lindemann, Yiqi Zhao, Xinyi Yu +2
We present recent advances in formal verification and control for autonomous systems with practical safety guarantees enabled by conformal prediction (CP), a statistical tool for u…
UP-SLAM: Adaptively Structured Gaussian SLAM with Uncertainty Prediction in Dynamic Environments
Wancai Zheng, Linlin Ou, Jiajie He +3
Recent 3D Gaussian Splatting (3DGS) techniques for Visual Simultaneous Localization and Mapping (SLAM) have significantly progressed in tracking and high-fidelity mapping. However,…
Oriented Object Detection in Aerial Images Based on Area Ratio of Parallelogram
Xinyi Yu, Mi Lin, Jiangping Lu +1
Oriented object detection is a challenging task in aerial images since the objects in aerial images are displayed in arbitrary directions and are frequently densely packed. The mai…
Diffusion-based Data Augmentation for Nuclei Image Segmentation
Xinyi Yu, Guanbin Li, Wei Lou +4
Nuclei segmentation is a fundamental but challenging task in the quantitative analysis of histopathology images. Although fully-supervised deep learning-based methods have made sig…
Improving Neural Indoor Surface Reconstruction with Mask-Guided Adaptive Consistency Constraints
Xinyi Yu, Liqin Lu, Jintao Rong +2
3D scene reconstruction from 2D images has been a long-standing task. Instead of estimating per-frame depth maps and fusing them in 3D, recent research leverages the neural implici…
Progressive Neural Index Search for Database System
Sai Wu, Xinyi Yu, Xiaojie Feng +3
As a key ingredient of the DBMS, index plays an important role in the query optimization and processing. However, it is a non-trivial task to apply existing indexes or design new i…
Implicit Identity Technologies for LLMs: Fingerprinting and Watermarking across Datasets, Models, and Generated Content
Bing Liu, Shunping Wang, Yufan Zhu +5
This paper presents a survey and taxonomy of LLM fingerprinting and watermarking for identity, ownership verification, provenance, and generated-content attribution. Large language…
A Stackelberg Game Approach for Signal Temporal Logic Control Synthesis with Uncontrollable Agents
Bohan Cui, Xinyi Yu, Alessandro Giua +1
In this paper, we investigate the control synthesis problem for Signal Temporal Logic (STL) specifications in the presence of uncontrollable agents. Existing works mainly address t…
When Distillation Breaks Motion Control: Restoring Generative Trajectories for Fast Video Generators
Jintao Rong, Xin Xie, Xinyi Yu +4
Training-free motion customization imposes motion patterns from reference videos onto video generators through test-time computation. Most existing methods target full diffusion mo…
Model Predictive Monitoring of Dynamical Systems for Signal Temporal Logic Specifications
Xinyi Yu, Weijie Dong, Xiang Yin +1
Online monitoring aims to evaluate or to predict, at runtime, whether or not the behaviors of a system satisfy some desired specification. It plays a key role in safety-critical cy…
STL-GO: Spatio-Temporal Logic with Graph Operators for Distributed Systems with Multiple Network Topologies
Yiqi Zhao, Xinyi Yu, Bardh Hoxha +3
Multi-agent systems (MASs) consisting of a number of autonomous agents that communicate, coordinate, and jointly sense the environment to achieve complex missions can be found in a…
Explicit Solution of Tunable Input-to-State Safe-Based Controller Under High-Relative-Degree Constraints
Yan Wei, Yu Feng, Linlin Ou +2
This paper investigates the safety analysis and verification of nonlinear systems subject to high-relative-degree constraints and unknown disturbance. The closed-form solution of t…
MKIoU Loss: Towards Accurate Oriented Object Detection in Aerial Images
Xinyi Yu, Jiangping Lu, Mi Lin +1
Oriented bounding box regression is crucial for oriented object detection. However, regression-based methods often suffer from boundary problems and the inconsistency between loss…
Task and Motion Planning of Dynamic Systems using Hyperproperties for Signal Temporal Logics
Jianing Zhao, Bowen Ye, Xinyi Yu +2
We investigate the task and motion planning problem for dynamical systems under signal temporal logic (STL) specifications. Existing works on STL control synthesis mainly focus on…
Efficient STL Control Synthesis under Asynchronous Temporal Robustness Constraints
Xinyi Yu, Xiang Yin, Lars Lindemann
In time-critical systems, such as air traffic control systems, it is crucial to design control policies that are robust to timing uncertainty. Recently, the notion of Asynchronous…
Sleep When Everything Looks Fine: Self-Triggered Monitoring for Signal Temporal Logic Tasks
Chuwei Wang, Xinyi Yu, Jianing Zhao +2
Online monitoring is a widely used technique in assessing if the performance of the system satisfies some desired requirements during run-time operation. Existing works on online m…
Online Monitoring of Dynamic Systems for Signal Temporal Logic Specifications with Model Information
Xinyi Yu, Weijie Dong, Xiang Yin +1
Online monitoring aims to evaluate or to predict, at runtime, whether or not the behaviors of a system satisfy some desired specification. It plays a key role in safety-critical cy…
Real-time Rail Recognition Based on 3D Point Clouds
Xinyi Yu, Weiqi He, Xuecheng Qian +2
Accurate rail location is a crucial part in the railway support driving system for safety monitoring. LiDAR can obtain point clouds that carry 3D information for the railway enviro…
Multi-subgoal Robot Navigation in Crowds with History Information and Interactions
Xinyi Yu, Jianan Hu, Yuehai Fan +2
Robot navigation in dynamic environments shared with humans is an important but challenging task, which suffers from performance deterioration as the crowd grows. In this paper, mu…
Across-Task Neural Architecture Search via Meta Learning
Jingtao Rong, Xinyi Yu, Mingyang Zhang +1
Adequate labeled data and expensive compute resources are the prerequisites for the success of neural architecture search(NAS). It is challenging to apply NAS in meta-learning scen…
3DGSNav: Enhancing Vision-Language Model Reasoning for Object Navigation via Active 3D Gaussian Splatting
Wancai Zheng, Hao Chen, Xianlong Lu +2
Object navigation is a core capability of embodied intelligence, enabling an agent to locate target objects in unknown environments. Recent advances in vision-language models (VLMs…
DWBench: Holistic Evaluation of Watermark for Dataset Copyright Auditing
Xiao Ren, Xinyi Yu, Linkang Du +5
The surging demand for large-scale datasets in deep learning has heightened the need for effective copyright protection, given the risks of unauthorized use to data owners. Althoug…
RepNAS: Searching for Efficient Re-parameterizing Blocks
Mingyang Zhang, Xinyi Yu, Jingtao Rong +1
In the past years, significant improvements in the field of neural architecture search(NAS) have been made. However, it is still challenging to search for efficient networks due to…
Effective Model Compression via Stage-wise Pruning
Mingyang Zhang, Xinyi Yu, Jingtao Rong +1
Automated Machine Learning(Auto-ML) pruning methods aim at searching a pruning strategy automatically to reduce the computational complexity of deep Convolutional Neural Networks(d…
GSORB-SLAM: Gaussian Splatting SLAM benefits from ORB features and Transmittance information
Wancai Zheng, Xinyi Yu, Jintao Rong +3
The emergence of 3D Gaussian Splatting (3DGS) has recently ignited a renewed wave of research in dense visual SLAM. However, existing approaches encounter challenges, including sen…
SAR-NAS: Lightweight SAR Object Detection with Neural Architecture Search
Xinyi Yu, Zhiwei Lin, Yongtao Wang
Synthetic Aperture Radar (SAR) object detection faces significant challenges from speckle noise, small target ambiguities, and on-board computational constraints. While existing ap…
LoRAPrune: Structured Pruning Meets Low-Rank Parameter-Efficient Fine-Tuning
Mingyang Zhang, Hao Chen, Chunhua Shen +4
Large Language Models (LLMs), such as LLaMA and T5, have shown exceptional performance across various tasks through fine-tuning. Although low-rank adaption (LoRA) has emerged to ch…
Channel Merging: Preserving Specialization for Merged Experts
Mingyang Zhang, Jing Liu, Ganggui Ding +3
Lately, the practice of utilizing task-specific fine-tuning has been implemented to improve the performance of large language models (LLM) in subsequent tasks. Through the integrat…
Trinary Tools for Continuously Valued Binary Classifiers
Michael Gleicher, Xinyi Yu, Yuheng Chen
Classification methods for binary (yes/no) tasks often produce a continuously valued score. Machine learning practitioners must perform model selection, calibration, discretization…
Boosting Box-supervised Instance Segmentation with Pseudo Depth
Xinyi Yu, Ling Yan, Pengtao Jiang +4
The realm of Weakly Supervised Instance Segmentation (WSIS) under box supervision has garnered substantial attention, showcasing remarkable advancements in recent years. However, t…
A Self-adaptive LSAC-PID Approach based on Lyapunov Reward Shaping for Mobile Robots
Xinyi Yu, Siyu Xu, Yuehai Fan +1
To solve the coupling problem of control loops and the adaptive parameter tuning problem in the multi-input multi-output (MIMO) PID control system, a self-adaptive LSAC-PID algorit…
Signal Temporal Logic Control Synthesis among Uncontrollable Dynamic Agents with Conformal Prediction
Xinyi Yu, Yiqi Zhao, Xiang Yin +1
The control of dynamical systems under temporal logic specifications among uncontrollable dynamic agents is challenging due to the agents' a-priori unknown behavior. Existing works…