Publications (75)
Taxi Dispatch with Real-Time Sensing Data in Metropolitan Areas: A Receding Horizon Control Approach
Fei Miao, Shuo Han, Shan Lin +6
Traditional taxi systems in metropolitan areas often suffer from inefficiencies due to uncoordinated actions as system capacity and customer demand change. With the pervasive deplo…
An STL-based Formulation of Resilience in Cyber-Physical Systems
Hongkai Chen, Shan Lin, Scott A. Smolka +1
Resiliency is the ability to quickly recover from a violation and avoid future violations for as long as possible. Such a property is of fundamental importance for Cyber-Physical S…
Efficient Data-driven Joint-level Calibration of Cable-driven Surgical Robots
Haonan Peng, Andrew Lewis, Yun-Hsuan Su +5
Knowing accurate joint positions is crucial for safe and precise control of laparoscopic surgical robots, especially for the automation of surgical sub-tasks. These robots have oft…
Data-Driven Robust Control for Type 1 Diabetes Under Meal and Exercise Uncertainties
Nicola Paoletti, Kin Sum Liu, Scott A. Smolka +1
We present a fully closed-loop design for an artificial pancreas (AP) which regulates the delivery of insulin for the control of Type I diabetes. Our AP controller operates in a fu…
Application of advanced ultrasonic testing methods to Dissimilar Metal Welds -- Comparison of simulated and experimental results
Audrey Gardahaut, Hugues Lourme, Steve Mahaut +2
Widely present in the primary circuit of Nuclear Power Plants (NPP), Dissimilar Metal Welds (DMW) are inspected using Ultrasonic nondestructive Testing (UT) techniques to ensure th…
Resource Allocation Optimization for Users with Different Levels of Service in Multicarrier Systems
Mirza Golam Kibria, Shan Lin
We optimize the throughput of a single cell multiuser orthogonal frequency division multiplexing system with proportional data rate fairness among the users. The concept is to supp…
Exchange coupling in synthetic anion-engineered chromia heterostructures
Shan Lin, Zhiwen Wang, Qinghua Zhang +15
Control of magnetic states by external factors has garnered a mainstream status in spintronic research for designing low power consumption and fast-response information storage and…
Constraints on the Combined Models with Inflation and Viable Dark Energy
Chao-Qiang Geng, Chung-Chi Lee, Shan Lin
We investigate the observational constraints on the modified gravity, which combines the inflation with the power-law (exponential) type of the viable dark energy…
Room-temperature ferromagnetism at an oxide/nitride interface
Qiao Jin, Zhiwen Wang, Qinghua Zhang +26
Heterointerfaces have led to the discovery of novel electronic and magnetic states because of their strongly entangled electronic degrees of freedom. Single-phase chromium compound…
Generalization Bounds for Convolutional Neural Networks
Shan Lin, Jingwei Zhang
Convolutional neural networks (CNNs) have achieved breakthrough performances in a wide range of applications including image classification, semantic segmentation, and object detec…
Data-Driven Robust Taxi Dispatch under Demand Uncertainties
Fei Miao, Shuo Han, Shan Lin +6
In modern taxi networks, large amounts of taxi occupancy status and location data are collected from networked in-vehicle sensors in real-time. They provide knowledge of system mod…
LAVIFT: Latent-Action-Guided Vision Fine-Tuning for Surgical Interaction Recognition
Jiajun Cheng, Subarna Tripathi, Sainan Liu +2
Understanding instrument-tissue interactions is essential for context-aware surgical AI and autonomous robotic surgery. Pretrained vision-language models (VLMs) and vision encoders…
Anisotropic electronic phase transition in CrN epitaxial thin films
Qiao Jin, Jiali Zhao, Manuel Roldan +12
Electronic phase transition in strongly correlated materials is extremely sensitive to the dimensionality and crystallographic orientations. Transition metal nitrides (TMNs) are se…
TrajPred: Trajectory-Conditioned Joint Embedding Prediction for Surgical Instrument-Tissue Interaction Recognition in Vision-Language Models
Jiajun Cheng, Xiaofan Yu, Subarna Tripathi +2
Recognizing instruments' interactions with tissues is essential for building context-aware AI assistants in robotic surgery. Vision-language models (VLMs) have opened a new avenue…
PalpAid: Multimodal Pneumatic Tactile Sensor for Tissue Palpation
Devi Yuliarti, Ravi Prakash, Hiu Ching Cheung +3
The tactile properties of tissue, such as elasticity and stiffness, often play an important role in surgical oncology when identifying tumors and pathological tissue boundaries. Th…
An STL-based Approach to Resilient Control for Cyber-Physical Systems
Hongkai Chen, Scott A. Smolka, Nicola Paoletti +1
We present ResilienC, a framework for resilient control of Cyber-Physical Systems subject to STL-based requirements. ResilienC utilizes a recently developed formalism for specifyin…
Multi-Agent Reinforcement Learning for Decentralized Reservoir Management via Murmuration Intelligence
Heming Fu, Guojun Xiong, Jian Li +1
Conventional centralized water management systems face critical limitations from computational complexity and uncertainty propagation. We present MurmuRL, a novel decentralized fra…
Synthesis of functional nitride membranes using sacrificial water-soluble BaO layers
Shengru Chen, Qiao Jin, Shan Lin +8
Transition metal nitrides (TMNs) exhibit fascinating physical properties that hold great potential in future device applications. To stack two-dimensional TMNs with other functiona…
Asymmetric Ground States in LaSrMnO/BaTiO heterostructures Induced by Flexoelectric Bending
Mingqun Qi, Zhen Yang, Shengru Chen +9
Misfit strain delivered from single-crystal substrates typically modifies the ground states of transition metal oxides, generating increasing interests in designing modern transduc…
ORRN: An ODE-based Recursive Registration Network for Deformable Respiratory Motion Estimation with Lung 4DCT Images
Xiao Liang, Shan Lin, Fei Liu +2
Deformable Image Registration (DIR) plays a significant role in quantifying deformation in medical data. Recent Deep Learning methods have shown promising accuracy and speedup for…
BAA-NGP: Bundle-Adjusting Accelerated Neural Graphics Primitives
Sainan Liu, Shan Lin, Jingpei Lu +2
Implicit neural representations have become pivotal in robotic perception, enabling robots to comprehend 3D environments from 2D images. Given a set of camera poses and associated…
LC-GAN: Image-to-image Translation Based on Generative Adversarial Network for Endoscopic Images
Shan Lin, Fangbo Qin, Yangming Li +3
Intelligent vision is appealing in computer-assisted and robotic surgeries. Vision-based analysis with deep learning usually requires large labeled datasets, but manual data labeli…
MPC-guided Imitation Learning of Neural Network Policies for the Artificial Pancreas
Hongkai Chen, Nicola Paoletti, Scott A. Smolka +1
Even though model predictive control (MPC) is currently the main algorithm for insulin control in the artificial pancreas (AP), it usually requires complex online optimizations, wh…
AnyOKP: One-Shot and Instance-Aware Object Keypoint Extraction with Pretrained ViT
Fangbo Qin, Taogang Hou, Shan Lin +3
Towards flexible object-centric visual perception, we propose a one-shot instance-aware object keypoint (OKP) extraction approach, AnyOKP, which leverages the powerful representati…
SensEmo: Enabling Affective Learning through Real-time Emotion Recognition with Smartwatches
Kushan Choksi, Hongkai Chen, Karan Joshi +3
Recent research has demonstrated the capability of physiological signals to infer both user emotional and attention responses. This presents an opportunity for leveraging widely av…
EyeCLIP: A visual-language foundation model for multi-modal ophthalmic image analysis
Danli Shi, Weiyi Zhang, Jiancheng Yang +8
Early detection of eye diseases like glaucoma, macular degeneration, and diabetic retinopathy is crucial for preventing vision loss. While artificial intelligence (AI) foundation m…
SuPerPM: A Surgical Perception Framework Based on Deep Point Matching Learned from Physical Constrained Simulation Data
Shan Lin, Albert J. Miao, Ali Alabiad +5
A major source of endoscopic tissue tracking errors during deformations stems from wrong data association between observed sensor measurements with previously tracked scene. To mit…
Reducing Annotating Load: Active Learning with Synthetic Images in Surgical Instrument Segmentation
Haonan Peng, Shan Lin, Daniel King +4
Accurate instrument segmentation in endoscopic vision of robot-assisted surgery is challenging due to reflection on the instruments and frequent contacts with tissue. Deep neural n…
Biomedical image analysis competitions: The state of current participation practice
Matthias Eisenmann, Annika Reinke, Vivienn Weru +352
The number of international benchmarking competitions is steadily increasing in various fields of machine learning (ML) research and practice. So far, however, little is known abou…
Open X-Embodiment: Robotic Learning Datasets and RT-X Models
Embodiment Collaboration, Abby O'Neill, Abdul Rehman +291
Large, high-capacity models trained on diverse datasets have shown remarkable successes on efficiently tackling downstream applications. In domains from NLP to Computer Vision, thi…
TwinTrack: Bridging Vision and Contact Physics for Real-Time Tracking of Unknown Objects in Contact-Rich Scenes
Wen Yang, Zhixian Xie, Yiting Wang +4
Real-time tracking of previously unseen, highly dynamic objects in contact-rich scenes, such as during dexterous in-hand manipulation, remains a major challenge. Pure vision-based…
Braiding lateral morphotropic grain boundary in homogeneitic oxides
Shengru Chen, Qinghua Zhang, Dongke Rong +19
Interfaces formed by correlated oxides offer a critical avenue for discovering emergent phenomena and quantum states. However, the fabrication of oxide interfaces with variable cry…
Synthesizing Stealthy Reprogramming Attacks on Cardiac Devices
Nicola Paoletti, Zhihao Jiang, Md Ariful Islam +5
An Implantable Cardioverter Defibrillator (ICD) is a medical device used for the detection of potentially fatal cardiac arrhythmia and their treatment through the delivery of elect…
Nanoscale magnetic ordering dynamics in a high Curie temperature ferromagnet
Yueh-Chun Wu, Gábor B. Halász, Joshua T. Damron +11
Thermally driven transitions between ferromagnetic and paramagnetic phases are characterized by critical behavior with divergent susceptibilities, long-range correlations, and spin…
DROID: A Large-Scale In-The-Wild Robot Manipulation Dataset
Alexander Khazatsky, Karl Pertsch, Suraj Nair +98
The creation of large, diverse, high-quality robot manipulation datasets is an important stepping stone on the path toward more capable and robust robotic manipulation policies. Ho…
HemoSet: The First Blood Segmentation Dataset for Automation of Hemostasis Management
Albert J. Miao, Shan Lin, Jingpei Lu +5
Hemorrhaging occurs in surgeries of all types, forcing surgeons to quickly adapt to the visual interference that results from blood rapidly filling the surgical field. Introducing…
Homogeneous Feature Transfer and Heterogeneous Location Fine-tuning for Cross-City Property Appraisal Framework
Yihan Guo, Shan Lin, Xiao Ma +2
Most existing real estate appraisal methods focus on building accuracy and reliable models from a given dataset but pay little attention to the extensibility of their trained model…
MARLIN: Multi-Agent Reinforcement Learning with Murmuration Intelligence and LLM Guidance for Reservoir Management
Heming Fu, Shan Lin, Guojun Xiong
As climate change intensifies extreme weather events, water disasters pose growing threats to global communities, making adaptive reservoir management critical for protecting vulne…
Patrol Security Game: Defending Against Adversary with Freedom in Attack Timing, Location, and Duration
Hao-Tsung Yang, Ting-Kai Weng, Ting-Yu Chang +4
We explored the Patrol Security Game (PSG), a robotic patrolling problem modeled as an extensive-form Stackelberg game, where the attacker determines the timing, location, and dura…
Multi-frame Feature Aggregation for Real-time Instrument Segmentation in Endoscopic Video
Shan Lin, Fangbo Qin, Haonan Peng +3
Deep learning-based methods have achieved promising results on surgical instrument segmentation. However, the high computation cost may limit the application of deep models to time…
Emergent magnetic states and tunable exchange bias at all 3d nitride heterointerfaces
Qiao Jin, Qinghua Zhang, He Bai +14
Interfacial magnetism stimulates the discovery of giant magnetoresistance and spin-orbital coupling across the heterointerfaces, facilitating the intimate correlation between spin…
Multi-task Mid-level Feature Alignment Network for Unsupervised Cross-Dataset Person Re-Identification
Shan Lin, Haoliang Li, Chang-Tsun Li +1
Most existing person re-identification (Re-ID) approaches follow a supervised learning framework, in which a large number of labelled matching pairs are required for training. Such…
CarFi: Rider Localization Using Wi-Fi CSI
Sirajum Munir, Hongkai Chen, Shiwei Fang +3
With the rise of hailing services, people are increasingly relying on shared mobility (e.g., Uber, Lyft) drivers to pick up for transportation. However, such drivers and riders hav…
A Unified Deep Semantic Expansion Framework for Domain-Generalized Person Re-identification
Eugene P. W. Ang, Shan Lin, Alex C. Kot
Supervised Person Re-identification (Person ReID) methods have achieved excellent performance when training and testing within one camera network. However, they usually suffer from…
Adversarial Pairwise Reverse Attention for Camera Performance Imbalance in Person Re-identification: New Dataset and Metrics
Eugene P. W. Ang, Shan Lin, Rahul Ahuja +2
Existing evaluation metrics for Person Re-Identification (Person ReID) models focus on system-wide performance. However, our studies reveal weaknesses due to the uneven data distri…
Near-Room Temperature Ferromagnetic Insulating State in Highly Distorted LaCoO2.5 with CoO5 Square Pyramids
Qinghua Zhang, Ang Gao, Fanqi Meng +9
Dedicated control of oxygen vacancies is an important route to functionalizing complex oxide films. It is well-known that tensile strain significantly lowers the oxygen vacancy for…
SemHint-MD: Learning from Noisy Semantic Labels for Self-Supervised Monocular Depth Estimation
Shan Lin, Yuheng Zhi, Michael C. Yip
Without ground truth supervision, self-supervised depth estimation can be trapped in a local minimum due to the gradient-locality issue of the photometric loss. In this paper, we p…
Semantic-SuPer: A Semantic-aware Surgical Perception Framework for Endoscopic Tissue Identification, Reconstruction, and Tracking
Shan Lin, Albert J. Miao, Jingpei Lu +4
Accurate and robust tracking and reconstruction of the surgical scene is a critical enabling technology toward autonomous robotic surgery. Existing algorithms for 3D perception in…
OphIn-500K: Curating Web-Scale Visual Instructions for Scaling Ophthalmic Multimodal Large Language Models
Xuanzhao Dong, Wenhui Zhu, Xiwen Chen +13
The advancement of general medical Multimodal Large Language Models (MLLMs) has shown great potential for building conversational assistants to support clinical diagnosis. However,…
Dimensional Control of Octahedral Tilt in SrRuO3 via Infinite-layered Oxides
Shan Lin, Qinghua Zhang, Xiahan Sang +16
Manipulation of octahedral distortion at atomic length scale is an effective means to tune the physical ground states of functional oxides. Previous work demonstrates that epitaxia…
Strain-mediated high conductivity in ultrathin antiferromagnetic metallic nitrides
Qiao Jin, Hu Cheng, Zhiwen Wang +18
Strain engineering provides the ability to control the ground states and associated phase transition in the epitaxial films. However, the systematic study of intrinsic characters a…
Cumulative-Time Signal Temporal Logic
Hongkai Chen, Zeyu Zhang, Shouvik Roy +4
Signal Temporal Logic (STL) is a widely adopted specification language in cyber-physical systems for expressing critical temporal requirements, such as safety conditions and respon…
SurgXBench: Explainable Vision-Language Model Benchmark for Surgery
Jiajun Cheng, Xianwu Zhao, Sainan Liu +5
Innovations in digital intelligence are transforming robotic surgery with more informed decision-making. Real-time awareness of surgical instrument presence and actions (e.g., cutt…
BASED: Bundle-Adjusting Surgical Endoscopic Dynamic Video Reconstruction using Neural Radiance Fields
Shreya Saha, Zekai Liang, Shan Lin +3
Reconstruction of deformable scenes from endoscopic videos is important for many applications such as intraoperative navigation, surgical visual perception, and robotic surgery. It…
Color Space Learning for Cross-Color Person Re-Identification
Jiahao Nie, Shan Lin, Alex C. Kot
The primary color profile of the same identity is assumed to remain consistent in typical Person Re-identification (Person ReID) tasks. However, this assumption may be invalid in r…
Diverse Deep Feature Ensemble Learning for Omni-Domain Generalized Person Re-identification
Eugene P. W. Ang, Shan Lin, Alex C. Kot
Person Re-identification (Person ReID) has progressed to a level where single-domain supervised Person ReID performance has saturated. However, such methods experience a significan…
Automated Synthesis of Safe Digital Controllers for Sampled-Data Stochastic Nonlinear Systems
Fedor Shmarov, Sadegh Soudjani, Nicola Paoletti +4
We present a new method for the automated synthesis of digital controllers with formal safety guarantees for systems with nonlinear dynamics, noisy output measurements, and stochas…
Dynamics of anisotropic oxygen-ion migration in strained cobaltites
Qinghua Zhang, Fanqi Meng, Ang Gao +13
Orientation control of oxygen vacancy channel (OVC) is a highly desirable for tailoring oxygen diffusion as it serves fast transport channel in ion conductors, which is widespread…
Strong Ferromagnetism Achieved via Breathing Lattices in Atomically Thin Cobaltites
Sisi Li, Qinghua Zhang, Shan Lin +22
Low-dimensional quantum materials that remain strongly ferromagnetic down to mono layer thickness are highly desired for spintronic applications. Although oxide materials are impor…
Automated Synthesis of Safe and Robust PID Controllers for Stochastic Hybrid Systems
Fedor Shmarov, Nicola Paoletti, Ezio Bartocci +3
We present a new method for the automated synthesis of safe and robust Proportional-Integral-Derivative (PID) controllers for stochastic hybrid systems. Despite their widespread us…
KidMesh: Computational Mesh Reconstruction for Pediatric Congenital Hydronephrosis Using Deep Neural Networks
Haoran Sun, Zhanpeng Zhu, Anguo Zhang +7
Pediatric congenital hydronephrosis (CH) is a common urinary tract disorder, primarily caused by obstruction at the renal pelvis-ureter junction. Magnetic resonance urography (MRU)…
Multi-Domain Adversarial Feature Generalization for Person Re-Identification
Shan Lin, Chang-Tsun Li, Alex C. Kot
With the assistance of sophisticated training methods applied to single labeled datasets, the performance of fully-supervised person re-identification (Person Re-ID) has been impro…
An STREL-based Formulation of Spatial Resilience in Cyber-Physical Systems
Zeyu Zhang, Hongkai Chen, Nicola Paoletti +2
Resiliency is the ability of a system to quickly recover from a violation (recoverability) and avoid future violations for as long as possible (durability). In the spatial setting,…
CtRNet-X: Camera-to-Robot Pose Estimation in Real-world Conditions Using a Single Camera
Jingpei Lu, Zekai Liang, Tristin Xie +4
Camera-to-robot calibration is crucial for vision-based robot control and requires effort to make it accurate. Recent advancements in markerless pose estimation methods have elimin…
SHADE-AD: An LLM-Based Framework for Synthesizing Activity Data of Alzheimer's Patients
Heming Fu, Hongkai Chen, Shan Lin +1
Alzheimer's Disease (AD) has become an increasingly critical global health concern, which necessitates effective monitoring solutions in smart health applications. However, the dev…
Towards Better Surgical Instrument Segmentation in Endoscopic Vision: Multi-Angle Feature Aggregation and Contour Supervision
Fangbo Qin, Shan Lin, Yangming Li +3
Accurate and real-time surgical instrument segmentation is important in the endoscopic vision of robot-assisted surgery, and significant challenges are posed by frequent instrument…
An Ensemble Learning Approach for Exercise Detection in Type 1 Diabetes Patients
Ke Ma, Hongkai Chen, Shan Lin
Type 1 diabetes is a serious disease in which individuals are unable to regulate their blood glucose levels, leading to various medical complications. Artificial pancreas (AP) syst…
Metal-to-insulator transition in oxide semimetals by anion doping
Haitao Hong, Huimin Zhang, Shan Lin +18
Oxide semimetals exhibiting both nontrivial topological characteristics stand as exemplary parent compounds and multiple degrees of freedom, offering great promise for the realizat…
Structural Twinning-induced Insulating Phase in CrN (111) Films
Qiao Jin, Zhiwen Wang, Qinghua Zhang +15
Electronic states of a correlated material can be effectively modified by structural variations delivered from a single-crystal substrate. In this letter, we show that the CrN film…
Declarative vs Rule-based Control for Flocking Dynamics
Usama Mehmood, Nicola Paoletti, Dung Phan +6
The popularity of rule-based flocking models, such as Reynolds' classic flocking model, raises the question of whether more declarative flocking models are possible. This question…
Aligned Divergent Pathways for Omni-Domain Generalized Person Re-Identification
Eugene P. W. Ang, Shan Lin, Alex C. Kot
Person Re-identification (Person ReID) has advanced significantly in fully supervised and domain generalized Person R e ID. However, methods developed for one task domain transfer…
Atomically engineered cobaltite layers for robust ferromagnetism
Shengru Chen, Qinghua Zhang, Xujing Li +18
Emergent phenomena at heterointerfaces are directly associated with the bonding geometry of adjacent layers. Effective control of accessible parameters, such as the bond length and…
Tracking Snake-like Robots in the Wild Using Only a Single Camera
Jingpei Lu, Florian Richter, Shan Lin +1
Robot navigation within complex environments requires precise state estimation and localization to ensure robust and safe operations. For ambulating mobile robots like robot snakes…
Multi-Task Anti-Causal Learning for Reconstructing Urban Events from Residents' Reports
Liangkai Zhou, Susu Xu, Shuqi Zhong +1
Many real-world machine learning tasks are anti-causal: they require inferring latent causes from observed effects. In practice, we often face multiple related tasks where part of…
Real-to-Sim Deformable Object Manipulation: Optimizing Physics Models with Residual Mappings for Robotic Surgery
Xiao Liang, Fei Liu, Yutong Zhang +3
Accurate deformable object manipulation (DOM) is essential for achieving autonomy in robotic surgery, where soft tissues are being displaced, stretched, and dissected. Many DOM met…