1 citations · 1 across the 6 of their papers we have counts for
7 papers
ProMemAgent: Long-Horizon Proactive Assistance with Context-Aware Prospective Memory from Sensory Perceptions
Lilin Xu, Linyang He, Kaiyuan Hou +4
Large language model (LLM) agents are moving beyond reactive responses toward proactive assistance that anticipates user needs without explicit requests. However, existing proactiv…
ProAssist: Continuous Step-aware Proactive Assistance with Multi-modal Egocentric Perception for Long-horizon Procedural Tasks
Lilin Xu, Bufang Yang, Siyang Jiang +6
Procedural tasks with multiple ordered steps are ubiquitous in daily life. Recent advances in multimodal large language models (MLLMs) have enabled personal assistants that support…
Exploring the Capabilities of LLMs for IMU-based Fine-grained Human Activity Understanding
Lilin Xu, Kaiyuan Hou, Xiaofan Jiang
Human activity recognition (HAR) using inertial measurement units (IMUs) increasingly leverages large language models (LLMs), yet existing approaches focus on coarse activities lik…
TDBench: A Benchmark for Top-Down Image Understanding with Reliability Analysis of Vision-Language Models
Kaiyuan Hou, Minghui Zhao, Lilin Xu +2
Top-down images play an important role in safety-critical settings such as autonomous navigation and aerial surveillance, where they provide holistic spatial information that front…
Visualizing the Invisible: A Generative AR System for Intuitive Multi-Modal Sensor Data Presentation
Yunqi Guo, Kaiyuan Hou, Heming Fu +4
Understanding sensor data can be difficult for non-experts because of the complexity and different semantic meanings of sensor modalities. This leads to a need for intuitive and ef…
AIRA: A Low-cost IR-based Approach Towards Autonomous Precision Drone Landing and NLOS Indoor Navigation
Yanchen Liu, Minghui Zhao, Kaiyuan Hou +5
Automatic drone landing is an important step for achieving fully autonomous drones. Although there are many works that leverage GPS, video, wireless signals, and active acoustic se…
FlexiFly: Interfacing the Physical World with Foundation Models Empowered by Reconfigurable Drone Systems
Minghui Zhao, Junxi Xia, Kaiyuan Hou +3
Foundation models (FM) have shown immense human-like capabilities for generating digital media. However, foundation models that can freely sense, interact, and actuate the physical…