291 citations · 788 across the 42 of their papers we have counts for
10 papers · 1 filter
Diagnosing Shoulder Disorders Using Multimodal Large Language Models and Consumer-Grade Cameras
Jindong Hong, Wencheng Zhang, Shiqin Qiao +15
Shoulder disorders, such as frozen shoulder (a.k.a., adhesive capsulitis), are common conditions affecting the health of people worldwide, and have a high incidence rate among the…
FAST-Splat: Fast, Ambiguity-Free Semantics Transfer in Gaussian Splatting
Ola Shorinwa, Jiankai Sun, Mac Schwager
We present FAST-Splat for fast, ambiguity-free semantic Gaussian Splatting, which seeks to address the main limitations of existing semantic Gaussian Splatting methods, namely: slo…
Aria-NeRF: Multimodal Egocentric View Synthesis
Jiankai Sun, Jianing Qiu, Chuanyang Zheng +3
We seek to accelerate research in developing rich, multimodal scene models trained from egocentric data, based on differentiable volumetric ray-tracing inspired by Neural Radiance…
NeRF-Loc: Transformer-Based Object Localization Within Neural Radiance Fields
Jiankai Sun, Yan Xu, Mingyu Ding +5
Neural Radiance Fields (NeRFs) have become a widely-applied scene representation technique in recent years, showing advantages for robot navigation and manipulation tasks. To furth…
LocATe: End-to-end Localization of Actions in 3D with Transformers
Jiankai Sun, Bolei Zhou, Michael J. Black +1
Understanding a person's behavior from their 3D motion is a fundamental problem in computer vision with many applications. An important component of this problem is 3D Temporal Act…
Egocentric Human Trajectory Forecasting with a Wearable Camera and Multi-Modal Fusion
Jianing Qiu, Lipeng Chen, Xiao Gu +5
In this paper, we address the problem of forecasting the trajectory of an egocentric camera wearer (ego-person) in crowded spaces. The trajectory forecasting ability learned from t…
SegVoxelNet: Exploring Semantic Context and Depth-aware Features for 3D Vehicle Detection from Point Cloud
Hongwei Yi, Shaoshuai Shi, Mingyu Ding +6
3D vehicle detection based on point cloud is a challenging task in real-world applications such as autonomous driving. Despite significant progress has been made, we observe two as…
GDRQ: Group-based Distribution Reshaping for Quantization
Haibao Yu, Tuopu Wen, Guangliang Cheng +3
Low-bit quantization is challenging to maintain high performance with limited model capacity (e.g., 4-bit for both weights and activations). Naturally, the distribution of both wei…
Cross-view Semantic Segmentation for Sensing Surroundings
Bowen Pan, Jiankai Sun, Ho Yin Tiga Leung +2
Sensing surroundings plays a crucial role in human spatial perception, as it extracts the spatial configuration of objects as well as the free space from the observations. To facil…
NavigationNet: A Large-scale Interactive Indoor Navigation Dataset
He Huang, Yujing Shen, Jiankai Sun +1
Indoor navigation aims at performing navigation within buildings. In scenes like home and factory, most intelligent mobile devices require an functionality of routing to guide itse…