4 papers
VEGA: Learning Navigation VLAs from In-the-Wild Egocentric Video with Geometric Trajectory Supervision
Gershom Seneviratne, Yohan Abeysinghe, Jianyu An +3
We introduce VEGA, an approach for training navigation VisionLanguage-Action (VLA) models from unlabeled egocentric navigation videos. Internet-scale egocentric videos provide a sc…
VFace: A Training-Free Approach for Diffusion-Based Video Face Swapping
Sanoojan Baliah, Yohan Abeysinghe, Rusiru Thushara +4
We present a training-free, plug-and-play method, namely VFace, for high-quality face swapping in videos. It can be seamlessly integrated with image-based face swapping approaches…
Synergistic Neural Forecasting of Air Pollution with Stochastic Sampling
Yohan Abeysinghe, Muhammad Akhtar Munir, Sanoojan Baliah +4
Air pollution remains a leading global health and environmental risk, particularly in regions vulnerable to episodic air pollution spikes due to wildfires, urban haze and dust stor…
MAGNET: A Multi-agent Framework for Finding Audio-Visual Needles by Reasoning over Multi-Video Haystacks
Sanjoy Chowdhury, Mohamed Elmoghany, Yohan Abeysinghe +5
Large multimodal models (LMMs) have shown remarkable progress in audio-visual understanding, yet they struggle with real-world scenarios that require complex reasoning across exten…