8 papers
ProcAgent: An Agentic Framework for Procedural Task Guidance on Edge with Human-in-the-Loop
Azizul Zahid, Subrata Biswas, Bashima Islam +1
Procedural tasks such as furniture assembly and home repair impose substantial cognitive demands because users must interpret instructions, track task progress, reason about spatia…
OWL: Geometry-Aware Spatial Reasoning for Audio Large Language Models
Subrata Biswas, Mohammad Nur Hossain Khan, Bashima Islam
Spatial reasoning is fundamental to auditory perception, yet current audio large language models (ALLMs) largely rely on unstructured binaural cues and single step inference. This…
LLaSA: A Sensor-Aware LLM for Natural Language Reasoning of Human Activity from IMU Data
Sheikh Asif Imran, Mohammad Nur Hossain Khan, Subrata Biswas +1
Wearable systems can recognize activities from IMU data but often fail to explain their underlying causes or contextual significance. To address this limitation, we introduce two l…
RAVEN: Query-Guided Representation Alignment for Question Answering over Audio, Video, Embedded Sensors, and Natural Language
Subrata Biswas, Mohammad Nur Hossain Khan, Bashima Islam
Multimodal question answering (QA) often requires identifying which video, audio, or sensor tokens are relevant to the question. Yet modality disagreements are common: off-camera s…
LOCUS: LOcalization with Channel Uncertainty and Sporadic Energy
Subrata Biswas, Mohammad Nur Hossain Khan, Violet Colwell +2
Accurate sound source localization (SSL), such as direction-of-arrival (DoA) estimation, relies on consistent multichannel data. However, batteryless systems often suffer from miss…
UnIT: Scalable Unstructured Inference-Time Pruning for MAC-efficient Neural Inference on MCUs
Ashe Neth, Sawinder kaur, Mohammad Nur Hossain Khan +3
Existing pruning methods are typically applied during training or compile time and often rely on structured sparsity. While compatible with low-power microcontrollers (MCUs), struc…