Publications (23)
From Feasibility to Desirability: Plan, Learn, Adapt (PLA) Framework for Personalized On-Device Itinerary Generation
Himel Dev, Tanmoy Sen, Madhusudan Basak +1
Generating personalized trip itineraries is a complex planning task and involves a tension between hard combinatorial feasibility and soft latent desirability. Classical optimizati…
MindfulAgents: Personalizing Mindfulness Meditation via an Expert-Aligned Multi-Agent System
Mengyuan Millie Wu, Zhihan Jiang, Yuang Fan +9
Mindfulness meditation is a widely accessible and evidence-based method for supporting mental health. Despite the proliferation of mindfulness meditation apps, sustaining user enga…
Layerwise Progressive Freezing Enables STE-Free Training of Deep Binary Neural Networks
Evan Gibson Smith, Bashima Islam
We investigate progressive freezing as an alternative to straight-through estimators (STE) for training binary networks from scratch. Under controlled training conditions, we find…
Sound Tagging in Infant-centric Home Soundscapes
Mohammad Nur Hossain Khan, Jialu Li, Nancy L. McElwain +2
Certain environmental noises have been associated with negative developmental outcomes for infants and young children. Though classifying or tagging sound events in a domestic envi…
Intermittent Learning: On-Device Machine Learning on Intermittently Powered System
Seulki Lee, Bashima Islam, Yubo Luo +1
This paper introduces intermittent learning - the goal of which is to enable energy harvested computing platforms capable of executing certain classes of machine learning tasks eff…
A System for Identifying and Visualizing Influential Communities
Md Tamzeed Islam, Bashima Islam, Mohammed Eunus Ali
In this paper, we introduce the concept of influential communities in a co-author network. We term a community as the most influential if the community has the highest influence am…
QUADS: QUAntized Distillation Framework for Efficient Speech Language Understanding
Subrata Biswas, Mohammad Nur Hossain Khan, Bashima Islam
Spoken Language Understanding (SLU) systems must balance performance and efficiency, particularly in resource-constrained environments. Existing methods apply distillation and quan…
LLaSA: A Sensor-Aware LLM for Natural Language Reasoning of Human Activity from IMU Data
Sheikh Asif Imran, Mohammad Nur Hossain Khan, Subrata Biswas +1
Wearable systems can recognize activities from IMU data but often fail to explain their underlying causes or contextual significance. To address this limitation, we introduce two l…
Forearm Ultrasound based Gesture Recognition on Edge
Keshav Bimbraw, Haichong K. Zhang, Bashima Islam
Ultrasound imaging of the forearm has demonstrated significant potential for accurate hand gesture classification. Despite this progress, there has been limited focus on developing…
Classification of Infant Sleep/Wake States: Cross-Attention among Large Scale Pretrained Transformer Networks using Audio, ECG, and IMU Data
Kai Chieh Chang, Mark Hasegawa-Johnson, Nancy L. McElwain +1
Infant sleep is critical to brain and behavioral development. Prior studies on infant sleep/wake classification have been largely limited to reliance on expensive and burdensome po…
LOCUS: LOcalization with Channel Uncertainty and Sporadic Energy
Subrata Biswas, Mohammad Nur Hossain Khan, Violet Colwell +2
Accurate sound source localization (SSL), such as direction-of-arrival (DoA) estimation, relies on consistent multichannel data. However, batteryless systems often suffer from miss…
Layerwise Progressive Freezing: A Training Scaffold for Depth-Scalable Binary Networks
Evan Gibson Smith, Bashima Islam
Training binary neural networks (BNNs) from scratch is dominated by the straight-through estimator (STE), whose forward/backward mismatch produces severe accuracy degradation as ne…
Anti-Sensing: Defense against Unauthorized Radar-based Human Vital Sign Sensing with Physically Realizable Wearable Oscillators
Md Farhan Tasnim Oshim, Nigel Doering, Bashima Islam +2
Recent advancements in Ultra-Wideband (UWB) radar technology have enabled contactless, non-line-of-sight vital sign monitoring, making it a valuable tool for healthcare. However, U…
Hard Rules, Soft Preferences: Bridging Reasoning, Learning, and Optimization for Personalized Packing Checklist Generation
Himel Dev, Madhusudan Basak, Tanmoy Sen +2
Packing for air travel is recurring and error-prone: the checklist must be personal and context-aware, yet feasible under safety rules, item dependencies, and luggage limits. Exist…
Memory-efficient Energy-adaptive Inference of Pre-Trained Models on Batteryless Embedded Systems
Pietro Farina, Subrata Biswas, Eren Yıldız +4
Batteryless systems frequently face power failures, requiring extra runtime buffers to maintain inference progress and leaving only a memory space for storing ultra-tiny deep neura…
RAVEN: Query-Guided Representation Alignment for Question Answering over Audio, Video, Embedded Sensors, and Natural Language
Subrata Biswas, Mohammad Nur Hossain Khan, Bashima Islam
Multimodal question answering (QA) often requires identifying which video, audio, or sensor tokens are relevant to the question. Yet modality disagreements are common: off-camera s…
Missingness-resilient Video-enhanced Multimodal Disfluency Detection
Payal Mohapatra, Shamika Likhite, Subrata Biswas +2
Most existing speech disfluency detection techniques only rely upon acoustic data. In this work, we present a practical multimodal disfluency detection approach that leverages avai…
ProcAgent: An Agentic Framework for Procedural Task Guidance on Edge with Human-in-the-Loop
Azizul Zahid, Subrata Biswas, Bashima Islam +1
Procedural tasks such as furniture assembly and home repair impose substantial cognitive demands because users must interpret instructions, track task progress, reason about spatia…
OWL: Geometry-Aware Spatial Reasoning for Audio Large Language Models
Subrata Biswas, Mohammad Nur Hossain Khan, Bashima Islam
Spatial reasoning is fundamental to auditory perception, yet current audio large language models (ALLMs) largely rely on unstructured binaural cues and single step inference. This…
Zygarde: Time-Sensitive On-Device Deep Inference and Adaptation on Intermittently-Powered Systems
Bashima Islam, Shahriar Nirjon
We propose Zygarde -- which is an energy -- and accuracy-aware soft real-time task scheduling framework for batteryless systems that flexibly execute deep learning tasks1 that are…
Amalgamated Intermittent Computing Systems
Bashima Islam, Yubo Luo, Shahriar Nirjon
Intermittent computing systems undergo frequent power failure, hindering necessary data sample capture or timely on-device computation. These missing samples and deadlines limit th…
UnIT: Scalable Unstructured Inference-Time Pruning for MAC-efficient Neural Inference on MCUs
Ashe Neth, Sawinder kaur, Mohammad Nur Hossain Khan +3
Existing pruning methods are typically applied during training or compile time and often rely on structured sparsity. While compatible with low-power microcontrollers (MCUs), struc…
Robust Multi-Tier Infant-Centered Audio Understanding with Whisper via Structured Speaker Conditioning
Xulin Fan, Jialu Li, Mohammad Nur Hossain Khan +4
Recent advances in model design and self-supervised audio representations have improved speech and audio understanding, yet infant-centered naturalistic recordings remain challengi…