activity
20232026
most citedEffect of Attention and Self-Supervised Speech Embeddings on Non-Semantic Speech Tasks

3 citations · 3 across the 13 of their papers we have counts for

collaborators

16 papers

cs.LG2026

BARTER: Compact Dynamic Sparse Training with Standard Dense Kernels

Yueyuan Sui, Payal Mohapatra, Qi Zhu +1

Dynamic sparse training (DST) aims to reduce training costs while maintaining accuracy. Existing DST methods mask out parameters but keep matrix dimensions unchanged. Training spee…

cs.LG2026

Source-Learned Reliance for Selective Test-Time Adaptation of Multimodal Time Series

Payal Mohapatra, Yueyuan Sui, Haodong Yang +3

Multimodal wearable systems must remain reliable when sensor streams become noisy or unavailable. Existing multimodal test-time adaptation (TTA) methods often assess reliability on…

cs.LG2026

Efficient Multimodal Inference through Adaptive Acquisition and Sequential Fusion

Payal Mohapatra, Haodong Yang, Yueyuan Sui +3

Multimodal systems often encode every available input, even when a subset suffices for prediction. Adaptive acquisition can reduce this cost by using predictions from incrementally…

cs.HC2026

Towards Localizing Conversation Partners using Head Motion

Payal Mohapatra, Calvin Murdock, Ali Aroudi +4

Many individuals struggle to understand conversation partners in noisy settings, particularly amid background speakers or due to hearing impairments. Emerging wearables like smartg…

cs.LG2026

Attention Drift: What Autoregressive Speculative Decoding Models Learn

Doğaç Eldenk, Payal Mohapatra, Yigitcan Comlek +3

Speculative decoding accelerates LLM inference by drafting future tokens with a small model, but drafter models degrade sharply under template perturbation and long-context inputs.…

cs.LG2026

Modality-Aware Zero-Shot Pruning and Sparse Attention for Efficient Multimodal Edge Inference

Yueyuan Sui, Payal Mohapatra, Doğaç Eldenk +5

Edge devices increasingly run multimodal sensing pipelines that must remain accurate despite fluctuating power budgets and unpredictable sensor dropout. Existing pruning methods fa…

cs.RO2026

EmboAlign: Aligning Video Generation with Compositional Constraints for Zero-Shot Manipulation

Gehao Zhang, Zhenyang Ni, Payal Mohapatra +3

Video generative models (VGMs) pretrained on large-scale internet data can produce temporally coherent rollout videos that capture rich object dynamics, offering a compelling found…

cs.AI2026

STEP-LLM: Generating CAD STEP Models from Natural Language with Large Language Models

Xiangyu Shi, Junyang Ding, Xu Zhao +8

Computer-aided design (CAD) is vital to modern manufacturing, yet model creation remains labor-intensive and expertise-heavy. To enable non-experts to translate intuitive design in…

cs.LG2026

TimeSliver : Symbolic-Linear Decomposition for Explainable Time Series Classification

Akash Pandey, Payal Mohapatra, Wei Chen +2

Identifying the extent to which every temporal segment influences a model's predictions is essential for explaining model decisions and increasing transparency. While post-hoc expl…

cs.LG2025

MAESTRO : Adaptive Sparse Attention and Robust Learning for Multimodal Dynamic Time Series

Payal Mohapatra, Yueyuan Sui, Akash Pandey +2

From clinical healthcare to daily living, continuous sensor monitoring across multiple modalities has shown great promise for real-world intelligent decision-making but also faces…

cs.CL2025

Can LLMs Understand Unvoiced Speech? Exploring EMG-to-Text Conversion with LLMs

Payal Mohapatra, Akash Pandey, Xiaoyuan Zhang +1

Unvoiced electromyography (EMG) is an effective communication tool for individuals unable to produce vocal speech. However, most prior methods rely on paired voiced and unvoiced EM…

cs.CV2025

Split Adaptation for Pre-trained Vision Transformers

Lixu Wang, Bingqi Shang, Yi Li +4

Vision Transformers (ViTs), extensively pre-trained on large-scale datasets, have become essential to foundation models, allowing excellent performance on diverse downstream tasks…

cs.HC2024

Non-verbal Hands-free Control for Smart Glasses using Teeth Clicks

Payal Mohapatra, Ali Aroudi, Anurag Kumar +1

Smart glasses are emerging as a popular wearable computing platform potentially revolutionizing the next generation of human-computer interaction. The widespread adoption of smart…

cs.CL2024

Missingness-resilient Video-enhanced Multimodal Disfluency Detection

Payal Mohapatra, Shamika Likhite, Subrata Biswas +2

Most existing speech disfluency detection techniques only rely upon acoustic data. In this work, we present a practical multimodal disfluency detection approach that leverages avai…

cs.LG2024

Phase-driven Domain Generalizable Learning for Nonstationary Time Series

Payal Mohapatra, Lixu Wang, Qi Zhu

Pattern recognition is a fundamental task in continuous sensing applications, but real-world scenarios often experience distribution shifts that necessitate learning generalizable…

cs.AI2023★ 3 cited

Effect of Attention and Self-Supervised Speech Embeddings on Non-Semantic Speech Tasks

Payal Mohapatra, Akash Pandey, Yueyuan Sui +1

Human emotion understanding is pivotal in making conversational technology mainstream. We view speech emotion understanding as a perception task which is a more realistic setting.…