3 citations · 6 across the 26 of their papers we have counts for
26 papers
VSMP-IMU: Video-Grounded Semantic Motion Programs for Sensor-Aware Synthetic IMU Generation
Lala Shakti Swarup Ray, Vitor Fortes Rey, Mengxi Liu +2
Wearable human activity recognition (HAR) is often limited by the scarcity of labeled sensor data, especially in low-resource, class-imbalanced, and subject-generalization settings…
Foundation Models Defining A New Era In Sensor-based Human Activity Recognition: A Survey And Outlook
Sizhen Bian, Mengxi Liu, Lala Shakti Swarup Ray +7
Sensor-based Human Activity Recognition (HAR) underpins many ubiquitous and wearable computing applications, yet current models remain limited by scarce labels, sensor heterogeneit…
ActivityNarrated: An Open-Ended Narrative Paradigm for Wearable Human Activity Understanding
Lala Shakti Swarup Ray, Mengxi Liu, Alcina Pinto +4
Wearable human activity recognition (HAR) has made steady progress, yet much of this progress remains grounded in fixed-window, closed-set classification benchmarks. This formulati…
SPECTRA: An Efficient Spectral-Informed Neural Network for Sensor-Based Activity Recognition
Deepika Gurung, Lala Shakti Swarup Ray, Mengxi Liu +2
Real time sensor based applications in pervasive computing require edge deployable models to ensure low latency privacy and efficient interaction. A prime example is sensor based h…
OpenMarcie: Dataset for Multimodal Action Recognition in Industrial Environments
Hymalai Bello, Lala Ray, Joanna Sorysz +2
Smart factories use advanced technologies to optimize production and increase efficiency. To this end, the recognition of worker activity allows for accurate quantification of perf…
Interpretable Multimodal Gesture Recognition for Drone and Mobile Robot Teleoperation via Log-Likelihood Ratio Fusion
Seungyeol Baek, Jaspreet Singh, Lala Shakti Swarup Ray +3
Human operators are still frequently exposed to hazardous environments such as disaster zones and industrial facilities, where intuitive and reliable teleoperation of mobile robots…
ChairPose: Pressure-based Chair Morphology Grounded Sitting Pose Estimation through Simulation-Assisted Training
Lala Shakti Swarup Ray, Vitor Fortes Rey, Bo Zhou +2
Prolonged seated activity is increasingly common in modern environments, raising concerns around musculoskeletal health, ergonomics, and the design of responsive interactive system…
SImpHAR: Advancing impedance-based human activity recognition using 3D simulation and text-to-motion models
Lala Shakti Swarup Ray, Mengxi Liu, Deepika Gurung +3
Human Activity Recognition (HAR) with wearable sensors is essential for applications in healthcare, fitness, and human-computer interaction. Bio-impedance sensing offers unique adv…
W2W: A Simulated Exploration of IMU Placement Across the Human Body for Designing Smarter Wearable
Lala Shakti Swarup Ray, Bo Zhou, Paul Lukowicz
Inertial measurement units (IMUs) are central to wearable systems for activity recognition and pose estimation, but sensor placement remains largely guided by heuristics and conven…
From Neck to Head: Bio-Impedance Sensing for Head Pose Estimation
Mengxi Liu, Lala Shakti Swarup Ray, Sizhen Bian +6
We present NeckSense, a novel wearable system for head pose tracking that leverages multi-channel bio-impedance sensing with soft, dry electrodes embedded in a lightweight, necklac…
TxP: Reciprocal Generation of Ground Pressure Dynamics and Activity Descriptions for Improving Human Activity Recognition
Lala Shakti Swarup Ray, Lars Krupp, Vitor Fortes Rey +3
Sensor-based human activity recognition (HAR) has predominantly focused on Inertial Measurement Units and vision data, often overlooking the capabilities unique to pressure sensors…
Initial Findings on Sensor based Open Vocabulary Activity Recognition via Text Embedding Inversion
Lala Shakti Swarup Ray, Bo Zhou, Sungho Suh +1
Conventional human activity recognition (HAR) relies on classifiers trained to predict discrete activity classes, inherently limiting recognition to activities explicitly present i…
OV-HHIR: Open Vocabulary Human Interaction Recognition Using Cross-modal Integration of Large Language Models
Lala Shakti Swarup Ray, Bo Zhou, Sungho Suh +1
Understanding human-to-human interactions, especially in contexts like public security surveillance, is critical for monitoring and maintaining safety. Traditional activity recogni…
Towards certifiable AI in aviation: landscape, challenges, and opportunities
Hymalai Bello, Daniel Geißler, Lala Ray +6
Artificial Intelligence (AI) methods are powerful tools for various domains, including critical fields such as avionics, where certification is required to achieve and maintain an…
ALS-HAR: Harnessing Wearable Ambient Light Sensors to Enhance IMU-based Human Activity Recogntion
Lala Shakti Swarup Ray, Daniel Geißler, Mengxi Liu +3
Despite the widespread integration of ambient light sensors (ALS) in smart devices commonly used for screen brightness adaptation, their application in human activity recognition (…
Enhancing Inertial Hand based HAR through Joint Representation of Language, Pose and Synthetic IMUs
Vitor Fortes Rey, Lala Shakti Swarup Ray, Xia Qingxin +2
Due to the scarcity of labeled sensor data in HAR, prior research has turned to video data to synthesize Inertial Measurement Units (IMU) data, capitalizing on its rich activity an…
Sensor Data Augmentation from Skeleton Pose Sequences for Improving Human Activity Recognition
Parham Zolfaghari, Vitor Fortes Rey, Lala Ray +3
The proliferation of deep learning has significantly advanced various fields, yet Human Activity Recognition (HAR) has not fully capitalized on these developments, primarily due to…
MuJo: Multimodal Joint Feature Space Learning for Human Activity Recognition
Stefan Gerd Fritsch, Cennet Oguz, Vitor Fortes Rey +3
Human activity recognition (HAR) is a long-standing problem in artificial intelligence with applications in a broad range of areas, including healthcare, sports and fitness, securi…
Text me the data: Generating Ground Pressure Sequence from Textual Descriptions for HAR
Lala Shakti Swarup Ray, Bo Zhou, Sungho Suh +3
In human activity recognition (HAR), the availability of substantial ground truth is necessary for training efficient models. However, acquiring ground pressure data through physic…
A Novel Local-Global Feature Fusion Framework for Body-weight Exercise Recognition with Pressure Mapping Sensors
Davinder Pal Singh, Lala Shakti Swarup Ray, Bo Zhou +2
We present a novel local-global feature fusion framework for body-weight exercise recognition with floor-based dynamic pressure maps. One step further from the existing studies usi…
PressureTransferNet: Human Attribute Guided Dynamic Ground Pressure Profile Transfer using 3D simulated Pressure Maps
Lala Shakti Swarup Ray, Vitor Fortes Rey, Bo Zhou +2
We propose PressureTransferNet, a novel method for Human Activity Recognition (HAR) using ground pressure information. Our approach generates body-specific dynamic ground pressure…
Selecting the motion ground truth for loose-fitting wearables: benchmarking optical MoCap methods
Lala Shakti Swarup Ray, Bo Zhou, Sungho Suh +1
To help smart wearable researchers choose the optimal ground truth methods for motion capturing (MoCap) for all types of loose garments, we present a benchmark, DrapeMoCapBench (DM…
Origami Single-end Capacitive Sensing for Continuous Shape Estimation of Morphing Structures
Lala Shakti Swarup Ray, Daniel Geißler, Bo Zhou +2
In this work, we propose a novel single-end morphing capacitive sensing method for shape tracking, FxC, by combining Folding origami structures and Capacitive sensing to detect the…
A Synthetic Benchmarking Pipeline to Compare Camera Calibration Algorithms
Lala Shakti Swarup Ray, Bo Zhou, Lars Krupp +2
Accurate camera calibration is crucial for various computer vision applications. However, measuring calibration accuracy in the real world is challenging due to the lack of dataset…