Publications (8)
An Overview of Enhancing Distance Learning Through Augmented and Virtual Reality Technologies
Elizabeth Childs, Ferzam Mohammad, Logan Stevens +4
Although distance learning presents a number of interesting educational advantages as compared to in-person instruction, it is not without its downsides. We first assess the educat…
Effects of virtual acoustics on dynamic auditory distance perception
Atul Rungta, Nicholas Rewkowski, Roberta Klatzky +2
Sound propagation encompasses various acoustic phenomena including reverberation. Current virtual acoustic methods, ranging from parametric filters to physically-accurate solvers,…
Speech2AffectiveGestures: Synthesizing Co-Speech Gestures with Generative Adversarial Affective Expression Learning
Uttaran Bhattacharya, Elizabeth Childs, Nicholas Rewkowski +1
We present a generative adversarial network to synthesize 3D pose sequences of co-speech upper-body gestures with appropriate affective expressions. Our network consists of two com…
P-Reverb: Perceptual Characterization of Early and Late Reflections for Auditory Displays
Atul Rungta, Nicholas Rewkowski, Roberta Klatzky +1
We introduce a novel, perceptually derived metric (P-Reverb) that relates the just-noticeable difference (JND) of the early sound field(also called early reflections) to the late s…
Generating Emotive Gaits for Virtual Agents Using Affect-Based Autoregression
Uttaran Bhattacharya, Nicholas Rewkowski, Pooja Guhan +4
We present a novel autoregression network to generate virtual agents that convey various emotions through their walking styles or gaits. Given the 3D pose sequences of a gait, our…
Echo-Reconstruction: Audio-Augmented 3D Scene Reconstruction
Justin Wilson, Nicholas Rewkowski, Ming C. Lin +1
Reflective and textureless surfaces such as windows, mirrors, and walls can be a challenge for object and scene reconstruction. These surfaces are often poorly reconstructed and fi…
A Framework for Active Haptic Guidance Using Robotic Haptic Proxies
Niall L. Williams, Nicholas Rewkowski, Jiasheng Li +1
Haptic feedback is an important component of creating an immersive mixed reality experience. Traditionally, haptic forces are rendered in response to the user's interactions with t…
Text2Gestures: A Transformer-Based Network for Generating Emotive Body Gestures for Virtual Agents
Uttaran Bhattacharya, Nicholas Rewkowski, Abhishek Banerjee +3
We present Text2Gestures, a transformer-based learning method to interactively generate emotive full-body gestures for virtual agents aligned with natural language text inputs. Our…