148 citations
Counting papers with at most 25 authors, so collaboration author lists do not stand in for the people here.
- Carnegie Mellon UniversityUS9 papers
- Ben-Gurion University of the NegevIL5 papers
- Centre National de la Recherche ScientifiqueFR5 papers
- ETH ZurichCH5 papers
- University of TorontoCA4 papers
- Chalmers University of TechnologySE3 papers
- Tsinghua UniversityCN3 papers
- University of Hong KongHK3 papers
- University of Illinois Urbana-ChampaignUS3 papers
- Aalto UniversityFI2 papers
- Adobe Systems (United States)US2 papers
- Columbia UniversityUS2 papers
79 papers
STyMo: Fast and Controllable Few-Shot Motion Style Transfer
Jose Luis Ponton, Alexander Winkler, Ladislav Kavan +2
Supporting a wide variety of motion styles is critical for creating diverse virtual characters, but current methods either require large stylized datasets or pre-trained models tha…
Physics-Based Simulation of Contact-Induced Facial Wrinkling
Juan Sebastian Montes Maestre, Ladislav Kavan, Edmond Boyer +3
Facial skin dynamics are inherently challenging to simulate due to a combination of geometric, material, and anatomical complexities. Human skin is a nonlinear layered material wit…
High-Performance Real-Time Implicit Strand-Based Hair Rendering via Software Rasterization
Lukas Lipp, Adrian Jarabo, Michael Wimmer +1
In this work we propose an efficient deferred software rasterization pipeline for real-time rendering of strand-based hair using hair meshes. Hair plays a crucial role in creating…
HyperBones: Realtime Bone-driven Neural Garment Simulation with Hypernetwork Conditioning
Astitva Srivastava, Hsiao-Yu Chen, Ryan Goldade +8
Recent advances in cloth simulation have led to accurate garment physics, but the methods are computationally expensive for real-time applications. In contrast, Linear Blend Skinni…
FRESCO: Benchmarking and Optimizing Re-rankers for Evolving Semantic Conflict in Retrieval-Augmented Generation
Sohyun An, Hayeon Lee, Shuibenyang Yuan +4
Retrieval-Augmented Generation (RAG) is a key approach to mitigating the temporal staleness of large language models (LLMs) by grounding responses in up-to-date evidence. Within th…
Cycle-Consistent Search: Question Reconstructability as a Proxy Reward for Search Agent Training
Sohyun An, Shuibenyang Yuan, Hayeon Lee +2
Reinforcement Learning (RL) has shown strong potential for optimizing search agents in complex information retrieval tasks. However, existing approaches predominantly rely on gold…
Enhancing Eye Feature Estimation from Event Data Streams through Adaptive Inference State Space Modeling
Viet Dung Nguyen, Mobina Ghorbaninejad, Chengyi Ma +5
Eye feature extraction from event-based data streams can be performed efficiently and with low energy consumption, offering great utility to real-world eye tracking pipelines. Howe…
Perceptual Requirements for Low-Latency Head-Mounted Displays
Eric Penner, Josephine D'Angelo, Clinton Smith +3
End-to-end (e2e) latency in head-mounted displays (HMD) is the time delay between a physical change in the world (e.g., a user's head movement) and the moment the display updates t…
Spectrogram features for audio and speech analysis
Ian McLoughlin, Lam Pham, Yan Song +7
Spectrogram-based representations have grown to dominate the feature space for deep learning audio analysis systems, and are often adopted for speech analysis also. Initially, the…
Gazeify Then Voiceify: Physical Object Referencing Through Gaze and Voice Interaction with Displayless Smart Glasses
Zheng Zhang, Mengjie Yu, Tianyi Wang +6
Smart glasses enhance interactions with the environment by using head-mounted cameras to observe the user's viewpoint, but lack the visual feedback used for common interactions. We…
REFA: Real-time Egocentric Facial Animations for Virtual Reality
Qiang Zhang, Tong Xiao, Haroun Habeeb +19
We present a novel system for real-time tracking of facial expressions using egocentric views captured from a set of infrared cameras embedded in a virtual reality (VR) headset. Ou…
HyBeam: Hybrid Microphone-Beamforming Array-Agnostic Speech Enhancement for Wearables
Yuval Bar Ilan, Boaz Rafaely, Vladimir Tourbabin
Speech enhancement is a fundamental challenge in signal processing, particularly when robustness is required across diverse acoustic conditions and microphone setups. Deep learning…
Mixture-of-Experts Framework for Field-of-View Enhanced Signal-Dependent Binauralization of Moving Talkers
Manan Mittal, Thomas Deppisch, Joseph Forrer +4
We propose a novel mixture of experts framework for field-of-view enhancement in binaural signal matching. Our approach enables dynamic spatial audio rendering that adapts to conti…
ProMemAssist: Exploring Timely Proactive Assistance Through Working Memory Modeling in Multi-Modal Wearable Devices
Kevin Pu, Ting Zhang, Naveen Sendhilnathan +3
Wearable AI systems aim to provide timely assistance in daily life, but existing approaches often rely on user initiation or predefined task knowledge, neglecting users' current me…
Self-supervised Learning of Latent Space Dynamics
Yue Li, Gene Wei-Chin Lin, Egor Larionov +7
Modeling the dynamic behavior of deformable objects is crucial for creating realistic digital worlds. While conventional simulations produce high-quality motions, their computation…
Towards Perception-Informed Latent HRTF Representations
You Zhang, Andrew Francl, Ruohan Gao +3
Personalized head-related transfer functions (HRTFs) are essential for ensuring a realistic auditory experience over headphones, because they take into account individual anatomica…
Ocular Authentication: Fusion of Gaze and Periocular Modalities
Dillon Lohr, Michael J. Proulx, Mehedi Hasan Raju +1
This paper investigates the feasibility of fusing two eye-centric authentication modalities-eye movements and periocular images-within a calibration-free authentication system. Whi…
POET: Prompt Offset Tuning for Continual Human Action Adaptation
Prachi Garg, Joseph K J, Vineeth N Balasubramanian +6
As extended reality (XR) is redefining how users interact with computing devices, research in human action recognition is gaining prominence. Typically, models deployed on immersiv…
Subthreshold Jitter in VR Can Induce Visual Discomfort
Samuel J. Levulis, Kevin W. Rio, Pablo Ramon Soria +3
Visual-vestibular conflicts (VVCs) are a primary contributor to visually induced motion sickness (VIMS) in head-mounted displays (HMDs). However, virtual reality (VR) comfort studi…
A Survey on Text-Driven 360-Degree Panorama Generation
Hai Wang, Xiaoyu Xiang, Weihao Xia +1
The advent of text-driven 360-degree panorama generation, enabling the synthesis of 360-degree panoramic images directly from textual descriptions, marks a transformative advanceme…
Glissando-Net: Deep sinGLe vIew category level poSe eStimation ANd 3D recOnstruction
Bo Sun, Hao Kang, Li Guan +3
We present a deep learning model, dubbed Glissando-Net, to simultaneously estimate the pose and reconstruct the 3D shape of objects at the category level from a single RGB image. P…
BSM-iMagLS: ILD Informed Binaural Signal Matching for Reproduction with Head-Mounted Microphone Arrays
Or Berebi, Zamir Ben-Hur, David Lou Alon +1
Headphone listening in applications such as augmented and virtual reality (AR and VR) relies on high-quality spatial audio to ensure immersion, making accurate binaural reproductio…
Eye Gaze as a Signal for Conveying User Attention in Contextual AI Systems
Ethan Wilson, Naveen Sendhilnathan, Charlie S. Burlingham +5
Advanced multimodal AI agents can now collaborate with users to solve challenges in the world. Yet, these emerging contextual AI systems rely on explicit communication channels bet…
CHOICE: Coordinated Human-Object Interaction in Cluttered Environments for Pick-and-Place Actions
Jintao Lu, He Zhang, Yuting Ye +3
Animating human-scene interactions such as pick-and-place tasks in cluttered, complex layouts is a challenging task, with objects of a wide variation of geometries and articulation…