75 citations · 235 across the 26 of their papers we have counts for
28 papers
Dichoptic Foveation
Henry Kam, Colin Groth, Jenna Kang +3
Interocular differences in visual perception can induce a variety of effects when fused by the brain. For example, prior works have found that carefully crafted binocular differenc…
Infinite Gaze Generation for Videos with Autoregressive Diffusion
Jenna Kang, Colin Groth, Tong Wu +4
Predicting human gaze in video is fundamental to advancing scene understanding and multimodal interaction. While traditional saliency maps provide spatial probability distributions…
HOICraft: In-Situ VLM-based Authoring Tool for Part-Level Hand-Object Interaction Design in VR
Dohui Lee, Qi Sun, Sang Ho Yoon
Hand-Object Interaction (HOI) is a key interaction component in Virtual Reality (VR). However, designing HOI still requires manual efforts to decide how object should be selected a…
Foveation Improves Payload Capacity in Steganography
Lifeng Qiu Lin, Henry Kam, Qi Sun +1
Steganography finds its use in visual medium such as providing metadata and watermarking. With support of efficient latent representations and foveated rendering, we trained models…
GeneVA: A Dataset of Human Annotations for Generative Text to Video Artifacts
Jenna Kang, Maria Silva, Patsorn Sangkloy +3
Recent advances in probabilistic generative models have extended capabilities from static image synthesis to text-driven video generation. However, the inherent randomness of their…
Cost-Aware Routing for Efficient Text-To-Image Generation
Qinchan Li, Kenneth Chen, Changyue Su +3
Diffusion models are well known for their ability to generate a high-fidelity image for an input prompt through an iterative denoising process. Unfortunately, the high fidelity als…
Physically Grounded Monocular Depth via Nanophotonic Wavefront Encoding
Bingxuan Li, Jiahao Wu, Yuan Xu +6
Depth foundation models (DFMs) offer strong learned priors for 3D perception from single RGB images but lack physical depth cues, leading to ambiguities in metric scale. We introdu…
BudgetFusion: Perceptually-Guided Adaptive Diffusion Models
Qinchan Li, Kenneth Chen, Changyue Su +1
Diffusion models have shown unprecedented success in the task of text-to-image generation. While these models are capable of generating high-quality and realistic images, the compl…
Low Latency Point Cloud Rendering with Learned Splatting
Yueyu Hu, Ran Gong, Qi Sun +1
Point cloud is a critical 3D representation with many emerging applications. Because of the point sparsity and irregularity, high-quality rendering of point clouds is challenging a…
HuBar: A Visual Analytics Tool to Explore Human Behaviour based on fNIRS in AR guidance systems
Sonia Castelo, Joao Rulff, Parikshit Solunke +11
The concept of an intelligent augmented reality (AR) assistant has significant, wide-ranging applications, with potential uses in medicine, military, and mechanics domains. Such an…
GazeFusion: Saliency-Guided Image Generation
Yunxiang Zhang, Nan Wu, Connor Z. Lin +2
Diffusion models offer unprecedented image generation power given just a text prompt. While emerging approaches for controlling diffusion models have enabled users to specify the d…
Image-GS: Content-Adaptive Image Representation via 2D Gaussians
Yunxiang Zhang, Bingxuan Li, Alexandr Kuznetsov +6
Neural image representations have emerged as a promising approach for encoding and rendering visual data. Combined with learning-based workflows, they demonstrate impressive trade-…
Toward Ubiquitous 3D Object Digitization: A Wearable Computing Framework for Non-Invasive Physical Property Acquisition
Yunxiang Zhang, Xin Sun, Dengfeng Li +2
Accurately digitizing physical objects is central to many applications, including virtual/augmented reality, industrial design, and e-commerce. Prior research has demonstrated effi…
Configurable Holography: Towards Display and Scene Adaptation
Yicheng Zhan, Liang Shi, Wojciech Matusik +2
Rendering holograms for holographic displays is often an iterative and computationally costly process. Emerging learned holography methods have alleviated this bottleneck by enabli…
The Shortest Route Is Not Always the Fastest: Probability-Modeled Stereoscopic Eye Movement Completion Time in VR
Budmonde Duinkharjav, Benjamin Liang, Anjul Patney +2
Speed and consistency of target-shifting play a crucial role in human ability to perform complex tasks. Shifting our gaze between objects of interest quickly and consistently requi…
Exploiting Human Color Discrimination for Memory- and Energy-Efficient Image Encoding in Virtual Reality
Nisarg Ujjainkar, Ethan Shahan, Kenneth Chen +3
Virtual Reality (VR) has the potential of becoming the next ubiquitous computing platform. Continued progress in the burgeoning field of VR depends critically on an efficient compu…
Toward Optimized VR/AR Ergonomics: Modeling and Predicting User Neck Muscle Contraction
Yunxiang Zhang, Kenneth Chen, Qi Sun
Ergonomic efficiency is essential to the mass and prolonged adoption of VR/AR experiences. While VR/AR head-mounted displays unlock users' natural wide-range head movements during…
ARGUS: Visualization of AI-Assisted Task Guidance in AR
Sonia Castelo, Joao Rulff, Erin McGowan +15
The concept of augmented reality (AR) assistants has captured the human imagination for decades, becoming a staple of modern science fiction. To pursue this goal, it is necessary t…
AutoColor: Learned Light Power Control for Multi-Color Holograms
Yicheng Zhan, Koray Kavaklı, Hakan Urey +2
Multi-color holograms rely on simultaneous illumination from multiple light sources. These multi-color holograms could utilize light sources better than conventional single-color h…
Force-Aware Interface via Electromyography for Natural VR/AR Interaction
Yunxiang Zhang, Benjamin Liang, Boyuan Chen +4
While tremendous advances in visual and auditory realism have been made for virtual and augmented reality (VR/AR), introducing a plausible sense of physicality into the virtual wor…
Color-Perception-Guided Display Power Reduction for Virtual Reality
Budmonde Duinkharjav, Kenneth Chen, Abhishek Tyagi +3
Battery life is an increasingly urgent challenge for today's untethered VR and AR devices. However, the power efficiency of head-mounted displays is naturally at odds with growing…
Image Features Influence Reaction Time: A Learned Probabilistic Perceptual Model for Saccade Latency
Budmonde Duinkharjav, Praneeth Chakravarthula, Rachel Brown +2
We aim to ask and answer an essential question "how quickly do we react after observing a displayed visual target?" To this end, we present psychophysical studies that characterize…
Instant Reality: Gaze-Contingent Perceptual Optimization for 3D Virtual Reality Streaming
Shaoyu Chen, Budmonde Duinkharjav, Xin Sun +5
Media streaming has been adopted for a variety of applications such as entertainment, visualization, and design. Unlike video/audio streaming where the content is usually consumed…
Gaze-Contingent Retinal Speckle Suppression for Perceptually-Matched Foveated Holographic Displays
Praneeth Chakravarthula, Zhan Zhang, Okan Tursun +3
Computer-generated holographic (CGH) displays show great potential and are emerging as the next-generation displays for augmented and virtual reality, and automotive heads-up displ…