8 papers
Clustered Codebook Quantization for 2D Gaussian-based Image Compression
Runze Cheng, Yicheng Zhan, Josef Spjut +1
Gaussian-based image representations effectively model image content using compact parametric primitives while preserving high visual fidelity, yet storing a large number of floati…
Editing Physiological Signals in Videos Using Latent Representations
Tianwen Zhou, Akshay Paruchuri, Josef Spjut +1
Camera-based physiological signal estimation provides a non-contact and convenient means to monitor Heart Rate (HR). However, the presence of vital signals in facial videos raises…
GRS: Generating Robotic Simulation Tasks from Real-World Images
Alex Zook, Fan-Yun Sun, Josef Spjut +3
We introduce GRS (Generating Robotic Simulation tasks), a system addressing real-to-sim for robotic simulations. GRS creates digital twin simulations from single RGB-D observations…
Assessing Learned Models for Phase-only Hologram Compression
Zicong Peng, Yicheng Zhan, Josef Spjut +1
We evaluate the performance of four common learned models utilizing INR and VAE structures for compressing phase-only holograms in holographic displays. The evaluated models includ…
Fly, Fail, Fix: Iterative Game Repair with Reinforcement Learning and Large Multimodal Models
Alex Zook, Josef Spjut, Jonathan Tremblay
Game design hinges on understanding how static rules and content translate into dynamic player behavior - something modern generative systems that inspect only a game's code or ass…
Esports and expertise: what competitive gaming can teach us about mastery
Ben Boudaoud, Josef Spjut, Joohwan Kim +2
Historically, much research and development in human computer interaction has focused on atomic and generalizable tasks, where task completion time indicates productivity. However,…