Publications (8)
PhaseCoder: Microphone Geometry-Agnostic Spatial Audio Understanding for Multimodal LLMs
Artem Dementyev, Wazeer Zulfikar, Sinan Hersek +3
Current multimodal LLMs process audio as a mono stream, ignoring the rich spatial information essential for embodied AI. Existing spatial audio models, conversely, are constrained…
Local Kernels that Approximate Bayesian Regularization and Proximal Operators
Frank Ong, Peyman Milanfar, Pascal Getreuer
In this work, we broadly connect kernel-based filtering (e.g. approaches such as the bilateral filters and nonlocal means, but also many more) with general variational formulations…
Image Stylization: From Predefined to Personalized
Ignacio Garcia-Dorado, Pascal Getreuer, Bartlomiej Wronski +1
We present a framework for interactive design of new image stylizations using a wide range of predefined filter blocks. Both novel and off-the-shelf image filtering and rendering t…
Fast, Trainable, Multiscale Denoising
Sungjoon Choi, John Isidoro, Pascal Getreuer +1
Denoising is a fundamental imaging problem. Versatile but fast filtering has been demanded for mobile camera systems. We present an approach to multiscale filtering which allows re…
BLADE: Filter Learning for General Purpose Computational Photography
Pascal Getreuer, Ignacio Garcia-Dorado, John Isidoro +3
The Rapid and Accurate Image Super Resolution (RAISR) method of Romano, Isidoro, and Milanfar is a computationally efficient image upscaling method using a trained set of filters.…
Trainable Frontend For Robust and Far-Field Keyword Spotting
Yuxuan Wang, Pascal Getreuer, Thad Hughes +2
Robust and far-field speech recognition is critical to enable true hands-free communication. In far-field conditions, signals are attenuated due to distance. To improve robustness…
Graphic Narrative with Interactive Stylization Design
Ignacio Garcia-Dorado, Pascal Getreuer, Madison Le +3
We present a system to convert any set of images (e.g., a video clip or a photo album) into a storyboard. We aim to create multiple pleasing graphic representations of the content…
Possibility of Turbulence from a Post-Navier-Stokes Equation
Pascal Getreuer, A. M. Albano, A. Muriel
We introduce corrections to the Navier-Stokes equation arising from the transitions between molecular states and the injection of external energy. In the simplest application of th…