132 citations · 159 across the 11 of their papers we have counts for
11 papers
Interpretability Transfer from Language to Vision via Sparse Autoencoders
Alexey Kravets, Da Li, Chuan Li +2
Recent advances in language model interpretability using sparse autoencoders (SAEs) have yet to effectively translate to the visual domain, mainly due to the difficulty and ambigui…
RAW: Robust Avatar Watermarking -- Benchmarking and Baseline
Jack Parry, Jack Saunders, Vinay Namboodiri
Digital avatar watermarking presents unique challenges: avatars are routinely post-processed with background replacement, reframing, and format conversion before deployment. We int…
GASP: Gaussian Avatars with Synthetic Priors
Jack Saunders, Charlie Hewitt, Yanan Jian +8
Gaussian Splatting has changed the game for real-time photo-realistic rendering. One of the most popular applications of Gaussian Splatting is to create animatable avatars, known a…
TalkLoRA: Low-Rank Adaptation for Speech-Driven Animation
Jack Saunders, Vinay Namboodiri
Speech-driven facial animation is important for many applications including TV, film, video games, telecommunication and AR/VR. Recently, transformers have been shown to be extreme…
Towards Accurate Lip-to-Speech Synthesis in-the-Wild
Sindhu Hegde, Rudrabha Mukhopadhyay, C. V. Jawahar +1
In this paper, we introduce a novel approach to address the task of synthesizing speech from silent videos of any in-the-wild speaker solely based on lip movements. The traditional…
Dubbing for Everyone: Data-Efficient Visual Dubbing using Neural Rendering Priors
Jack Saunders, Vinay Namboodiri
Visual dubbing is the process of generating lip motions of an actor in a video to synchronise with given audio. Recent advances have made progress towards this goal but have not be…
FACTS: Facial Animation Creation using the Transfer of Styles
Jack Saunders, Steven Caulkin, Vinay Namboodiri
The ability to accurately capture and express emotions is a critical aspect of creating believable characters in video games and other forms of entertainment. Traditionally, this a…
Towards MOOCs for Lipreading: Using Synthetic Talking Heads to Train Humans in Lipreading at Scale
Aditya Agarwal, Bipasha Sen, Rudrabha Mukhopadhyay +2
Many people with some form of hearing loss consider lipreading as their primary mode of day-to-day communication. However, finding resources to learn or improve one's lipreading sk…
FaceOff: A Video-to-Video Face Swapping System
Aditya Agarwal, Bipasha Sen, Rudrabha Mukhopadhyay +2
Doubles play an indispensable role in the movie industry. They take the place of the actors in dangerous stunt scenes or scenes where the same actor plays multiple characters. The…
STEER: Simple Temporal Regularization For Neural ODEs
Arnab Ghosh, Harkirat Singh Behl, Emilien Dupont +2
Training Neural Ordinary Differential Equations (ODEs) is often computationally expensive. Indeed, computing the forward pass of such models involves solving an ODE which can becom…
CovidAID: COVID-19 Detection Using Chest X-Ray
Arpan Mangal, Surya Kalia, Harish Rajgopal +4
The exponential increase in COVID-19 patients is overwhelming healthcare systems across the world. With limited testing kits, it is impossible for every patient with respiratory il…