238 citations · 474 across the 8 of their papers we have counts for
8 papers
Live Music Models
Lyria Team, Antoine Caillon, Brian McWilliams +33
We introduce a new class of generative models for music called live music models that produce a continuous stream of music in real-time with synchronized user control. We release M…
Gemma: Open Models Based on Gemini Research and Technology
Gemma Team, Thomas Mesnard, Cassidy Hardin +105
This work introduces Gemma, a family of lightweight, state-of-the art open models built from the research and technology used to create Gemini models. Gemma models demonstrate stro…
Blendshapes GHUM: Real-time Monocular Facial Blendshape Prediction
Ivan Grishchenko, Geng Yan, Eduard Gabriel Bazavan +5
We present Blendshapes GHUM, an on-device ML pipeline that predicts 52 facial blendshape coefficients at 30+ FPS on modern mobile phones, from a single monocular RGB image and enab…
BlazePose GHUM Holistic: Real-time 3D Human Landmarks and Pose Estimation
Ivan Grishchenko, Valentin Bazarevsky, Andrei Zanfir +7
We present BlazePose GHUM Holistic, a lightweight neural network pipeline for 3D human body landmarks and pose estimation, specifically tailored to real-time on-device inference. B…
Real-time Pupil Tracking from Monocular Video for Digital Puppetry
Artsiom Ablavatski, Andrey Vakunov, Ivan Grishchenko +2
We present a simple, real-time approach for pupil tracking from live video on mobile devices. Our method extends a state-of-the-art face mesh detector with two new components: a ti…
Attention Mesh: High-fidelity Face Mesh Prediction in Real-time
Ivan Grishchenko, Artsiom Ablavatski, Yury Kartynnik +2
We present Attention Mesh, a lightweight architecture for 3D face mesh prediction that uses attention to semantically meaningful regions. Our neural network is designed for real-ti…