4 papers
MouseGPT: A Large-scale Vision-Language Model for Mouse Behavior Analysis
Teng Xu, Taotao Zhou, Youjia Wang +15
Analyzing animal behavior is crucial in neuroscience, yet deciphering its intricate dynamics remains challenging. Traditional machine vision approaches detect spontaneous behaviors…
Sophia-in-Audition: Virtual Production with a Robot Performer
Taotao Zhou, Teng Xu, Dong Zhang +5
We present Sophia-in-Audition (SiA), a new frontier in virtual production, by employing the humanoid robot Sophia within an UltraStage environment composed of a controllable lighti…
Relightable Neural Human Assets from Multi-view Gradient Illuminations
Taotao Zhou, Kai He, Di Wu +6
Human modeling and relighting are two fundamental problems in computer vision and graphics, where high-quality datasets can largely facilitate related research. However, most exist…
Neural Relighting and Expression Transfer On Video Portraits
Youjia Wang, Taotao Zhou, Minzhang Li +4
Photo-realistic video portrait reenactment benefits virtual production and numerous VR/AR experiences. The task remains challenging as the reenacted expression should match the sou…