9 papers
TRIG: Toward Measuring Texture Realism in Image Generation
Zhiwei Xu, Jiali Cui, Zhiqiang Lao +2
This paper studies the backbone used by metrics for evaluating the quality of generated images. Although generative models have advanced rapidly, some outputs still exhibit unreali…
LEAP: Learned Block-wise Evidence Retrieval for Long Audio-Video Perception
Juyi Lin, Zhiqiang Lao, Jiali Cui +9
Hour-scale audio-visual question answering is constrained by a context dilemma: dense whole-recording encoding rapidly exhausts context limits, whereas uniform temporal compression…
A General-Purpose VLM Can Teach an Astronomy Foundation Model to Better Recognize Galaxy Morphology
Dichang Zhang, Jiaqi Deng, Yixuan Shao +7
Existing astronomy foundation models provide strong galaxy representations, but adapting them to new survey conditions and survey-specific morphology recognition tasks still requir…
Neural Geometry Image-Based Representations with Optimal Transport (OT)
Xiang Gao, Yuanpeng Liu, Xinmu Wang +7
Neural representations for 3D meshes are emerging as an effective solution for compact storage and efficient processing. Existing methods often rely on neural overfitting, where a…
OT-Talk: Animating 3D Talking Head with Optimal Transportation
Xinmu Wang, Xiang Gao, Xiyun Song +4
Animating 3D head meshes using audio inputs has significant applications in AR/VR, gaming, and entertainment through 3D avatars. However, bridging the modality gap between speech s…
ePBR: Extended PBR Materials in Image Synthesis
Yu Guo, Zhiqiang Lao, Xiyun Song +3
Realistic indoor or outdoor image synthesis is a core challenge in computer vision and graphics. The learning-based approach is easy to use but lacks physical consistency, while tr…
REEF: Relevance-Aware and Efficient LLM Adapter for Video Understanding
Sakib Reza, Xiyun Song, Heather Yu +3
Integrating vision models into large language models (LLMs) has sparked significant interest in creating vision-language foundation models, especially for video understanding. Rece…
OccludeNeRF: Geometric-aware 3D Scene Inpainting with Collaborative Score Distillation in NeRF
Jingyu Shi, Achleshwar Luthra, Jiazhi Li +5
With Neural Radiance Fields (NeRFs) arising as a powerful 3D representation, research has investigated its various downstream tasks, including inpainting NeRFs with 2D images. Desp…
Envisioning a Next Generation Extended Reality Conferencing System with Efficient Photorealistic Human Rendering
Chuanyue Shen, Letian Zhang, Zhangsihao Yang +4
Meeting online is becoming the new normal. Creating an immersive experience for online meetings is a necessity towards more diverse and seamless environments. Efficient photorealis…