most citedGhost in the Minecraft: Generally Capable Agents for Open-World Environments via Large Language Models with Text-based Knowledge and Memory

24 citations · 51 across the 10 of their papers we have counts for

collaborators

10 papers

cs.CV2023

Visual Commonsense based Heterogeneous Graph Contrastive Learning

Zongzhao Li, Xiangyu Zhu, Xi Zhang +2

How to select relevant key objects and reason about the complex relationships cross vision and linguistic domain are two key issues in many multi-modality applications such as visu…

cs.CV2023

DDG-Net: Discriminability-Driven Graph Network for Weakly-supervised Temporal Action Localization

Xiaojun Tang, Junsong Fan, Chuanchen Luo +3

Weakly-supervised temporal action localization (WTAL) is a practical yet challenging task. Due to large-scale datasets, most existing methods use a network pretrained in other data…

cs.SD2023★ 6 cited

Visually-Guided Sound Source Separation with Audio-Visual Predictive Coding

Zengjie Song, Zhaoxiang Zhang

The framework of visually-guided sound source separation generally consists of three parts: visual feature extraction, multimodal feature fusion, and sound signal processing. An on…

cs.CV2023

Tracking Objects with 3D Representation from Videos

Jiawei He, Lue Fan, Yuqi Wang +4

Data association is a knotty problem for 2D Multiple Object Tracking due to the object occlusion. However, in 3D space, data association is not so hard. Only with a 3D Kalman Filte…

eess.IV2023★ 3 cited

BMAD: Benchmarks for Medical Anomaly Detection

Jinan Bao, Hanshi Sun, Hanqiu Deng +3

Anomaly detection (AD) is a fundamental research problem in machine learning and computer vision, with practical applications in industrial inspection, video surveillance, and medi…

cs.AI2023★ 24 cited

Ghost in the Minecraft: Generally Capable Agents for Open-World Environments via Large Language Models with Text-based Knowledge and Memory

Xizhou Zhu, Yuntao Chen, Hao Tian +10

The captivating realm of Minecraft has attracted substantial research interest in recent years, serving as a rich platform for developing intelligent agents capable of functioning…

cs.CV2023★ 1 cited

Intrinsic Physical Concepts Discovery with Object-Centric Predictive Models

Qu Tang, XiangYu Zhu, Zhen Lei +1

The ability to discover abstract physical concepts and understand how they work in the world through observing lies at the core of human intelligence. The acquisition of this abili…

cs.CV2023

Graphics Capsule: Learning Hierarchical 3D Face Representations from 2D Images

Chang Yu, Xiangyu Zhu, Xiaomei Zhang +2

The function of constructing the hierarchy of objects is important to the visual process of the human brain. Previous studies have successfully adopted capsule networks to decompos…

cs.CV2023★ 7 cited

Sharpness-Aware Gradient Matching for Domain Generalization

Pengfei Wang, Zhaoxiang Zhang, Zhen Lei +1

The goal of domain generalization (DG) is to enhance the generalization capability of the model learned from a source domain to other unseen domains. The recently developed Sharpne…

cs.CV2023★ 10 cited

Learnable Graph Matching: A Practical Paradigm for Data Association

Jiawei He, Zehao Huang, Naiyan Wang +1

Data association is at the core of many computer vision tasks, e.g., multiple object tracking, image matching, and point cloud registration. however, current data association solut…