25 citations · 106 across the 18 of their papers we have counts for
19 papers
SurgVLM: A Large Vision-Language Model and Systematic Evaluation Benchmark for Surgical Intelligence
Zhitao Zeng, Zhu Zhuo, Xiaojun Jia +12
Foundation models have achieved transformative success across biomedical domains by enabling holistic understanding of multimodal data. However, their application in surgery remain…
RuleReasoner: Reinforced Rule-based Reasoning via Domain-aware Dynamic Sampling
Yang Liu, Jiaqi Li, Zilong Zheng
Rule-based reasoning is acknowledged as one of the fundamental problems of reasoning. While recent studies show that large reasoning models (LRMs) have remarkable reasoning capabil…
Discrete Markov Bridge
Hengli Li, Yuxuan Wang, Song-Chun Zhu +2
Discrete diffusion has recently emerged as a promising paradigm in discrete data modeling. However, existing methods typically rely on a fixed rate transition matrix during trainin…
Absolute Zero: Reinforced Self-play Reasoning with Zero Data
Andrew Zhao, Yiran Wu, Yang Yue +7
Reinforcement learning with verifiable rewards (RLVR) has shown promise in enhancing the reasoning capabilities of large language models by learning directly from outcome-based rew…
MindAgent: Emergent Gaming Interaction
Ran Gong, Qiuyuan Huang, Xiaojian Ma +8
Large Language Models (LLMs) have the capacity of performing complex scheduling in a multi-agent system and can coordinate these agents into completing sophisticated tasks that req…
Large Language Models are In-Context Semantic Reasoners rather than Symbolic Reasoners
Xiaojuan Tang, Zilong Zheng, Jiaqi Li +4
The emergent few-shot reasoning capabilities of Large Language Models (LLMs) have excited the natural language and machine learning community over recent years. Despite of numerous…
MindDial: Belief Dynamics Tracking with Theory-of-Mind Modeling for Situated Neural Dialogue Generation
Shuwen Qiu, Mingdian Liu, Hengli Li +2
Humans talk in daily conversations while aligning and negotiating the expressed meanings or common ground. Despite the impressive conversational abilities of the large generative l…
SQA3D: Situated Question Answering in 3D Scenes
Xiaojian Ma, Silong Yong, Zilong Zheng +4
We propose a new task to benchmark scene understanding of embodied agents: Situated Question Answering in 3D Scenes (SQA3D). Given a scene context (e.g., 3D scan), SQA3D requires t…
VGStore: A Multimodal Extension to SPARQL for Querying RDF Scene Graph
Yanzeng Li, Zilong Zheng, Wenjuan Han +1
Semantic Web technology has successfully facilitated many RDF models with rich data representation methods. It also has the potential ability to represent and store multimodal know…
Learning Cycle-Consistent Cooperative Networks via Alternating MCMC Teaching for Unsupervised Cross-Domain Translation
Jianwen Xie, Zilong Zheng, Xiaolin Fang +2
This paper studies the unsupervised cross-domain translation problem by proposing a generative framework, in which the probability distribution of each domain is represented by a g…
Generative VoxelNet: Learning Energy-Based Models for 3D Shape Synthesis and Analysis
Jianwen Xie, Zilong Zheng, Ruiqi Gao +3
3D data that contains rich geometry information of objects and scenes is valuable for understanding 3D physical world. With the recent emergence of large-scale 3D datasets, it beco…
Learning Energy-Based Model with Variational Auto-Encoder as Amortized Sampler
Jianwen Xie, Zilong Zheng, Ping Li
Due to the intractable partition function, training energy-based models (EBMs) by maximum likelihood requires Markov chain Monte Carlo (MCMC) sampling to approximate the gradient o…
Joint Inference of States, Robot Knowledge, and Human (False-)Beliefs
Tao Yuan, Hangxin Liu, Lifeng Fan +4
Aiming to understand how human (false-)belief--a core socio-cognitive ability--would affect human interactions with robots, this paper proposes to adopt a graphical model to unify…
Generative PointNet: Deep Energy-Based Learning on Unordered Point Sets for 3D Generation, Reconstruction and Classification
Jianwen Xie, Yifei Xu, Zilong Zheng +2
We propose a generative model of unordered point sets, such as point clouds, in the form of an energy-based model, where the energy function is parameterized by an input-permutatio…
Motion-Based Generator Model: Unsupervised Disentanglement of Appearance, Trackable and Intrackable Motions in Dynamic Patterns
Jianwen Xie, Ruiqi Gao, Zilong Zheng +2
Dynamic patterns are characterized by complex spatial and motion patterns. Understanding dynamic patterns requires a disentangled representational model that separates the factoria…
Reasoning Visual Dialogs with Structural and Partial Observations
Zilong Zheng, Wenguan Wang, Siyuan Qi +1
We propose a novel model to address the task of Visual Dialog which exhibits complex dialog structures. To obtain a reasonable answer based on the current question and the dialog h…
Cooperative Training of Fast Thinking Initializer and Slow Thinking Solver for Conditional Learning
Jianwen Xie, Zilong Zheng, Xiaolin Fang +2
This paper studies the problem of learning the conditional distribution of a high-dimensional output given an input, where the output and input may belong to two different domains,…
Learning Dynamic Generator Model by Alternating Back-Propagation Through Time
Jianwen Xie, Ruiqi Gao, Zilong Zheng +2
This paper studies the dynamic generator model for spatial-temporal processes such as dynamic textures and action sequences in video data. In this model, each time frame of the vid…
Learning Descriptor Networks for 3D Shape Synthesis and Analysis
Jianwen Xie, Zilong Zheng, Ruiqi Gao +3
This paper proposes a 3D shape descriptor network, which is a deep convolutional energy-based model, for modeling volumetric shape patterns. The maximum likelihood training of the…