activity
20222024
most citedGrounded SAM: Assembling Open-World Models for Diverse Visual Tasks

93 citations · 195 across the 16 of their papers we have counts for

collaborators

16 papers

cs.LG2024

Efficient Antibody Structure Refinement Using Energy-Guided SE(3) Flow Matching

Jiying Zhang, Zijing Liu, Shengyuan Bai +3

Antibodies are proteins produced by the immune system that recognize and bind to specific antigens, and their 3D structures are crucial for understanding their binding mechanism an…

cs.CL2024★ 1 cited

SMILES-Prompting: A Novel Approach to LLM Jailbreak Attacks in Chemical Synthesis

Aidan Wong, He Cao, Zijing Liu +1

The increasing integration of large language models (LLMs) across various fields has heightened concerns about their potential to propagate dangerous information. This paper specif…

cs.CL2024

CAPE: A Chinese Dataset for Appraisal-based Emotional Generation using Large Language Models

June M. Liu, He Cao, Renliang Sun +3

Generating emotionally appropriate responses in conversations with large language models presents a significant challenge due to the complexities of human emotions and cognitive pr…

cs.AI2024

Dynamic Guided and Domain Applicable Safeguards for Enhanced Security in Large Language Models

Weidi Luo, He Cao, Zijing Liu +5

With the extensive deployment of Large Language Models (LLMs), ensuring their safety has become increasingly critical. However, existing defense methods often struggle with two key…

cs.LG2024

PRESTO: Progressive Pretraining Enhances Synthetic Chemistry Outcomes

He Cao, Yanjun Shao, Zhiyuan Liu +4

Multimodal Large Language Models (MLLMs) have seen growing adoption across various scientific disciplines. These advancements encourage the investigation of molecule-text modeling…

q-bio.BM2024

ControlMol: Adding Substructure Control To Molecule Diffusion Models

Qi Zhengyang, Liu Zijing, Zhang Jiying +2

Due to the vast design space of molecules, generating molecules conditioned on a specific sub-structure relevant to a particular function or therapeutic target is a crucial task in…

cs.CL2024★ 3 cited

MoleculeQA: A Dataset to Evaluate Factual Accuracy in Molecular Comprehension

Xingyu Lu, He Cao, Zijing Liu +5

Large language models are playing an increasingly significant role in molecular research, yet existing models often generate erroneous information, posing challenges to accurate mo…

cs.CV2024★ 93 cited

Grounded SAM: Assembling Open-World Models for Diverse Visual Tasks

Tianhe Ren, Shilong Liu, Ailing Zeng +14

We introduce Grounded SAM, which uses Grounding DINO as an open-set object detector to combine with the segment anything model (SAM). This integration enables the detection and seg…

q-bio.BM2023★ 14 cited

InstructMol: Multi-Modal Integration for Building a Versatile and Reliable Molecular Assistant in Drug Discovery

He Cao, Zijing Liu, Xingyu Lu +2

The rapid evolution of artificial intelligence in drug discovery encounters challenges with generalization and extensive training, yet Large Language Models (LLMs) offer promise in…

cs.CV2023★ 2 cited

TOSS:High-quality Text-guided Novel View Synthesis from a Single Image

Yukai Shi, Jianan Wang, He Cao +7

In this paper, we present TOSS, which introduces text to the task of novel view synthesis (NVS) from just a single RGB image. While Zero-1-to-3 has demonstrated impressive zero-sho…

cs.CL2023★ 42 cited

ChatCounselor: A Large Language Models for Mental Health Support

June M. Liu, Donghao Li, He Cao +3

This paper presents ChatCounselor, a large language model (LLM) solution designed to provide mental health support. Unlike generic chatbots, ChatCounselor is distinguished by its f…

q-bio.BM2023

Leveraging Side Information for Ligand Conformation Generation using Diffusion-Based Approaches

Jiamin Wu, He Cao, Yuan Yao

Ligand molecule conformation generation is a critical challenge in drug discovery. Deep learning models have been developed to tackle this problem, particularly through the use of…

cs.CV2023★ 15 cited

detrex: Benchmarking Detection Transformers

Tianhe Ren, Shilong Liu, Feng Li +13

The DEtection TRansformer (DETR) algorithm has received considerable attention in the research community and is gradually emerging as a mainstream approach for object detection and…

cs.CV2023★ 16 cited

DreamWaltz: Make a Scene with Complex 3D Animatable Avatars

Yukun Huang, Jianan Wang, Ailing Zeng +5

We present DreamWaltz, a novel framework for generating and animating complex 3D avatars given text guidance and parametric human body prior. While recent methods have shown encour…

cs.LG2023★ 2 cited

Inducing Neural Collapse in Deep Long-tailed Learning

Xuantong Liu, Jianfeng Zhang, Tianyang Hu +3

Although deep neural networks achieve tremendous success on various classification tasks, the generalization ability drops sheer when training datasets exhibit long-tailed distribu…

cs.CV2022★ 7 cited

Exploring Vision Transformers as Diffusion Learners

He Cao, Jianan Wang, Tianhe Ren +4

Score-based diffusion models have captured widespread attention and funded fast progress of recent vision generative tasks. In this paper, we focus on diffusion model backbone whic…