activity
20232026
most citedNeuGPT: Unified multi-modal Neural GPT

1 citations · 7 across the 41 of their papers we have counts for

collaborators
Showing 2024Show all

16 papers · 1 filter

cs.CV2024

Not Just Text: Uncovering Vision Modality Typographic Threats in Image Generation Models

Hao Cheng, Erjia Xiao, Jiayan Yang +6

Current image generation models can effortlessly produce high-quality, highly realistic images, but this also increases the risk of misuse. In various Text-to-Image or Image-to-Ima…

cs.CL2024★ 1 cited

NeuGPT: Unified multi-modal Neural GPT

Yiqian Yang, Yiqun Duan, Hyejeong Jo +6

This paper introduces NeuGPT, a groundbreaking multi-modal language generation model designed to harmonize the fragmented landscape of neural recording research. Traditionally, stu…

cs.CV2024

DEL: Discrete Element Learner for Learning 3D Particle Dynamics with Neural Rendering

Jiaxu Wang, Jingkai Sun, Junhao He +4

Learning-based simulators show great potential for simulating particle dynamics when 3D groundtruth is available, but per-particle correspondences are not always accessible. The de…

cs.CV2024

Spiking Neural Network as Adaptive Event Stream Slicer

Jiahang Cao, Mingyuan Sun, Ziqing Wang +4

Event-based cameras are attracting significant interest as they provide rich edge information, high dynamic range, and high temporal resolution. Many state-of-the-art event-based a…

cs.RO2024

Multi-Floor Zero-Shot Object Navigation Policy

Lingfeng Zhang, Hao Wang, Erjia Xiao +4

Object navigation in multi-floor environments presents a formidable challenge in robotics, requiring sophisticated spatial reasoning and adaptive exploration strategies. Traditiona…

cs.CV2024

Manipulation Facing Threats: Evaluating Physical Vulnerabilities in End-to-End Vision Language Action Models

Hao Cheng, Erjia Xiao, Yichi Wang +12

Recently, driven by advancements in Multimodal Large Language Models (MLLMs), Vision Language Action Models (VLAMs) are being proposed to achieve better performance in open-vocabul…

cs.RO2024

Mamba Policy: Towards Efficient 3D Diffusion Policy with Hybrid Selective State Models

Jiahang Cao, Qiang Zhang, Jingkai Sun +11

Diffusion models have been widely employed in the field of 3D manipulation due to their efficient capability to learn distributions, allowing for precise prediction of action traje…

eess.SP2024★ 1 cited

RRAM-Based Bio-Inspired Circuits for Mobile Epileptic Correlation Extraction and Seizure Prediction

Hao Wang, Lingfeng Zhang, Erjia Xiao +3

Non-invasive mobile electroencephalography (EEG) acquisition systems have been utilized for long-term monitoring of seizures, yet they suffer from limited battery life. Resistive r…

cs.RO2024

Query-based Semantic Gaussian Field for Scene Representation in Reinforcement Learning

Jiaxu Wang, Ziyi Zhang, Qiang Zhang +5

Latent scene representation plays a significant role in training reinforcement learning (RL) agents. To obtain good latent vectors describing the scenes, recent works incorporate t…

cs.LG2024

Mamba as Decision Maker: Exploring Multi-scale Sequence Modeling in Offline Reinforcement Learning

Jiahang Cao, Qiang Zhang, Ziqing Wang +8

Sequential modeling has demonstrated remarkable capabilities in offline reinforcement learning (RL), with Decision Transformer (DT) being one of the most notable representatives, a…

cs.CL2024★ 1 cited

MAD: Multi-Alignment MEG-to-Text Decoding

Yiqian Yang, Hyejeong Jo, Yiqun Duan +6

Deciphering language from brain activity is a crucial task in brain-computer interface (BCI) research. Non-invasive cerebral signaling techniques including electroencephalography (…

cs.CV2024

Reinforcement Learning with Generalizable Gaussian Splatting

Jiaxu Wang, Qiang Zhang, Jingkai Sun +7

An excellent representation is crucial for reinforcement learning (RL) performance, especially in vision-based reinforcement learning tasks. The quality of the environment represen…

cs.RO2024

Prompting Multi-Modal Tokens to Enhance End-to-End Autonomous Driving Imitation Learning with LLMs

Yiqun Duan, Qiang Zhang, Renjing Xu

The utilization of Large Language Models (LLMs) within the realm of reinforcement learning, particularly as planners, has garnered a significant degree of attention in recent schol…

cs.RO2024★ 1 cited

TriHelper: Zero-Shot Object Navigation with Dynamic Assistance

Lingfeng Zhang, Qiang Zhang, Hao Wang +4

Navigating toward specific objects in unknown environments without additional training, known as Zero-Shot object navigation, poses a significant challenge in the field of robotics…

cs.CL2024

NeuSpeech: Decode Neural signal as Speech

Yiqian Yang, Yiqun Duan, Qiang Zhang +5

Decoding language from brain dynamics is an important open direction in the realm of brain-computer interface (BCI), especially considering the rapid growth of large language model…

cs.RO2024★ 1 cited

Whole-body Humanoid Robot Locomotion with Human Reference

Qiang Zhang, Peter Cui, David Yan +8

Recently, humanoid robots have made significant advances in their ability to perform challenging tasks due to the deployment of Reinforcement Learning (RL), however, the inherent c…