most citedGPT4Tools: Teaching Large Language Model to Use Tools via Self-instruction

33 citations · 34 across the 5 of their papers we have counts for

collaborators

5 papers

cs.CV2023★ 33 cited

GPT4Tools: Teaching Large Language Model to Use Tools via Self-instruction

Rui Yang, Lin Song, Yanwei Li +4

This paper aims to efficiently enable Large Language Models (LLMs) to use multimodal tools. Advanced proprietary LLMs, such as ChatGPT and GPT-4, have shown great potential for too…

cs.CV2023

BoxSnake: Polygonal Instance Segmentation with Box Supervision

Rui Yang, Lin Song, Yixiao Ge +1

Box-supervised instance segmentation has gained much attention as it requires only simple box annotations instead of costly mask or polygon annotations. However, existing box-super…

cs.LG2023★ 1 cited

Robust Representation Learning by Clustering with Bisimulation Metrics for Visual Reinforcement Learning with Distractions

Qiyuan Liu, Qi Zhou, Rui Yang +1

Recent work has shown that representation learning plays a critical role in sample-efficient reinforcement learning (RL) from pixels. Unfortunately, in real-world scenarios, repres…

cs.LG2023

Generalization in Visual Reinforcement Learning with the Reward Sequence Distribution

Jie Wang, Rui Yang, Zijie Geng +7

Generalization in partially observed markov decision processes (POMDPs) is critical for successful applications of visual reinforcement learning (VRL) in real scenarios. A widely u…

cs.CV2022

UniInst: Unique Representation for End-to-End Instance Segmentation

Yimin Ou, Rui Yang, Lufan Ma +5

Existing instance segmentation methods have achieved impressive performance but still suffer from a common dilemma: redundant representations (e.g., multiple boxes, grids, and anch…