5 citations · 5 across the 4 of their papers we have counts for
4 papers
NeuralOS: Towards Simulating Operating Systems via Neural Generative Models
Luke Rivard, Sun Sun, Hongyu Guo +2
We introduce NeuralOS, a neural framework that simulates graphical user interfaces (GUIs) of operating systems by directly predicting screen frames in response to user inputs such…
DisProtEdit: Exploring Disentangled Representations for Multi-Attribute Protein Editing
Max Ku, Sun Sun, Hongyu Guo +1
We introduce DisProtEdit, a controllable protein editing framework that leverages dual-channel natural language supervision to learn disentangled representations of structural and…
Referring Expression Instance Retrieval and A Strong End-to-End Baseline
Xiangzhao Hao, Kuan Zhu, Hongyu Guo +5
Using natural language to query visual information is a fundamental need in real-world applications. Text-Image Retrieval (TIR) retrieves a target image from a gallery based on an…
-MICL: Understanding and Generalizing InfoNCE-based Contrastive Learning
Yiwei Lu, Guojun Zhang, Sun Sun +2
In self-supervised contrastive learning, a widely-adopted objective function is InfoNCE, which uses the heuristic cosine similarity for the representation comparison, and is closel…