activity
20142023
most citedLLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Day

231 citations · 247 across the 8 of their papers we have counts for

collaborators

8 papers

cs.CV202312 cited

BiomedJourney: Counterfactual Biomedical Image Generation by Instruction-Learning from Multimodal Patient Journeys

Yu Gu, Jianwei Yang, Naoto Usuyama +5

Rapid progress has been made in instruction-learning for image editing with natural-language instruction, as exemplified by InstructPix2Pix. In biomedicine, such methods can be app…

cs.LG2023

Asynchronous Federated Learning with Incentive Mechanism Based on Contract Theory

Danni Yang, Yun Ji, Zhoubin Kou +2

To address the challenges posed by the heterogeneity inherent in federated learning (FL) and to attract high-quality clients, various incentive mechanisms have been employed. Howev…

cs.CV2023231 cited

LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Day

Chunyuan Li, Cliff Wong, Sheng Zhang +6

Conversational generative AI has demonstrated remarkable promise for empowering biomedical practitioners, but current investigations focus on unimodal text. Multimodal conversation…

cs.CL20231 cited

Generate then Select: Open-ended Visual Question Answering Guided by World Knowledge

Xingyu Fu, Sheng Zhang, Gukyeong Kwon +10

The open-ended Visual Question Answering (VQA) task requires AI models to jointly reason over visual and natural language inputs using world knowledge. Recently, pre-trained Langua…

eess.IV20231 cited

Regularized Shallow Image Prior for Electrical Impedance Tomography

Zhe Liu, Zhou Chen, Qi Wang +2

Untrained Neural Network Prior (UNNP) based algorithms have gained increasing popularity in tomographic imaging, as they offer superior performance compared to hand-crafted priors…

math.OC20222 cited

A Dual Accelerated Method for Online Stochastic Distributed Averaging: From Consensus to Decentralized Policy Evaluation

Sheng Zhang, Ashwin Pananjady, Justin Romberg

Motivated by decentralized sensing and policy evaluation problems, we consider a particular type of distributed stochastic optimization problem over a network, called the online st…