1 citations · 1 across the 2 of their papers we have counts for
4 papers
LangVAE and LangSpace: Building and Probing for Language Model VAEs
Danilo S. Carvalho, Yingji Zhang, Harriet Unsworth +1
We present LangVAE, a novel framework for modular construction of variational autoencoders (VAEs) on top of pre-trained large language models (LLMs). Such language model VAEs can e…
Nexus: An Omni-Perceptive And -Interactive Model for Language, Audio, And Vision
Che Liu, Yingji Zhang, Dong Zhang +13
This work proposes an industry-level omni-modal large language model (LLM) pipeline that integrates auditory, visual, and linguistic modalities to overcome challenges such as limit…
Does Table Source Matter? Benchmarking and Improving Multimodal Scientific Table Understanding and Reasoning
Bohao Yang, Yingji Zhang, Dong Liu +2
Recent large language models (LLMs) have advanced table understanding capabilities but rely on converting tables into text sequences. While multimodal large language models (MLLMs)…
Controlled LLM-based Reasoning for Clinical Trial Retrieval
Mael Jullien, Alex Bogatu, Harriet Unsworth +1
Matching patients to clinical trials demands a systematic and reasoned interpretation of documents which require significant expert-level background knowledge, over a complex set o…