5 citations · 20 across the 11 of their papers we have counts for
5 papers · 1 filter
LLaVA-Gemma: Accelerating Multimodal Foundation Models with a Compact Language Model
Musashi Hinck, Matthew L. Olson, David Cobbley +2
We train a suite of multimodal foundation models (MMFM) using the popular LLaVA framework with the recently released Gemma family of large language models (LLMs). Of particular int…
Multimodal Embeddings from Language Models
Shao-Yen Tseng, Panayiotis Georgiou, Shrikanth Narayanan
Word embeddings such as ELMo have recently been shown to model word semantics with greater efficacy through contextualized learning on large-scale language corpora, resulting in si…
Behavior Gated Language Models
Prashanth Gurunath Shivakumar, Shao-Yen Tseng, Panayiotis Georgiou +1
Most current language modeling techniques only exploit co-occurrence, semantic and syntactic information from the sequence of words. However, a range of information such as the sta…
Predicting Behavior in Cancer-Afflicted Patient and Spouse Interactions using Speech and Language
Sandeep Nallan Chakravarthula, Haoqi Li, Shao-Yen Tseng +2
Cancer impacts the quality of life of those diagnosed as well as their spouse caregivers, in addition to potentially influencing their day-to-day behaviors. There is evidence that…
Unsupervised Online Multitask Learning of Behavioral Sentence Embeddings
Shao-Yen Tseng, Brian Baucom, Panayiotis Georgiou
Unsupervised learning has been an attractive method for easily deriving meaningful data representations from vast amounts of unlabeled data. These representations, or embeddings, o…