25 citations · 88 across the 15 of their papers we have counts for
16 papers
L3 Ensembles: Lifelong Learning Approach for Ensemble of Foundational Language Models
Aidin Shiri, Kaushik Roy, Amit Sheth +1
Fine-tuning pre-trained foundational language models (FLM) for specific tasks is often impractical, especially for resource-constrained devices. This necessitates the development o…
IERL: Interpretable Ensemble Representation Learning -- Combining CrowdSourced Knowledge and Distributed Semantic Representations
Yuxin Zi, Kaushik Roy, Vignesh Narayanan +2
Large Language Models (LLMs) encode meanings of words in the form of distributed semantics. Distributed semantics capture common statistical patterns among language tokens (words,…
Knowledge-Infused Self Attention Transformers
Kaushik Roy, Yuxin Zi, Vignesh Narayanan +2
Transformer-based language models have achieved impressive success in various natural language processing tasks due to their ability to capture complex dependencies and contextual…
Social network modeling and applications, a tutorial
Lisette Espín-Noboa, Tiago Peixoto, Fariba Karimi
Social networks have been widely studied over the last century from multiple disciplines to understand societal issues such as inequality in employment rates, managerial performanc…
Process Knowledge-infused Learning for Clinician-friendly Explanations
Kaushik Roy, Yuxin Zi, Manas Gaur +4
Language models have the potential to assess mental health using social media data. By analyzing online posts and conversations, these models can detect patterns indicating mental…
Cook-Gen: Robust Generative Modeling of Cooking Actions from Recipes
Revathy Venkataramanan, Kaushik Roy, Kanak Raj +4
As people become more aware of their food choices, food computation models have become increasingly popular in assisting people in maintaining healthy eating habits. For example, f…
ProKnow: Process Knowledge for Safety Constrained and Explainable Question Generation for Mental Health Diagnostic Assistance
Kaushik Roy, Manas Gaur, Misagh Soltani +3
Current Virtual Mental Health Assistants (VMHAs) provide counseling and suggestive care. They refrain from patient diagnostic assistance because they lack training in safety-constr…
Knowledge Graph Guided Semantic Evaluation of Language Models For User Trust
Kaushik Roy, Tarun Garg, Vedant Palit +3
A fundamental question in natural language processing is - what kind of language structure and semantics is the language model capturing? Graph formats such as knowledge graphs are…
"Can We Detect Substance Use Disorder?": Knowledge and Time Aware Classification on Social Media from Darkweb
Usha Lokala, Orchid Chetia Phukan, Triyasha Ghosh Dastidar +3
Opioid and substance misuse is rampant in the United States today, with the phenomenon known as the "opioid crisis". The relationship between substance use and mental health has be…
KSAT: Knowledge-infused Self Attention Transformer -- Integrating Multiple Domain-Specific Contexts
Kaushik Roy, Yuxin Zi, Vignesh Narayanan +2
Domain-specific language understanding requires integrating multiple pieces of relevant contextual information. For example, we see both suicide and depression-related behavior (mu…
MMTM: Multi-Tasking Multi-Decoder Transformer for Math Word Problems
Keyur Faldu, Amit Sheth, Prashant Kikani +1
Recently, quite a few novel neural architectures were derived to solve math word problems by predicting expression trees. These architectures varied from seq2seq models, including…
Learning to Automate Follow-up Question Generation using Process Knowledge for Depression Triage on Reddit Posts
Shrey Gupta, Anmol Agarwal, Manas Gaur +4
Conversational Agents (CAs) powered with deep language models (DLMs) have shown tremendous promise in the domain of mental health. Prominently, the CAs have been used to provide in…
Exo-SIR: An Epidemiological Model to Analyze the Impact of Exogenous Spread of Infection
Nirmal Kumar Sivaraman, Manas Gaur, Shivansh Baijal +2
Epidemics like Covid-19 and Ebola have impacted people's lives significantly. The impact of mobility of people across the countries or states in the spread of epidemics has been si…
UBERT: A Novel Language Model for Synonymy Prediction at Scale in the UMLS Metathesaurus
Thilini Wijesiriwardene, Vinh Nguyen, Goonmeet Bajaj +7
The UMLS Metathesaurus integrates more than 200 biomedical source vocabularies. During the Metathesaurus construction process, synonymous terms are clustered into concepts by human…
Process Knowledge-infused Learning for Suicidality Assessment on Social Media
Kaushik Roy, Manas Gaur, Qi Zhang +1
Improving the performance and natural language explanations of deep learning algorithms is a priority for adoption by humans in the real world. In several domains, such as healthca…
A Computational Approach to Understand Mental Health from Reddit: Knowledge-aware Multitask Learning Framework
Usha Lokala, Aseem Srivastava, Triyasha Ghosh Dastidar +4
Analyzing gender is critical to study mental health (MH) support in CVD (cardiovascular disease). The existing studies on using social media for extracting MH symptoms consider sym…