activity
20222026
most citedKnowledge-Infused Self Attention Transformers

3 citations · 11 across the 8 of their papers we have counts for

collaborators

9 papers

cs.CL2026

Neuro-symbolic PRM: Enhancing Scientific Reasoning via Structured Traces and Symbolic Verification

Yuxin Zi, Cong Xu, Suparna Bhattacharya +2

While tool-augmented Large Language Models have significantly improved multi-step reasoning in quantitative STEM tasks, a critical residual failure mode remains: intermediate reaso…

cs.CL2025★ 3 cited

Large Language Models for Mental Health Diagnostic Assessments: Exploring The Potential of Large Language Models for Assisting with Mental Health Diagnostic Assessments -- The Depression and Anxiety Case

Kaushik Roy, Harshul Surana, Darssan Eswaramoorthi +4

Large language models (LLMs) are increasingly attracting the attention of healthcare professionals for their potential to assist in diagnostic assessments, which could alleviate th…

cs.CL2023★ 1 cited

RDR: the Recap, Deliberate, and Respond Method for Enhanced Language Understanding

Yuxin Zi, Hariram Veeramani, Kaushik Roy +1

Natural language understanding (NLU) using neural network pipelines often requires additional context that is not solely present in the input data. Through Prior research, it has b…

cs.CL2023★ 2 cited

IERL: Interpretable Ensemble Representation Learning -- Combining CrowdSourced Knowledge and Distributed Semantic Representations

Yuxin Zi, Kaushik Roy, Vignesh Narayanan +2

Large Language Models (LLMs) encode meanings of words in the form of distributed semantics. Distributed semantics capture common statistical patterns among language tokens (words,…

cs.CL2023★ 3 cited

Knowledge-Infused Self Attention Transformers

Kaushik Roy, Yuxin Zi, Vignesh Narayanan +2

Transformer-based language models have achieved impressive success in various natural language processing tasks due to their ability to capture complex dependencies and contextual…

cs.CL2023

Process Knowledge-infused Learning for Clinician-friendly Explanations

Kaushik Roy, Yuxin Zi, Manas Gaur +4

Language models have the potential to assess mental health using social media data. By analyzing online posts and conversations, these models can detect patterns indicating mental…

cs.CL2023★ 1 cited

Cook-Gen: Robust Generative Modeling of Cooking Actions from Recipes

Revathy Venkataramanan, Kaushik Roy, Kanak Raj +4

As people become more aware of their food choices, food computation models have become increasingly popular in assisting people in maintaining healthy eating habits. For example, f…

cs.CL2023

Knowledge Graph Guided Semantic Evaluation of Language Models For User Trust

Kaushik Roy, Tarun Garg, Vedant Palit +3

A fundamental question in natural language processing is - what kind of language structure and semantics is the language model capturing? Graph formats such as knowledge graphs are…

cs.CL2022★ 1 cited

KSAT: Knowledge-infused Self Attention Transformer -- Integrating Multiple Domain-Specific Contexts

Kaushik Roy, Yuxin Zi, Vignesh Narayanan +2

Domain-specific language understanding requires integrating multiple pieces of relevant contextual information. For example, we see both suicide and depression-related behavior (mu…