2 citations · 5 across the 13 of their papers we have counts for
13 papers
MUSES: A Benchmark for Prospective Intellectual-Roots Retrieval
Rohan Pandey, Sunjae Kwon, Hong Yu
Scientific discovery depends on finding prior literature that shapes what comes next. Existing retrieval systems optimize for relevance and popularity, often favoring central paper…
ThinkSwitch: Context Distillation with LoRA and Weight Interpolation for Specific-Purpose Reasoning Tasks
Dhruv Saini, Rohan Pandey
Large language models often improve on difficult tasks by spending inference-time compute on a reasoning trace before producing the final answer. That extra computation can be usef…
Poisoning the Watchtower: Prompt Injection Attacks Against LLM-Augmented Security Operations Through Adversarial Log Content
Rohan Pandey, Archit Bhujang
Large language models (LLMs) are increasingly used as analyst assistants in security operations centers (SOCs), where they ingest log and alert data to produce triage labels, incid…
Analyzing the birth-death model of Oncostreams in Glioma, and the effects of Cytochalasin D treatment
Kai Poffenbarger, Rohan Pandey
This research project investigates the critical role of oncostreams in glioma aggressiveness, leveraging advanced ex-vivo 3D explants and in-vivo intravital imaging techniques to e…
gzip Predicts Data-dependent Scaling Laws
Rohan Pandey
Past work has established scaling laws that predict the performance of a neural language model (LM) as a function of its parameter count and the number of tokens it's trained on, e…
The Möbius function of the poset of triangular numbers under divisibility
Rohan Pandey, Harry Richman
This paper analyzes the Möbius () function defined on the partially ordered set of triangular numbers () under the divisibility relation. We make conjectures o…
Towards Vision-Language Mechanistic Interpretability: A Causal Tracing Tool for BLIP
Vedant Palit, Rohan Pandey, Aryaman Arora +1
Mechanistic interpretability seeks to understand the neural mechanisms that enable specific behaviors in Large Language Models (LLMs) by leveraging causality-based methods. While t…
Athena 2.0: Discourse and User Modeling in Open Domain Dialogue
Omkar Patil, Lena Reed, Kevin K. Bowden +12
Conversational agents are consistently growing in popularity and many people interact with them every day. While many conversational agents act as personal assistants, they can hav…
Multimodal Learning Without Labeled Multimodal Data: Guarantees and Applications
Paul Pu Liang, Chun Kai Ling, Yun Cheng +6
In many machine learning systems that jointly learn from multiple modalities, a core research question is to understand the nature of multimodal interactions: how modalities combin…
Semantic Composition in Visually Grounded Language Models
Rohan Pandey
What is sentence meaning and its ideal representation? Much of the expressive power of human language derives from semantic composition, the mind's ability to represent meaning hie…
Syntax-guided Neural Module Distillation to Probe Compositionality in Sentence Embeddings
Rohan Pandey
Past work probing compositionality in sentence embedding models faces issues determining the causal impact of implicit syntax representations. Given a sentence, we construct a neur…
Cross-modal Attention Congruence Regularization for Vision-Language Relation Alignment
Rohan Pandey, Rulin Shao, Paul Pu Liang +2
Despite recent progress towards scaling up multimodal vision-language models, these models are still known to struggle on compositional generalization benchmarks such as Winoground…
Athena 2.0: Contextualized Dialogue Management for an Alexa Prize SocialBot
Juraj Juraska, Kevin K. Bowden, Lena Reed +12
Athena 2.0 is an Alexa Prize SocialBot that has been a finalist in the last two Alexa Prize Grand Challenges. One reason for Athena's success is its novel dialogue management strat…