2 citations · 3 across the 12 of their papers we have counts for
13 papers
COMPASS: Finding Where Reasoning Lives in Language Models
Pratyay Dutta, Kowshik Thopalli, Vivek Narayanaswamy
Explicitly eliciting reasoning substantially improves LLM performance. Existing approaches require a predefined characterization of reasoning, whether through CoT prompt design, co…
Improving Robustness In Sparse Autoencoders via Masked Regularization
Vivek Narayanaswamy, Kowshik Thopalli, Bhavya Kailkhura +1
Sparse autoencoders (SAEs) are widely used in mechanistic interpretability to project LLM activations onto sparse latent spaces. However, sparsity alone is an imperfect proxy for i…
The Anatomy of Uncertainty in LLMs
Aditya Taparia, Ransalu Senanayake, Kowshik Thopalli +1
Understanding why a large language model (LLM) is uncertain about the response is important for their reliable deployment. Current approaches, which either provide a single uncerta…
Leveraging Registers in Vision Transformers for Robust Adaptation
Srikar Yellapragada, Kowshik Thopalli, Vivek Narayanaswamy +5
Vision Transformers (ViTs) have shown success across a variety of tasks due to their ability to capture global image representations. Recent studies have identified the existence o…
Physics-Informed Transformation Toward Improving the Machine-Learned NLTE Models of ICF Simulations
Min Sang Cho, Paul E. Grabowski, Kowshik Thopalli +11
The integration of machine learning techniques into Inertial Confinement Fusion (ICF) simulations has emerged as a powerful approach for enhancing computational efficiency. By repl…
On The Role of Prompt Construction In Enhancing Efficacy and Efficiency of LLM-Based Tabular Data Generation
Banooqa Banday, Kowshik Thopalli, Tanzima Z. Islam +1
LLM-based data generation for real-world tabular data can be challenged by the lack of sufficient semantic context in feature names used to describe columns. We hypothesize that en…
DECIDER: Leveraging Foundation Model Priors for Improved Model Failure Detection and Explanation
Rakshith Subramanyam, Kowshik Thopalli, Vivek Narayanaswamy +1
Reliably detecting when a deployed machine learning model is likely to fail on a given input is crucial for ensuring safe operation. In this work, we propose DECIDER (Debiasing Cla…
Speeding Up Image Classifiers with Little Companions
Yang Liu, Kowshik Thopalli, Jayaraman Thiagarajan
Scaling up neural networks has been a key recipe to the success of large language and vision models. However, in practice, up-scaled models can be disproportionately costly in term…
On the Use of Anchoring for Training Vision Models
Vivek Narayanaswamy, Kowshik Thopalli, Rushil Anirudh +3
Anchoring is a recent, architecture-agnostic principle for training deep neural networks that has been shown to significantly improve uncertainty estimation, calibration, and extra…
Target-Aware Generative Augmentations for Single-Shot Adaptation
Kowshik Thopalli, Rakshith Subramanyam, Pavan Turaga +1
In this paper, we address the problem of adapting models from a source domain to a target domain, a task that has become increasingly important due to the brittle generalization of…
Single-Shot Domain Adaptation via Target-Aware Generative Augmentation
Rakshith Subramanyam, Kowshik Thopalli, Spring Berman +2
The problem of adapting models from a source domain using data from any target domain of interest has gained prominence, thanks to the brittle generalization in deep neural network…
Domain Alignment Meets Fully Test-Time Adaptation
Kowshik Thopalli, Pavan Turaga, Jayaraman J. Thiagarajan
A foundational requirement of a deployed ML model is to generalize to data drawn from a testing distribution that is different from training. A popular solution to this problem is…
Automated Domain Discovery from Multiple Sources to Improve Zero-Shot Generalization
Kowshik Thopalli, Sameeksha Katoch, Pavan Turaga +1
Domain generalization (DG) methods aim to develop models that generalize to settings where the test distribution is different from the training data. In this paper, we focus on the…