6 citations · 24 across the 15 of their papers we have counts for
16 papers
Sensi-BERT: Towards Sensitivity Driven Fine-Tuning for Parameter-Efficient BERT
Souvik Kundu, Sharath Nittur Sridhar, Maciej Szankin +1
Large pre-trained language models have recently gained significant traction due to their improved performance on various down-stream tasks like text classification and question ans…
InstaTune: Instantaneous Neural Architecture Search During Fine-Tuning
Sharath Nittur Sridhar, Souvik Kundu, Sairam Sundaresan +2
One-Shot Neural Architecture Search (NAS) algorithms often rely on training a hardware agnostic super-network for a domain specific task. Optimal sub-networks are then extracted fr…
Svarah: Evaluating English ASR Systems on Indian Accents
Tahir Javed, Sakshi Joshi, Vignesh Nagarajan +6
India is the second largest English-speaking country in the world with a speaker base of roughly 130 million. Thus, it is imperative that automatic speech recognition (ASR) systems…
Vistaar: Diverse Benchmarks and Training Sets for Indian Language ASR
Kaushal Santosh Bhogale, Sai Sundaresan, Abhigyan Raman +3
Improving ASR systems is necessary to make new LLM-based use-cases accessible to people across the globe. In this paper, we focus on Indian languages, and make the case that divers…
Sparse Mixture Once-for-all Adversarial Training for Efficient In-Situ Trade-Off Between Accuracy and Robustness of DNNs
Souvik Kundu, Sairam Sundaresan, Sharath Nittur Sridhar +3
Existing deep neural networks (DNNs) that achieve state-of-the-art (SOTA) performance on both clean and adversarially-perturbed images rely on either activation or weight condition…
SuNeRF: Validation of a 3D Global Reconstruction of the Solar Corona Using Simulated EUV Images
Kyriaki-Margarita Bintsi, Robert Jarolim, Benoit Tremblay +8
Extreme Ultraviolet (EUV) light emitted by the Sun impacts satellite operations and communications and affects the habitability of planets. Currently, EUV-observing instruments are…
A Hardware-Aware Framework for Accelerating Neural Architecture Search Across Modalities
Daniel Cummings, Anthony Sarah, Sharath Nittur Sridhar +3
Recent advances in Neural Architecture Search (NAS) such as one-shot NAS offer the ability to extract specialized hardware-aware sub-network configurations from a task-specific sup…
A Fast and Efficient Conditional Learning for Tunable Trade-Off between Accuracy and Robustness
Souvik Kundu, Sairam Sundaresan, Massoud Pedram +1
Existing models that achieve state-of-the-art (SOTA) performance on both clean and adversarially-perturbed images rely on convolution operations conditioned with feature-wise linea…
Deep-SWIM: A few-shot learning approach to classify Solar WInd Magnetic field structures
Hala Lamdouar, Sairam Sundaresan, Anna Jungbluth +9
The solar wind consists of charged particles ejected from the Sun into interplanetary space and towards Earth. Understanding the magnetic field of the solar wind is crucial for pre…
A Hardware-Aware System for Accelerating Deep Neural Network Optimization
Anthony Sarah, Daniel Cummings, Sharath Nittur Sridhar +4
Recent advances in Neural Architecture Search (NAS) which extract specialized hardware-aware configurations (a.k.a. "sub-networks") from a hardware-agnostic "super-network" have be…
TrimBERT: Tailoring BERT for Trade-offs
Sharath Nittur Sridhar, Anthony Sarah, Sairam Sundaresan
Models based on BERT have been extremely successful in solving a variety of natural language processing (NLP) tasks. Unfortunately, many of these large models require a great deal…
AttentionLite: Towards Efficient Self-Attention Models for Vision
Souvik Kundu, Sairam Sundaresan
We propose a novel framework for producing a class of parameter and compute efficient models called AttentionLitesuitable for resource-constrained applications. Prior work has prim…
Attention-based Image Upsampling
Souvik Kundu, Hesham Mostafa, Sharath Nittur Sridhar +1
Convolutional layers are an integral part of many deep neural network solutions in computer vision. Recent work shows that replacing the standard convolution operation with mechani…
RotNet: Fast and Scalable Estimation of Stellar Rotation Periods Using Convolutional Neural Networks
J. Emmanuel Johnson, Sairam Sundaresan, Tansu Daylan +6
Magnetic activity in stars manifests as dark spots on their surfaces that modulate the brightness observed by telescopes. These light curves contain important information on stella…
Logic2Text: High-Fidelity Natural Language Generation from Logical Forms
Zhiyu Chen, Wenhu Chen, Hanwen Zha +4
Previous works on Natural Language Generation (NLG) from structured data have primarily focused on surface-level descriptions of record sequences. However, for complex structured d…
Compact Scene Graphs for Layout Composition and Patch Retrieval
Subarna Tripathi, Sharath Nittur Sridhar, Sairam Sundaresan +1
Structured representations such as scene graphs serve as an efficient and compact representation that can be used for downstream rendering or retrieval tasks. However, existing eff…