4 citations · 11 across the 10 of their papers we have counts for
10 papers
LLaMA-NAS: Efficient Neural Architecture Search for Large Language Models
Anthony Sarah, Sharath Nittur Sridhar, Maciej Szankin +1
The abilities of modern large language models (LLMs) in solving natural language processing, complex reasoning, sentiment analysis and other tasks have been extraordinary which has…
CiMNet: Towards Joint Optimization for DNN Architecture and Configuration for Compute-In-Memory Hardware
Souvik Kundu, Anthony Sarah, Vinay Joshi +2
With the recent growth in demand for large-scale deep neural networks, compute in-memory (CiM) has come up as a prominent solution to alleviate bandwidth and on-chip interconnect b…
SimQ-NAS: Simultaneous Quantization Policy and Neural Architecture Search
Sharath Nittur Sridhar, Maciej Szankin, Fang Chen +2
Recent one-shot Neural Architecture Search algorithms rely on training a hardware-agnostic super-network tailored to a specific task and then extracting efficient sub-networks for…
InstaTune: Instantaneous Neural Architecture Search During Fine-Tuning
Sharath Nittur Sridhar, Souvik Kundu, Sairam Sundaresan +2
One-Shot Neural Architecture Search (NAS) algorithms often rely on training a hardware agnostic super-network for a domain specific task. Optimal sub-networks are then extracted fr…
A Hardware-Aware Framework for Accelerating Neural Architecture Search Across Modalities
Daniel Cummings, Anthony Sarah, Sharath Nittur Sridhar +3
Recent advances in Neural Architecture Search (NAS) such as one-shot NAS offer the ability to extract specialized hardware-aware sub-network configurations from a task-specific sup…
Deep-SWIM: A few-shot learning approach to classify Solar WInd Magnetic field structures
Hala Lamdouar, Sairam Sundaresan, Anna Jungbluth +9
The solar wind consists of charged particles ejected from the Sun into interplanetary space and towards Earth. Understanding the magnetic field of the solar wind is crucial for pre…
A Hardware-Aware System for Accelerating Deep Neural Network Optimization
Anthony Sarah, Daniel Cummings, Sharath Nittur Sridhar +4
Recent advances in Neural Architecture Search (NAS) which extract specialized hardware-aware configurations (a.k.a. "sub-networks") from a hardware-agnostic "super-network" have be…
Accelerating Neural Architecture Exploration Across Modalities Using Genetic Algorithms
Daniel Cummings, Sharath Nittur Sridhar, Anthony Sarah +1
Neural architecture search (NAS), the study of automating the discovery of optimal deep neural network architectures for tasks in domains such as computer vision and natural langua…
TrimBERT: Tailoring BERT for Trade-offs
Sharath Nittur Sridhar, Anthony Sarah, Sairam Sundaresan
Models based on BERT have been extremely successful in solving a variety of natural language processing (NLP) tasks. Unfortunately, many of these large models require a great deal…
Undivided Attention: Are Intermediate Layers Necessary for BERT?
Sharath Nittur Sridhar, Anthony Sarah
In recent times, BERT-based models have been extremely successful in solving a variety of natural language processing (NLP) tasks such as reading comprehension, natural language in…