504 citations · 577 across the 17 of their papers we have counts for
4 papers · 1 filter
BREATHE: Second-Order Gradients and Heteroscedastic Emulation based Design Space Exploration
Shikhar Tuli, Niraj K. Jha
Researchers constantly strive to explore larger and more complex search spaces in various scientific studies and physical experiments. However, such investigations often involve so…
TransCODE: Co-design of Transformers and Accelerators for Efficient Training and Inference
Shikhar Tuli, Niraj K. Jha
Automated co-design of machine learning models and evaluation hardware is critical for efficiently deploying such models at scale. Despite the state-of-the-art performance of trans…
EdgeTran: Co-designing Transformers for Efficient Inference on Mobile Edge Platforms
Shikhar Tuli, Niraj K. Jha
Automated design of efficient transformer models has recently attracted significant attention from industry and academia. However, most works only focus on certain metrics while se…
AccelTran: A Sparsity-Aware Accelerator for Dynamic Inference with Transformers
Shikhar Tuli, Niraj K. Jha
Self-attention-based transformer models have achieved tremendous success in the domain of natural language processing. Despite their efficacy, accelerating the transformer is chall…