6 citations · 23 across the 19 of their papers we have counts for
4 papers · 1 filter
Improving the Throughput of Diffusion-based Large Language Models via a Training-Free Confidence-Aware Calibration
Jucheng Shen, Gaurav Sarkar, Yeonju Ro +4
We present CadLLM, a training-free method to accelerate the inference throughput of diffusion-based LLMs (dLLMs). We first investigate the dynamic nature of token unmasking confide…
SimQ-NAS: Simultaneous Quantization Policy and Neural Architecture Search
Sharath Nittur Sridhar, Maciej Szankin, Fang Chen +2
Recent one-shot Neural Architecture Search algorithms rely on training a hardware-agnostic super-network tailored to a specific task and then extracting efficient sub-networks for…
InstaTune: Instantaneous Neural Architecture Search During Fine-Tuning
Sharath Nittur Sridhar, Souvik Kundu, Sairam Sundaresan +2
One-Shot Neural Architecture Search (NAS) algorithms often rely on training a hardware agnostic super-network for a domain specific task. Optimal sub-networks are then extracted fr…
A Hardware-Aware Framework for Accelerating Neural Architecture Search Across Modalities
Daniel Cummings, Anthony Sarah, Sharath Nittur Sridhar +3
Recent advances in Neural Architecture Search (NAS) such as one-shot NAS offer the ability to extract specialized hardware-aware sub-network configurations from a task-specific sup…