Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding
arXiv:1510.00149
Abstract
Neural networks are both computationally intensive and memory intensive, making them difficult to deploy on embedded systems with limited hardware resources. To address this limitation, we introduce "deep compression", a three stage pipeline: pruning, trained quantization and Huffman coding, that work together to reduce the storage requirement of neural networks by 35x to 49x without affecting their accuracy. Our method first prunes the network by learning only the important connections. Next, we quantize the weights to enforce weight sharing, finally, we apply Huffman coding. After the first two steps we retrain the network to fine tune the remaining connections and the quantized centroids. Pruning, reduces the number of connections by 9x to 13x; Quantization then reduces the number of bits that represent each connection from 32 to 5. On the ImageNet dataset, our method reduced the storage required by AlexNet by 35x, from 240MB to 6.9MB, without loss of accuracy. Our method reduced the size of VGG-16 by 49x from 552MB to 11.3MB, again with no loss of accuracy. This allows fitting the model into on-chip SRAM cache rather than off-chip DRAM memory. Our compression method also facilitates the use of complex neural networks in mobile applications where application size and download bandwidth are constrained. Benchmarked on CPU, GPU and mobile GPU, compressed network has 3x to 4x layerwise speedup and 3x to 7x better energy efficiency.
arXiv commentPublished as a conference paper at ICLR 2016 (oral)
References in corpus (10)
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- Caffe: Convolutional Architecture for Fast Feature Embedding
- Exploiting Linear Structure Within Convolutional Networks for Efficient Evaluation
- Going Deeper with Convolutions
- Compressing Deep Convolutional Networks using Vector Quantization
- Predicting Parameters in Deep Learning
- Compressing Neural Networks with the Hashing Trick
- Provable Bounds for Learning Some Deep Representations
- Memory Bounded Deep Convolutional Networks
- Deep Fried Convnets
Cited by in corpus (316)
- MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
- Convergence of Edge Computing and Deep Learning: A Comprehensive Survey
- Deep Multi-modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and Challenges
- Deep Face Recognition: A Survey
- Benchmark Analysis of Representative Deep Neural Network Architectures
- Trained Ternary Quantization
- Efficient Deep Learning: A Survey on Making Deep Learning Models Smaller, Faster, and Better
- FPGA-based Accelerators of Deep Learning Networks for Learning and Classification: A Review
- A Systematic DNN Weight Pruning Framework using Alternating Direction Method of Multipliers
- Q8BERT: Quantized 8Bit BERT
- SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning
- Fast-SCNN: Fast Semantic Segmentation Network
- Channel Pruning for Accelerating Very Deep Neural Networks
- SpArch: Efficient Architecture for Sparse Matrix Multiplication
- Model compression via distillation and quantization
- Machine Learning for Microcontroller-Class Hardware: A Review
- Radar-Camera Fusion for Object Detection and Semantic Segmentation in Autonomous Driving: A Comprehensive Review
- A Microprocessor implemented in 65nm CMOS with Configurable and Bit-scalable Accelerator for Programmable In-memory Computing
- Learning New Physics from a Machine
- Driver Drowsiness Detection Model Using Convolutional Neural Networks Techniques for Android Application
- GhostNets on Heterogeneous Devices via Cheap Operations
- Empowering Edge Intelligence: A Comprehensive Survey on On-Device AI Models
- QuantumNAS: Noise-Adaptive Search for Robust Quantum Circuits
- CirCNN: Accelerating and Compressing Deep Neural Networks Using Block-CirculantWeight Matrices
- Tiny Machine Learning: Progress and Futures
- The NLP Cookbook: Modern Recipes for Transformer based Deep Learning Architectures
- JALAD: Joint Accuracy- and Latency-Aware Deep Structure Decoupling for Edge-Cloud Execution
- Apprentice: Using Knowledge Distillation Techniques To Improve Low-Precision Network Accuracy
- Distilled Siamese Networks for Visual Tracking
- Automatic Sleep Staging of EEG Signals: Recent Development, Challenges, and Future Directions
- FETCH: A deep-learning based classifier for fast transient classification
- Exploring Sparsity in Recurrent Neural Networks
- Faster CNNs with Direct Sparse Convolutions and Guided Pruning
- SCNN: An Accelerator for Compressed-sparse Convolutional Neural Networks
- A Theoretical Analysis of Deep Q-Learning
- Learning Intrinsic Sparse Structures within Long Short-Term Memory
- Reinventing 2D Convolutions for 3D Images
- Compression of Deep Convolutional Neural Networks for Fast and Low Power Mobile Applications
- Light-Weight RefineNet for Real-Time Semantic Segmentation
- Hardware Acceleration of Sparse and Irregular Tensor Computations of ML Models: A Survey and Insights
- A Survey on Approximate Edge AI for Energy Efficient Autonomous Driving Services
- Deep Learning Methods for Fingerprint-Based Indoor Positioning: A Review
- Layer-specific Optimization for Mixed Data Flow with Mixed Precision in FPGA Design for CNN-based Object Detectors
- Accelerator-Aware Pruning for Convolutional Neural Networks
- Dual Dynamic Inference: Enabling More Efficient, Adaptive and Controllable Deep Inference
- A TinyML Platform for On-Device Continual Learning with Quantized Latent Replays
- Deep Learning Methods for Solving Linear Inverse Problems: Research Directions and Paradigms
- Robust Ultra-wideband Range Error Mitigation with Deep Learning at the Edge
- A Low Effort Approach to Structured CNN Design Using PCA
- The Global Landscape of Neural Networks: An Overview
- FSpiNN: An Optimization Framework for Memory- and Energy-Efficient Spiking Neural Networks
- The unreasonable effectiveness of the forget gate
- Soft Filter Pruning for Accelerating Deep Convolutional Neural Networks
- Federated Learning for Healthcare Informatics
- AddNet: Deep Neural Networks Using FPGA-Optimized Multipliers
- Shape-based Magnetic Domain Wall Drift for an Artificial Spintronic Leaky Integrate-and-Fire Neuron
- Deep Learning with Low Precision by Half-wave Gaussian Quantization
- Filter Pruning by Switching to Neighboring CNNs with Good Attributes
- Integrated Photonic Tensor Processing Unit for a Matrix Multiply: a Review
- EdgeDRNN: Recurrent Neural Network Accelerator for Edge Inference
- Sobolev Training for Neural Networks
- Feature Pyramid and Hierarchical Boosting Network for Pavement Crack Detection
- Real-Time Decoding for Fault-Tolerant Quantum Computing: Progress, Challenges and Outlook
- MaskConnect: Connectivity Learning by Gradient Descent
- Cluster Pruning: An Efficient Filter Pruning Method for Edge AI Vision Applications
- EDropout: Energy-Based Dropout and Pruning of Deep Neural Networks
- Sparsity through evolutionary pruning prevents neuronal networks from overfitting
- Reducing Computational Complexity of Neural Networks in Optical Channel Equalization: From Concepts to Implementation
- Edge Deep Learning for Neural Implants
- Insights on representational similarity in neural networks with canonical correlation
- FermiNets: Learning generative machines to generate efficient neural networks via generative synthesis
- Lets keep it simple, Using simple architectures to outperform deeper and more complex architectures
- Lightweight Modules for Efficient Deep Learning based Image Restoration
- Compacting Deep Neural Networks for Internet of Things: Methods and Applications
- Automated Pruning for Deep Neural Network Compression
- Crossbar-aware neural network pruning
- PruneTrain: Fast Neural Network Training by Dynamic Sparse Model Reconfiguration
- Towards Energy-Efficient and Secure Edge AI: A Cross-Layer Framework
- DFTerNet: Towards 2-bit Dynamic Fusion Networks for Accurate Human Activity Recognition
- MEC: Memory-efficient Convolution for Deep Neural Network
- Flare: Flexible In-Network Allreduce
- MobileFaceNets: Efficient CNNs for Accurate Real-Time Face Verification on Mobile Devices
- Revisiting Efficient Multi-Step Nonlinearity Compensation with Machine Learning: An Experimental Demonstration
- Efficient Sparse-Winograd Convolutional Neural Networks
- Data Shuffling in Wireless Distributed Computing via Low-Rank Optimization
- BitWave: Exploiting Column-Based Bit-Level Sparsity for Deep Learning Acceleration
- Back to Simplicity: How to Train Accurate BNNs from Scratch?
- Distilling Object Detectors with Task Adaptive Regularization
- Compression of Recurrent Neural Networks for Efficient Language Modeling
- Model Pruning Enables Localized and Efficient Federated Learning for Yield Forecasting and Data Sharing
- Delta Networks for Optimized Recurrent Network Computation
- DeLTA: GPU Performance Model for Deep Learning Applications with In-depth Memory System Traffic Analysis
- Mobile Video Object Detection with Temporally-Aware Feature Maps
- Long short-term memory networks for proton dose calculation in highly heterogeneous tissues
- PoPS: Policy Pruning and Shrinking for Deep Reinforcement Learning
- BlockDrop: Dynamic Inference Paths in Residual Networks
- Multi-Kernel Prediction Networks for Denoising of Burst Images
- ReSpawn: Energy-Efficient Fault-Tolerance for Spiking Neural Networks considering Unreliable Memories
- Structured Pruning of Deep Convolutional Neural Networks
- TinyissimoYOLO: A Quantized, Low-Memory Footprint, TinyML Object Detection Network for Low Power Microcontrollers
- LiteHAR: Lightweight Human Activity Recognition from WiFi Signals with Random Convolution Kernels
- Compact Deep Convolutional Neural Networks With Coarse Pruning
- Complexity-Driven CNN Compression for Resource-constrained Edge AI
- WoodFisher: Efficient Second-Order Approximation for Neural Network Compression
- A Learning Framework for n-bit Quantized Neural Networks toward FPGAs
- Sparsely-Connected Neural Networks: Towards Efficient VLSI Implementation of Deep Neural Networks
- AxTrain: Hardware-Oriented Neural Network Training for Approximate Inference
- Quality Resilient Deep Neural Networks
- Towards Efficient Training for Neural Network Quantization
- Neural Networks Compression for Language Modeling
- ExPAN(N)D: Exploring Posits for Efficient Artificial Neural Network Design in FPGA-based Systems
- Quantized Convolutional Neural Networks for Mobile Devices
- FPUS23: An Ultrasound Fetus Phantom Dataset with Deep Neural Network Evaluations for Fetus Orientations, Fetal Planes, and Anatomical Features
- Training Competitive Binary Neural Networks from Scratch
- Feature Fusion for Online Mutual Knowledge Distillation
- AnycostFL: Efficient On-Demand Federated Learning over Heterogeneous Edge Devices
- Accurate Optical Flow via Direct Cost Volume Processing
- Towards Transmission-Friendly and Robust CNN Models over Cloud and Device
- Learning Sensor Multiplexing Design through Back-propagation
- Overcoming Challenges in Fixed Point Training of Deep Convolutional Networks
- Learning Sparse Low-Precision Neural Networks With Learnable Regularization
- Throughput Optimizations for FPGA-based Deep Neural Network Inference
- IGCV3: Interleaved Low-Rank Group Convolutions for Efficient Deep Neural Networks
- One Size Does Not Fit All: Quantifying and Exposing the Accuracy-Latency Trade-off in Machine Learning Cloud Service APIs via Tolerance Tiers
- Efficient Quantized Sparse Matrix Operations on Tensor Cores
- MARS: Multi-macro Architecture SRAM CIM-Based Accelerator with Co-designed Compressed Neural Networks
- Task dependent Deep LDA pruning of neural networks
- Joint Multi-Dimension Pruning via Numerical Gradient Update
- Run-Time Efficient RNN Compression for Inference on Edge Devices
- Towards On-Device AI and Blockchain for 6G enabled Agricultural Supply-chain Management
- APQ: Joint Search for Network Architecture, Pruning and Quantization Policy
- Loss-Aware Automatic Selection of Structured Pruning Criteria for Deep Neural Network Acceleration
- Probing transfer learning with a model of synthetic correlated datasets
- BioNetExplorer: Architecture-Space Exploration of Bio-Signal Processing Deep Neural Networks for Wearables
- Deep Generative Modeling for Scene Synthesis via Hybrid Representations
- Degree-Quant: Quantization-Aware Training for Graph Neural Networks
- Improved Techniques for Training Adaptive Deep Networks
- Touché: Towards Ideal and Efficient Cache Compression By Mitigating Tag Area Overheads
- CATBERT: Context-Aware Tiny BERT for Detecting Social Engineering Emails
- Flexible and Fully Quantized Ultra-Lightweight TinyissimoYOLO for Ultra-Low-Power Edge Systems
- Evolutionary Synthesis of Deep Neural Networks via Synaptic Cluster-driven Genetic Encoding
- Efficient Visual Recognition with Deep Neural Networks: A Survey on Recent Advances and New Directions
- -ARM: Network Sparsification via Stochastic Binary Optimization
- Optimizing Dense Feed-Forward Neural Networks
- Mixed Precision Low-bit Quantization of Neural Network Language Models for Speech Recognition
- FedGreen: Federated Learning with Fine-Grained Gradient Compression for Green Mobile Edge Computing
- Few Sample Knowledge Distillation for Efficient Network Compression
- Transfer Learning for the Efficient Detection of COVID-19 from Smartphone Audio Data
- Hardware-Centric AutoML for Mixed-Precision Quantization
- Dynamic Hard Pruning of Neural Networks at the Edge of the Internet
- Iteratively Training Look-Up Tables for Network Quantization
- SLAQ: Quality-Driven Scheduling for Distributed Machine Learning
- Exploiting Errors for Efficiency: A Survey from Circuits to Algorithms
- ExSample: Efficient Searches on Video Repositories through Adaptive Sampling
- Biased Mixtures Of Experts: Enabling Computer Vision Inference Under Data Transfer Limitations
- OnDev-LCT: On-Device Lightweight Convolutional Transformers towards federated learning
- On Quantizing Implicit Neural Representations
- KTAN: Knowledge Transfer Adversarial Network
- Exploring the Design Space of Deep Convolutional Neural Networks at Large Scale
- Channel-wise Mixed-precision Assignment for DNN Inference on Constrained Edge Nodes
- A Novel IoT Trust Model Leveraging Fully Distributed Behavioral Fingerprinting and Secure Delegation
- Restricted Recurrent Neural Networks
- Trained Rank Pruning for Efficient Deep Neural Networks
- An Empirical Analysis of the Impact of Data Augmentation on Knowledge Distillation
- Pruning via Iterative Ranking of Sensitivity Statistics
- VEDLIoT: Very Efficient Deep Learning in IoT
- Neural network relief: a pruning algorithm based on neural activity
- Frank-Wolfe Network: An Interpretable Deep Structure for Non-Sparse Coding
- A Highly Parallel FPGA Implementation of Sparse Neural Network Training
- BoolNet: Minimizing The Energy Consumption of Binary Neural Networks
- Intermittent Learning: On-Device Machine Learning on Intermittently Powered System
- FedDCT: Federated Learning of Large Convolutional Neural Networks on Resource Constrained Devices using Divide and Collaborative Training
- Exploring Automatic Gym Workouts Recognition Locally On Wearable Resource-Constrained Devices
- Sauron U-Net: Simple automated redundancy elimination in medical image segmentation via filter pruning
- The Convergence of Machine Learning and Communications
- Deep Ensembling with No Overhead for either Training or Testing: The All-Round Blessings of Dynamic Sparsity
- LCNN: Lookup-based Convolutional Neural Network
- Accelerating and Compressing Deep Neural Networks for Massive MIMO CSI Feedback
- JSDoop and TensorFlow.js: Volunteer Distributed Web Browser-Based Neural Network Training
- Understanding Generalization in Deep Learning via Tensor Methods
- FxP-QNet: A Post-Training Quantizer for the Design of Mixed Low-Precision DNNs with Dynamic Fixed-Point Representation
- Coordinating Filters for Faster Deep Neural Networks
- ECM: Early Exit via Class Means for Efficient Supervised and Unsupervised Learning
- Automated Design Space Exploration for optimised Deployment of DNN on Arm Cortex-A CPUs
- Constrained Deep Learning using Conditional Gradient and Applications in Computer Vision
- Edge-Cloud Cooperation for DNN Inference via Reinforcement Learning and Supervised Learning
- Joint Pruning & Quantization for Extremely Sparse Neural Networks
- Federated Learning for Commercial Image Sources
- Improving Neural Network Training using Dynamic Learning Rate Schedule for PINNs and Image Classification
- Progressive Neural Compression for Adaptive Image Offloading under Timing Constraints
- Real-Time Execution of Large-scale Language Models on Mobile
- Tensor Contraction Layers for Parsimonious Deep Nets
- ASP Vision: Optically Computing the First Layer of Convolutional Neural Networks using Angle Sensitive Pixels
- On-FPGA Training with Ultra Memory Reduction: A Low-Precision Tensor Method
- Applying the Residue Number System to Network Inference
- SymbolNet: Neural Symbolic Regression with Adaptive Dynamic Pruning for Compression
- SmartSplit: Latency-Energy-Memory Optimisation for CNN Splitting on Smartphone Environment
- HEMP: High-order Entropy Minimization for neural network comPression
- Effective Training of Convolutional Neural Networks with Low-bitwidth Weights and Activations
- Channel-wise Hessian Aware trace-Weighted Quantization of Neural Networks
- Espresso: Efficient Forward Propagation for BCNNs
- Depthwise Multiception Convolution for Reducing Network Parameters without Sacrificing Accuracy
- Accelerating Monte Carlo Bayesian Inference via Approximating Predictive Uncertainty over Simplex
- Improving Neural Network with Uniform Sparse Connectivity
- Latency-Constrained DNN Architecture Learning for Edge Systems using Zerorized Batch Normalization
- Low-Power Object Counting with Hierarchical Neural Networks
- PTEENet: Post-Trained Early-Exit Neural Networks Augmentation for Inference Cost Optimization
- Topological Persistence Guided Knowledge Distillation for Wearable Sensor Data
- Learning Versatile Convolution Filters for Efficient Visual Recognition
- Memristor-based Deep Convolution Neural Network: A Case Study
- PURSUhInT: In Search of Informative Hint Points Based on Layer Clustering for Knowledge Distillation
- Interleaver Design for Deep Neural Networks
- Streamlining Tensor and Network Pruning in PyTorch
- VLCQ: Post-training quantization for deep neural networks using variable length coding
- Deep Spiking Neural Networks for Large Vocabulary Automatic Speech Recognition
- PCNN: Pattern-based Fine-Grained Regular Pruning towards Optimizing CNN Accelerators
- Improving Neural Network Training in Low Dimensional Random Bases
- Partition Pruning: Parallelization-Aware Pruning for Deep Neural Networks
- Enabling Embedded Inference Engine with ARM Compute Library: A Case Study
- On the efficient representation and execution of deep acoustic models
- Demystifying Neural Network Filter Pruning
- At-Scale Evaluation of Weight Clustering to Enable Energy-Efficient Object Detection
- BiQGEMM: Matrix Multiplication with Lookup Table For Binary-Coding-based Quantized DNNs
- Weight Pruning via Adaptive Sparsity Loss
- Harmonic Networks: Integrating Spectral Information into CNNs
- Learning Efficient Convolutional Networks through Irregular Convolutional Kernels
- Convergence of a Relaxed Variable Splitting Method for Learning Sparse Neural Networks via , and transformed- Penalties
- Knowledge Distillation Under Ideal Joint Classifier Assumption
- CRAFT: Criticality-Aware Fault-Tolerance Enhancement Techniques for Emerging Memories-Based Deep Neural Networks
- Exploiting Channel Similarity for Accelerating Deep Convolutional Neural Networks
- QuickNet: Maximizing Efficiency and Efficacy in Deep Architectures
- Compressing Gradient Optimizers via Count-Sketches
- High Performance Convolution Using Sparsity and Patterns for Inference in Deep Convolutional Neural Networks
- Statistical Model Compression for Small-Footprint Natural Language Understanding
- Exploring Weight Importance and Hessian Bias in Model Pruning
- Hardware-software co-exploration with racetrack memory based in-memory computing for CNN inference in embedded systems
- Compressed Learning of Deep Neural Networks for OpenCL-Capable Embedded Systems
- SparCE: Sparsity aware General Purpose Core Extensions to Accelerate Deep Neural Networks
- Powers of layers for image-to-image translation
- CNN Acceleration by Low-rank Approximation with Quantized Factors
- Pufferfish: Communication-efficient Models At No Extra Cost
- LegoNet: Memory Footprint Reduction Through Block Weight Clustering
- HG-Caffe: Mobile and Embedded Neural Network GPU (OpenCL) Inference Engine with FP16 Supporting
- Pruning and Slicing Neural Networks using Formal Verification
- A Winning Hand: Compressing Deep Networks Can Improve Out-Of-Distribution Robustness
- A New Clustering-Based Technique for the Acceleration of Deep Convolutional Networks
- STH: Spatio-Temporal Hybrid Convolution for Efficient Action Recognition
- REPrune: Filter Pruning via Representative Election
- Jointly Optimizing Preprocessing and Inference for DNN-based Visual Analytics
- Distilling with Performance Enhanced Students
- GroupReduce: Block-Wise Low-Rank Approximation for Neural Language Model Shrinking
- On Iterative Neural Network Pruning, Reinitialization, and the Similarity of Masks
- Graph DNA: Deep Neighborhood Aware Graph Encoding for Collaborative Filtering
- Pruning Convolutional Neural Networks for Image Instance Retrieval
- Learning Sparse & Ternary Neural Networks with Entropy-Constrained Trained Ternarization (EC2T)
- Efficient Integer-Arithmetic-Only Convolutional Neural Networks
- HALP: Hardware-Aware Latency Pruning
- EasyConvPooling: Random Pooling with Easy Convolution for Accelerating Training and Testing
- Neural Machine Translation with 4-Bit Precision and Beyond
- Active Subspace of Neural Networks: Structural Analysis and Universal Attacks
- Automated Backend-Aware Post-Training Quantization
- Model order reduction with neural networks: Application to laminar and turbulent flows
- Activation Density driven Energy-Efficient Pruning in Training
- Hierarchical compositional feature learning
- SEVEN: Pruning Transformer Model by Reserving Sentinels
- Multi-modal Experts Network for Autonomous Driving
- DCentNet: Decentralized Multistage Biomedical Signal Classification using Early Exits
- Visual Confusion Label Tree For Image Classification
- Network Automatic Pruning: Start NAP and Take a Nap
- Graph Neural Networks Including Sparse Interpretability
- Towards Collaborative Intelligence Friendly Architectures for Deep Learning
- Training Sparse Neural Networks using Compressed Sensing
- Compression and Localization in Reinforcement Learning for ATARI Games
- ATCN: Resource-Efficient Processing of Time Series on Edge
- Extending Label Smoothing Regularization with Self-Knowledge Distillation
- Leveraging Structured Pruning of Convolutional Neural Networks
- Bespoke vs. Prêt-à-Porter Lottery Tickets: Exploiting Mask Similarity for Trainable Sub-Network Finding
- Exploiting Weight Redundancy in CNNs: Beyond Pruning and Quantization
- Latency-Memory Optimized Splitting of Convolution Neural Networks for Resource Constrained Edge Devices
- Fixed-point optimization of deep neural networks with adaptive step size retraining
- RTN: Reparameterized Ternary Network
- RISC-NN: Use RISC, NOT CISC as Neural Network Hardware Infrastructure
- Efficient Inferencing of Compressed Deep Neural Networks
- MultiTASC++: A Continuously Adaptive Scheduler for Edge-Based Multi-Device Cascade Inference
- MOFHEI: Model Optimizing Framework for Fast and Efficient Homomorphically Encrypted Neural Network Inference
- Blind Adversarial Pruning: Balance Accuracy, Efficiency and Robustness
- SIPA: A Simple Framework for Efficient Networks
- AutoPruning for Deep Neural Network with Dynamic Channel Masking
- Mitigate Parasitic Resistance in Resistive Crossbar-based Convolutional Neural Networks
- A scalable convolutional neural network for task-specified scenarios via knowledge distillation
- Towards Accurate and High-Speed Spiking Neuromorphic Systems with Data Quantization-Aware Deep Networks
- Sparse Persistent RNNs: Squeezing Large Recurrent Networks On-Chip
- Mining the Weights Knowledge for Optimizing Neural Network Structures
- Towards Accurate Quantization and Pruning via Data-free Knowledge Transfer
- An Approximation Algorithm for Optimal Subarchitecture Extraction
- A Survey on GAN Acceleration Using Memory Compression Technique
- FLASH: Fast Neural Architecture Search with Hardware Optimization
- Data-free mixed-precision quantization using novel sensitivity metric
- Accelerator-Aware Training for Transducer-Based Speech Recognition
- Rethinking Empirical Evaluation of Adversarial Robustness Using First-Order Attack Methods
- Constrained-size Tensorflow Models for YouTube-8M Video Understanding Challenge
- KCP: Kernel Cluster Pruning for Dense Labeling Neural Networks
- SmartDeal: Re-Modeling Deep Network Weights for Efficient Inference and Training
- The Future of Intelligent Wavefront Shaping for Smart Radio Environments
- Supporting Massive DLRM Inference Through Software Defined Memory
- FPGA Implementations of 3D-SIMD Processor Architecture for Deep Neural Networks Using Relative Indexed Compressed Sparse Filter Encoding Format and Stacked Filters Stationary Flow
- Cyber-Secure Wearable, Ultra-Low-Power Networked Sensors for Soldier Health Monitoring: Insights from the CAPSARII project
- Multi-objective Evolutionary Approach for Efficient Kernel Size and Shape for CNN
- A Comparative Study of Neural Network Compression
- Deep Compression for PyTorch Model Deployment on Microcontrollers
- Filter Pre-Pruning for Improved Fine-tuning of Quantized Deep Neural Networks
- clcNet: Improving the Efficiency of Convolutional Neural Network using Channel Local Convolutions
- Stacked Filters Stationary Flow For Hardware-Oriented Acceleration Of Deep Convolutional Neural Networks
- Prune the Convolutional Neural Networks with Sparse Shrink
- Grow-Push-Prune: aligning deep discriminants for effective structural network compression
- Class-Discriminative CNN Compression