activity
20232026
most citedCan Unstructured Pruning Reduce the Depth in Deep Neural Networks?

28 citations · 33 across the 9 of their papers we have counts for

collaborators
Showing cs.LGShow all

8 papers · 1 filter

cs.LG2026

Hoeffding Concept Bottleneck Models with Applications to Overhead Images

Clément Bénard, Manon Arfib, Christophe Labreuche +1

Explainability of deep learning algorithms is critical for computer-vision applications with high-stakes decisions. Concept bottleneck models (CBM) have recently shown promising pe…

cs.LG2024

Memory-Optimized Once-For-All Network

Maxime Girard, Victor Quétu, Samuel Tardieu +2

Deploying Deep Neural Networks (DNNs) on different hardware platforms is challenging due to varying resource constraints. Besides handcrafted approaches aiming at making deep model…

cs.LG2024

LaCoOT: Layer Collapse through Optimal Transport

Victor Quétu, Zhu Liao, Nour Hezbri +2

Although deep neural networks are well-known for their outstanding performance in tackling complex tasks, their hunger for computational resources remains a significant hurdle, pos…

cs.LG2024★ 1 cited

The Simpler The Better: An Entropy-Based Importance Metric To Reduce Neural Networks' Depth

Victor Quétu, Zhu Liao, Enzo Tartaglione

While deep neural networks are highly effective at solving complex tasks, large pre-trained models are commonly employed even to solve consistently simpler downstream tasks, which…

cs.LG2024

Layer Collapse Can be Induced by Unstructured Pruning

Zhu Liao, Victor Quétu, Van-Tam Nguyen +1

Unstructured pruning is a popular compression method for efficiently reducing model parameters. However, while it effectively decreases the number of parameters, it is commonly bel…

cs.LG2023★ 28 cited

Can Unstructured Pruning Reduce the Depth in Deep Neural Networks?

Zhu Liao, Victor Quétu, Van-Tam Nguyen +1

Pruning is a widely used technique for reducing the size of deep neural networks while maintaining their performance. However, such a technique, despite being able to massively com…

cs.LG2023

DSD: Can We Dodge Sparse Double Descent and Compress the Neural Network Worry-Free?

Victor Quétu, Enzo Tartaglione

Neoteric works have shown that modern deep learning models can exhibit a sparse double descent phenomenon. Indeed, as the sparsity of the model increases, the test performance firs…

cs.LG2023★ 2 cited

Can we avoid Double Descent in Deep Neural Networks?

Victor Quétu, Enzo Tartaglione

Finding the optimal size of deep learning models is very actual and of broad impact, especially in energy-saving schemes. Very recently, an unexpected phenomenon, the ``double desc…