74 citations · 101 across the 15 of their papers we have counts for
15 papers
Physics-Guided Inductive Spatiotemporal Kriging for PM2.5 with Satellite Gradient Constraints
Shuo Wang, Mengfan Teng, Yun Cheng +8
High-resolution mapping of fine particulate matter (PM2.5) is a cornerstone of sustainable urbanism but remains critically hindered by the spatial sparsity of ground monitoring net…
PCDCNet: A Surrogate Model for Air Quality Forecasting with Physical-Chemical Dynamics and Constraints
Shuo Wang, Yun Cheng, Qingye Meng +6
Air quality forecasting (AQF) is critical for public health and environmental management, yet remains challenging due to the complex interplay of emissions, meteorology, and chemic…
Forget the Data and Fine-Tuning! Just Fold the Network to Compress
Dong Wang, Haris Šikić, Lothar Thiele +1
We introduce model folding, a novel data-free model compression technique that merges structurally similar neurons across layers, significantly reducing the model size without the…
Geometric Data Augmentations to Mitigate Distribution Shifts in Pollen Classification from Microscopic Images
Nam Cao, Olga Saukh
Distribution shifts are characterized by differences between the training and test data distributions. They can significantly reduce the accuracy of machine learning models deploye…
REDS: Resource-Efficient Deep Subnetworks for Dynamic Resource Constraints
Francesco Corti, Balz Maag, Joachim Schauer +2
Deep learning models deployed on edge devices frequently encounter resource variability, which arises from fluctuating energy levels, timing constraints, or prioritization of other…
Subspace-Configurable Networks
Dong Wang, Olga Saukh, Xiaoxi He +1
While the deployment of deep learning models on edge devices is increasing, these models often lack robustness when faced with dynamic changes in sensed data. This can be attribute…
DataComp: In search of the next generation of multimodal datasets
Samir Yitzhak Gadre, Gabriel Ilharco, Alex Fang +31
Multimodal datasets are a critical component in recent breakthroughs such as Stable Diffusion and GPT-4, yet their design does not receive the same research attention as model arch…
The Role of Pre-training Data in Transfer Learning
Rahim Entezari, Mitchell Wortsman, Olga Saukh +3
The transfer learning paradigm of model pre-training and subsequent fine-tuning produces high-accuracy models. While most studies recommend scaling the pre-training size to benefit…
REPAIR: REnormalizing Permuted Activations for Interpolation Repair
Keller Jordan, Hanie Sedghi, Olga Saukh +2
In this paper we look into the conjecture of Entezari et al. (2021) which states that if the permutation invariance of neural networks is taken into account, then there is likely n…
Studying the impact of magnitude pruning on contrastive learning methods
Francesco Corti, Rahim Entezari, Sara Hooker +2
We study the impact of different pruning techniques on the representation learned by deep neural networks trained with contrastive loss functions. Our work finds that at high spars…
Understanding the effect of sparsity on neural networks robustness
Lukas Timpl, Rahim Entezari, Hanie Sedghi +2
This paper examines the impact of static sparsity on the robustness of a trained network to weight perturbations, data corruption, and adversarial examples. We show that, up to a c…
Deep Neural Network Pruning for Nuclei Instance Segmentation in Hematoxylin & Eosin-Stained Histological Images
Amirreza Mahbod, Rahim Entezari, Isabella Ellinger +1
Recently, pruning deep neural networks (DNNs) has received a lot of attention for improving accuracy and generalization power, reducing network size, and increasing inference speed…
The Role of Permutation Invariance in Linear Mode Connectivity of Neural Networks
Rahim Entezari, Hanie Sedghi, Olga Saukh +1
In this paper, we conjecture that if the permutation invariance of neural networks is taken into account, SGD solutions will likely have no barrier in the linear interpolation betw…
Interpretable and Transferable Models to Understand the Impact of Lockdown Measures on Local Air Quality
Johanna Einsiedler, Yun Cheng, Franz Papst +1
The COVID-19 related lockdown measures offer a unique opportunity to understand how changes in economic activity and traffic affect ambient air quality and how much pollution reduc…
Class-dependent Compression of Deep Neural Networks
Rahim Entezari, Olga Saukh
Today's deep neural networks require substantial computation resources for their training, storage, and inference, which limits their effective use on resource-constrained devices.…