Learning Deep Morphological Networks with Neural Architecture Search
arXiv:2106.07714 · doi:10.1016/j.patcog.2022.108893
Abstract
Deep Neural Networks (DNNs) are generated by sequentially performing linear and non-linear processes. Using a combination of linear and non-linear procedures is critical for generating a sufficiently deep feature space. The majority of non-linear operators are derivations of activation functions or pooling functions. Mathematical morphology is a branch of mathematics that provides non-linear operators for a variety of image processing problems. We investigate the utility of integrating these operations in an end-to-end deep learning framework in this paper. DNNs are designed to acquire a realistic representation for a particular job. Morphological operators give topological descriptors that convey salient information about the shapes of objects depicted in images. We propose a method based on meta-learning to incorporate morphological operators into DNNs. The learned architecture demonstrates how our novel morphological operations significantly increase DNN performance on various tasks, including picture classification and edge detection.
arXiv comment18 pages
References in corpus (15)
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
- Neural Architecture Search with Reinforcement Learning
- Neural Architecture Search: A Survey
- Richer Convolutional Features for Edge Detection
- A Survey on Evolutionary Neural Architecture Search
- PC-DARTS: Partial Channel Connections for Memory-Efficient Architecture Search
- Deep Networks with Stochastic Depth
- CMA-ES for Hyperparameter Optimization of Deep Neural Networks
- Learning Deep Structured Multi-Scale Features using Attention-Gated CRFs for Contour Prediction
- Deep Crisp Boundaries: From Boundaries to Higher-level Tasks
- ISTA-NAS: Efficient and Consistent Neural Architecture Search by Sparse Coding
- Bayesian Neural Architecture Search using A Training-Free Performance Metric
- Reduced Dilation-Erosion Perceptron for Binary Classification
- DHA: End-to-End Joint Optimization of Data Augmentation Policy, Hyper-parameter and Architecture