NeuNetS: An Automated Synthesis Engine for Neural Network Design
arXiv:1901.06261
Abstract
Application of neural networks to a vast variety of practical applications is transforming the way AI is applied in practice. Pre-trained neural network models available through APIs or capability to custom train pre-built neural network architectures with customer data has made the consumption of AI by developers much simpler and resulted in broad adoption of these complex AI models. While prebuilt network models exist for certain scenarios, to try and meet the constraints that are unique to each application, AI teams need to think about developing custom neural network architectures that can meet the tradeoff between accuracy and memory footprint to achieve the tight constraints of their unique use-cases. However, only a small proportion of data science teams have the skills and experience needed to create a neural network from scratch, and the demand far exceeds the supply. In this paper, we present NeuNetS : An automated Neural Network Synthesis engine for custom neural network design that is available as part of IBM's AI OpenScale's product. NeuNetS is available for both Text and Image domains and can build neural networks for specific tasks in a fraction of the time it takes today with human effort, and with accuracy similar to that of human-designed AI models.
arXiv comment14 pages, 12 figures. arXiv admin note: text overlap with arXiv:1806.00250
References in corpus (14)
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
- Distributed Representations of Words and Phrases and their Compositionality
- Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
- Practical Bayesian Optimization of Machine Learning Algorithms
- A Neural Representation of Sketch Drawings
- Designing Neural Network Architectures using Reinforcement Learning
- Xception: Deep Learning with Depthwise Separable Convolutions
- Snips Voice Platform: an embedded Spoken Language Understanding system for private-by-design voice interfaces
- Progressive Neural Architecture Search
- DeepArchitect: Automatically Designing and Training Deep Architectures
- Peephole: Predicting Network Performance Before Training
- AlphaX: eXploring Neural Architectures with Deep Neural Networks and Monte Carlo Tree Search
- Incremental Training of Deep Convolutional Neural Networks