Ludwig: a type-based declarative deep learning toolbox

Abstract

In this work we present Ludwig, a flexible, extensible and easy to use toolbox which allows users to train deep learning models and use them for obtaining predictions without writing code. Ludwig implements a novel approach to deep learning model building based on two main abstractions: data types and declarative configuration files. The data type abstraction allows for easier code and sub-model reuse, and the standardized interfaces imposed by this abstraction allow for encapsulation and make the code easy to extend. Declarative model definition configuration files enable inexperienced users to obtain effective models and increase the productivity of expert users. Alongside these two innovations, Ludwig introduces a general modularized deep learning architecture called Encoder-Combiner-Decoder that can be instantiated to perform a vast amount of machine learning tasks. These innovations make it possible for engineers, scientists from other fields and, in general, a much broader audience to adopt deep learning models for their tasks, concretely helping in its democratization.

References in corpus (4)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• API design for machine learning software: experiences from the scikit-learn project
• MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems
• Bayesian Optimization of Combinatorial Structures

Cited by in corpus (9)

• On the Opportunities and Risks of Foundation Models
• Review: Deep Learning in Electron Microscopy
• ktrain: A Low-Code Library for Augmented Machine Learning
• Machine Learning applied to Multifrequency Data in Astrophysics: Blazar Classification
• Managing ML Pipelines: Feature Stores and the Coming Wave of Embedding Ecosystems
• FastEstimator: A Deep Learning Library for Fast Prototyping and Productization
• Ember: No-Code Context Enrichment via Similarity-Based Keyless Joins
• Global Tweet Mentions of COVID-19
• PyTorchPipe: a framework for rapid prototyping of pipelines combining language and vision