Generation and Simulation of Yeast Microscopy Imagery with Deep Learning

Abstract

Time-lapse fluorescence microscopy (TLFM) is an important and powerful tool in synthetic biological research. Modeling TLFM experiments based on real data may enable researchers to repeat certain experiments with minor effort. This thesis is a study towards deep learning-based modeling of TLFM experiments on the image level. The modeling of TLFM experiments, by way of the example of trapped yeast cells, is split into two tasks. The first task is to generate synthetic image data based on real image data. To approach this problem, a novel generative adversarial network, for conditionalized and unconditionalized image generation, is proposed. The second task is the simulation of brightfield microscopy images over multiple discrete time-steps. To tackle this simulation task an advanced future frame prediction model is introduced. The proposed models are trained and tested on a novel dataset that is presented in this thesis. The obtained results showed that the modeling of TLFM experiments, with deep learning, is a proper approach, but requires future research to effectively model real-world experiments.

References in corpus (27)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
• PyTorch: An Imperative Style, High-Performance Deep Learning Library
• Auto-Encoding Variational Bayes
• TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
• Decoupled Weight Decay Regularization
• Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
• GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
• Spectral Normalization for Generative Adversarial Networks
• Road Extraction by Deep Residual U-Net
• Instance Normalization: The Missing Ingredient for Fast Stylization
• Stochastic Backpropagation and Approximate Inference in Deep Generative Models
• Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)
• FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidence
• Wide Residual Networks
• NIPS 2016 Tutorial: Generative Adversarial Networks
• Which Training Methods for GANs do actually Converge?
• Searching for Activation Functions
• Decomposing Motion and Content for Natural Video Sequence Prediction
• Deep Predictive Coding Networks for Video Prediction and Unsupervised Learning
• NVAE: A Deep Hierarchical Variational Autoencoder
• Axial Attention in Multidimensional Transformers
• MetNet: A Neural Weather Model for Precipitation Forecasting
• Attention-Based Transformers for Instance Segmentation of Cells in Microstructures
• Deep Learning with S-shaped Rectified Linear Activation Units
• Padé Activation Units: End-to-end Learning of Flexible Activation Functions in Deep Networks
• Maximizing Information Gain for the Characterization of Biomolecular Circuits