35 citations · 69 across the 12 of their papers we have counts for
14 papers
Ensembles of Neural Surrogates for Parametric Sensitivity in Ocean Modeling
Yixuan Sun, Romain Egele, Sri Hari Krishna Narayanan +6
Accurate simulations of the oceans are crucial in understanding the Earth system. Despite their efficiency, simulations at lower resolutions must rely on various uncertain paramete…
AI Competitions and Benchmarks: Dataset Development
Romain Egele, Julio C. S. Jacques Junior, Jan N. van Rijn +7
Machine learning is now used in many applications thanks to its ability to predict, generate, or discover patterns from large quantities of data. However, the process of collecting…
Streamlining Ocean Dynamics Modeling with Fourier Neural Operators: A Multiobjective Hyperparameter and Architecture Optimization Approach
Yixuan Sun, Ololade Sowunmi, Romain Egele +3
Training an effective deep learning model to learn ocean processes involves careful choices of various hyperparameters. We leverage the advanced search algorithms for multiobjectiv…
The Unreasonable Effectiveness Of Early Discarding After One Epoch In Neural Network Hyperparameter Optimization
Romain Egele, Felix Mohr, Tom Viering +1
To reach high performance with deep learning, hyperparameter optimization (HPO) is essential. This process is usually time-consuming due to costly evaluations of neural networks. E…
Optimizing Distributed Training on Frontier for Large Language Models
Sajal Dash, Isaac Lyngaas, Junqi Yin +5
Large language models (LLMs) have demonstrated remarkable success as foundational models, benefiting various downstream applications through fine-tuning. Recent studies on loss sca…
Parallel Multi-Objective Hyperparameter Optimization with Uniform Normalization and Bounded Objectives
Romain Egele, Tyler Chang, Yixuan Sun +2
Machine learning (ML) methods offer a wide range of configurable hyperparameters that have a significant influence on their performance. While accuracy is a commonly used performan…
Is One Epoch All You Need For Multi-Fidelity Hyperparameter Optimization?
Romain Egele, Isabelle Guyon, Yixuan Sun +1
Hyperparameter optimization (HPO) is crucial for fine-tuning machine learning models but can be computationally expensive. To reduce costs, Multi-fidelity HPO (MF-HPO) leverages in…
Quantifying uncertainty for deep learning based forecasting and flow-reconstruction using neural architecture search ensembles
Romit Maulik, Romain Egele, Krishnan Raghavan +1
Classical problems in computational physics such as data-driven forecasting and signal reconstruction from sparse sensors have recently seen an explosion in deep neural network (DN…
HPC Storage Service Autotuning Using Variational-Autoencoder-Guided Asynchronous Bayesian Optimization
Matthieu Dorier, Romain Egele, Prasanna Balaprakash +5
Distributed data storage services tailored to specific applications have grown popular in the high-performance computing (HPC) community as a way to address I/O and storage challen…
Asynchronous Decentralized Bayesian Optimization for Large Scale Hyperparameter Optimization
Romain Egele, Isabelle Guyon, Venkatram Vishwanath +1
Bayesian optimization (BO) is a promising approach for hyperparameter optimization of deep neural networks (DNNs), where each model training can take minutes to hours. In BO, a com…
AutoDEUQ: Automated Deep Ensemble with Uncertainty Quantification
Romain Egele, Romit Maulik, Krishnan Raghavan +3
Deep neural networks are powerful predictors for a variety of tasks. However, they do not capture uncertainty directly. Using neural network ensembles to quantify uncertainty is co…
AgEBO-Tabular: Joint Neural Architecture and Hyperparameter Search with Autotuned Data-Parallel Training for Tabular Data
Romain Egele, Prasanna Balaprakash, Venkatram Vishwanath +2
Developing high-performing predictive models for large tabular data sets is a challenging task. The state-of-the-art methods are based on expert-developed model ensembles from diff…
Recurrent Neural Network Architecture Search for Geophysical Emulation
Romit Maulik, Romain Egele, Bethany Lusch +1
Developing surrogate geophysical models from data is a key research topic in atmospheric and oceanic modeling because of the large computational costs associated with numerical sim…
Scalable Reinforcement-Learning-Based Neural Architecture Search for Cancer Deep Learning Research
Prasanna Balaprakash, Romain Egele, Misha Salim +5
Cancer is a complex disease, the understanding and treatment of which are being aided through increases in the volume of collected data and in the scale of deployed computing power…