Re-evaluating Retrosynthesis Algorithms with Syntheseus
arXiv:2310.19796 · doi:10.1039/D4FD00093E
Abstract
Automated Synthesis Planning has recently re-emerged as a research area at the intersection of chemistry and machine learning. Despite the appearance of steady progress, we argue that imperfect benchmarks and inconsistent comparisons mask systematic shortcomings of existing techniques, and unnecessarily hamper progress. To remedy this, we present a synthesis planning library with an extensive benchmarking framework, called syntheseus, which promotes best practice by default, enabling consistent meaningful evaluation of single-step models and multi-step planning algorithms. We demonstrate the capabilities of syntheseus by re-evaluating several previous retrosynthesis algorithms, and find that the ranking of state-of-the-art models changes in controlled evaluation experiments. We end with guidance for future works in this area, and call the community to engage in the discussion on how to improve benchmarks for synthesis planning.
Accepted for publication in Faraday Discussions
References in corpus (15)
- Automatic chemical design using a data-driven continuous representation of molecules
- Learning to Plan Chemical Syntheses
- State-of-the-Art Augmented NLP Transformer models for direct and single-step retrosynthesis
- MechRetro is a chemical-mechanism-driven graph learning framework for interpretable retrosynthesis prediction and pathway planning
- Root-aligned SMILES: A Tight Representation for Chemical Reaction Prediction
- Generating Focussed Molecule Libraries for Drug Discovery with Recurrent Neural Networks
- RetroComposer: Composing Templates for Template-Based Retrosynthesis Prediction
- RetroGraph: Retrosynthetic Planning with Graph Search
- Amortized Tree Generation for Bottom-up Synthesis Planning and Synthesizable Molecular Design
- Energy-based View of Retrosynthesis
- Recent advances in artificial intelligence for retrosynthesis
- SemiRetro: Semi-template framework boosts deep retrosynthesis prediction
- Mind the Retrosynthesis Gap: Bridging the divide between Single-step and Multi-step Retrosynthesis Prediction
- Retrosynthetic Planning with Dual Value Networks
- Retro-fallback: retrosynthetic planning in an uncertain world