ChatGPT Chemistry Assistant for Text Mining and Prediction of MOF Synthesis

Abstract

We use prompt engineering to guide ChatGPT in the automation of text mining of metal-organic frameworks (MOFs) synthesis conditions from diverse formats and styles of the scientific literature. This effectively mitigates ChatGPT's tendency to hallucinate information -- an issue that previously made the use of Large Language Models (LLMs) in scientific fields challenging. Our approach involves the development of a workflow implementing three different processes for text mining, programmed by ChatGPT itself. All of them enable parsing, searching, filtering, classification, summarization, and data unification with different tradeoffs between labor, speed, and accuracy. We deploy this system to extract 26,257 distinct synthesis parameters pertaining to approximately 800 MOFs sourced from peer-reviewed research articles. This process incorporates our ChemPrompt Engineering strategy to instruct ChatGPT in text mining, resulting in impressive precision, recall, and F1 scores of 90-99%. Furthermore, with the dataset built by text mining, we constructed a machine-learning model with over 86% accuracy in predicting MOF experimental crystallization outcomes and preliminarily identifying important factors in MOF crystallization. We also developed a reliable data-grounded MOF chatbot to answer questions on chemical reactions and synthesis procedures. Given that the process of using ChatGPT reliably mines and tabulates diverse MOF synthesis information in a unified format, while using only narrative language requiring no coding expertise, we anticipate that our ChatGPT Chemistry Assistant will be very useful across various other chemistry sub-disciplines.

Published on Journal of the American Chemical Society (2023); 102 pages (18-page manuscript, 84 pages of supporting information)

References in corpus (3)

• Sparks of Artificial General Intelligence: Early experiments with GPT-4
• Similarity of Precursors in Solid-state Synthesis as Text-Mined from Scientific Literature
• Scaling Transformer to 1M tokens and beyond with RMT

Cited by in corpus (16)

• A GPT-4 Reticular Chemist for Guiding MOF Discovery
• Image and Data Mining in Reticular Chemistry Using GPT-4V
• A Prompt-Engineered Large Language Model, Deep Learning Workflow for Materials Classification
• Artificial Intelligence in Materials Science and Engineering: Current Landscape, Key Challenges, and Future Trajectorie
• Spiers Memorial Lecture: How to do impactful research in artificial intelligence for chemistry and materials science
• How False Data Affects Machine Learning Models in Electrochemistry?
• The Rise of Generative AI for Metal-Organic Framework Design and Synthesis
• VISION: A Modular AI Assistant for Natural Human-Instrument Interaction at Scientific User Facilities
• Coarse-grained crystal graph neural networks for reticular materials design
• Superconductor discovery in the emerging paradigm of Materials Informatics
• Automated Extraction of Material Properties using LLM-based AI Agents
• Reshaping MOFs text mining with a dynamic multi-agents framework of large language model
• Visual Analysis of LLM-based Entity Resolution from Scientific Papers
• Semantic Embeddings of Chemical Elements for Enhanced Materials Inference and Discovery
• Large Language Model-driven Analysis of General Coordinates Network (GCN) Circulars
• Developing an AI Course for Synthetic Chemistry Students