From Intention To Implementation: Automating Biomedical Research via LLMs
arXiv:2412.09429 · doi:10.1007/s11432-024-4485-0
Abstract
Conventional biomedical research is increasingly labor-intensive due to the exponential growth of scientific literature and datasets. Artificial intelligence (AI), particularly Large Language Models (LLMs), has the potential to revolutionize this process by automating various steps. Still, significant challenges remain, including the need for multidisciplinary expertise, logicality of experimental design, and performance measurements. This paper introduces BioResearcher, the first end-to-end automated system designed to streamline the entire biomedical research process involving dry lab experiments. BioResearcher employs a modular multi-agent architecture, integrating specialized agents for search, literature processing, experimental design, and programming. By decomposing complex tasks into logically related sub-tasks and utilizing a hierarchical learning approach, BioResearcher effectively addresses the challenges of multidisciplinary requirements and logical complexity. Furthermore, BioResearcher incorporates an LLM-based reviewer for in-process quality control and introduces novel evaluation metrics to assess the quality and automation of experimental protocols. BioResearcher successfully achieves an average execution success rate of 63.07% across eight previously unmet research objectives. The generated protocols, on average, outperform typical agent systems by 22.0% on five quality metrics. The system demonstrates significant potential to reduce researchers' workloads and accelerate biomedical discoveries, paving the way for future innovations in automated research systems.
To appear in SCIENCE CHINA Information Sciences. If you find our work useful, please cite us as: @article{ BioResearcher, author = "Yi Luo and Linghang Shi and Yihao Li and Aobo Zhuang and Yeyun Gong and Ling Liu and Chen Lin", title = "From Intention To Implementation: Automating Biomedical Research via LLMs", journal = "SCIENCE CHINA Information Sciences", year = "2025" }
References in corpus (27)
- Training language models to follow instructions with human feedback
- Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
- A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPT
- Retrieval-Augmented Generation for Large Language Models: A Survey
- ReAct: Synergizing Reasoning and Acting in Language Models
- Voyager: An Open-Ended Embodied Agent with Large Language Models
- Generative Agents: Interactive Simulacra of Human Behavior
- Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicine
- PubMed and Beyond: Biomedical Literature Search in the Age of Artificial Intelligence
- Prompt Engineering for Healthcare: Methodologies and Applications
- The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery
- OpenMedLM: Prompt engineering can out-perform fine-tuning in medical question-answering with open-source large language models
- Agent Hospital: A Simulacrum of Hospital with Evolvable Medical Agents
- Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolution
- BianQue: Balancing the Questioning and Suggestion Ability of Health LLMs with Multi-turn Health Conversations Polished by ChatGPT
- Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Models
- HuatuoGPT, towards Taming Language Model to Be a Doctor
- MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoning
- ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Models
- System for systematic literature review using multiple AI agents: Concept and an empirical evaluation
- CRISPR-GPT for Agentic Automation of Gene-editing Experiments
- Agentic LLM Workflows for Generating Patient-Friendly Medical Reports
- From Beginner to Expert: Modeling Medical Knowledge into General LLMs
- Many Heads Are Better Than One: Improved Scientific Idea Generation by A LLM-Based Multi-Agent System
- Genesis: Towards the Automation of Systems Biology Research
- Collaborative Evolving Strategy for Automatic Data-Centric Development
- CycleResearcher: Improving Automated Research via Automated Review