Streamlining evidence based clinical recommendations with large language models

Abstract

Clinical evidence underpins informed healthcare decisions, yet integrating it into real-time practice remains challenging due to intensive workloads, complex procedures, and time constraints. This study presents Quicker, an LLM-powered system that automates evidence synthesis and generates clinical recommendations following standard guideline development workflows. Quicker delivers an end-to-end pipeline from clinical questions to recommendations and supports customized decision-making through integrated tools and interactive interfaces. To evaluate how closely Quicker can reproduce guideline development processes, we constructed Q2CRBench-3, a benchmark derived from guideline development records for three diseases. Experiments show that Quicker produces precise question decomposition, expert-aligned retrieval, and near-comprehensive screening. Quicker assistance improved the accuracy of extracted study data, and its recommendations were more comprehensive and coherent than clinician-written ones. In system-level testing, Quicker working with one participant reduced recommendation development to 20-40 min. Overall, the findings demonstrate Quicker's potential to enhance the speed and reliability of evidence-based clinical decision-making.

References in corpus (8)

• Evaluating Large Language Models Trained on Code
• Capabilities of GPT-4 on Medical Challenge Problems
• DeepSeek-V3 Technical Report
• Large Language Models and User Trust: Consequence of Self-Referential Learning Loop and the Deskilling of Healthcare Professionals
• Assessing the Ability of ChatGPT to Screen Articles for Systematic Reviews
• Towards General Text Embeddings with Multi-stage Contrastive Learning
• Medical Graph RAG: Towards Safe Medical Large Language Model via Graph Retrieval-Augmented Generation
• Med-R${}^2$: Crafting Trustworthy LLM Physicians via Retrieval and Reasoning of Evidence-Based Medicine