Pioneering AI PICO Scoping Tool Enhances EU Joint Clinical Assessments

A recently published AI PICO Scoping Tool delivers a practical solution for the demanding requirements of EU Joint Clinical Assessments by automatically extracting and consolidating Population, Intervention, Comparator, and Outcome (PICO) elements from disparate health technology assessment reports and clinical guidelines. In validation exercises spanning non-small cell lung cancer (NSCLC) and hepatocellular carcinoma (HCC), the system reviewed 49 documents totaling 5,463 pages from 16 countries and produced recall rates of 0.807 and 0.837 respectively, often matching or exceeding human performance while compressing roughly 25 hours of manual work into 96 minutes of computation.

Cutting Through Multilingual Evidence Mountains

Developers built the tool around a six-step retrieval-augmented generation pipeline that preserves tables and document hierarchy during PDF parsing, translates content into English, and creates semantically chunked vector embeddings. Few-shot prompting then guides extraction and conservative consolidation, deliberately avoiding model fine-tuning in favor of metadata tagging and parallel processing streams that maintain clinical nuance across differing national standards of care.

Outperforming Humans in Oncology Benchmarks

The AI PICO Scoping Tool captured comparators with exceptional reliability (0.911 in NSCLC, 0.967 in HCC) and achieved higher overall recall than manual methods in head-to-head testing. Stability checks across parameter changes confirmed consistent results, with coefficients of variation below 3 percent, demonstrating that the system reliably surfaces consolidated PICO sets assessors can trust.

Reclaiming Time for Strategic Decisions

By shifting effort away from exhaustive document screening, the AI PICO Scoping Tool lets assessors, pharmaceutical sponsors, and national HTA bodies concentrate on interpretation and deliberation during the critical JCA scoping phase. Its disease-agnostic design, grounded in the peer-reviewed methodology, positions it for broader adoption across therapeutic areas as EU-HTA implementation accelerates.