Home › Psychology

📖 3 min read

Delphi consensus studies in healthcare: major gaps in reporting found

The key finding

A scoping review of 287 Delphi consensus studies published between 2018 and 2021 revealed widespread inconsistencies in how these influential studies are conducted and reported. Most strikingly, 62% of studies did not disclose their method for analyzing open-ended expert responses—a core component of the Delphi process. Additionally, 43% reported using a “modified Delphi” approach without clearly defining what modifications were made. These gaps make it difficult to assess the quality of Delphi findings or compare results across studies, even though Delphi consensus directly informs clinical practice guidelines, treatment protocols, and healthcare policy decisions affecting millions of patients.

What the study looked like

Researchers conducted a scoping review by searching four major databases (Scopus, MEDLINE/PubMed, CINAHL, and Epistemonikos) for Delphi studies published in English or German from January 2018 to April 2021. They included only studies with “Delphi” in the title and “health” plus “consensus” in the title or abstract. The 287 included studies were analyzed for how they assembled expert panels, designed questionnaires, and structured the consensus-building process. The review team examined three key categories known to influence Delphi outcomes: who participated as experts, how questionnaires were formatted and administered, and how feedback was provided across multiple survey rounds.

Why researchers think this happened

The authors suggest that lack of standardized reporting guidelines for Delphi studies has allowed considerable methodological variation to flourish. Many researchers appear to adapt the Delphi method to fit their specific needs—hence the 43% reporting “modified” approaches—but fail to document these modifications transparently. The absence of a shared framework means individual research teams make independent decisions about expert selection, question phrasing, consensus thresholds (81% defined consensus as percentage agreement, but cutoffs varied), and analysis methods. Because Delphi studies synthesize subjective expert judgment rather than experimental data, undisclosed choices about methodology can introduce bias. For instance, not reporting how open-ended comments were coded could mask whether certain expert viewpoints were emphasized or marginalized in the final consensus.

How to read this carefully

This was a scoping review, not a quality assessment, so the authors documented what Delphi studies reported rather than testing whether poor reporting correlated with flawed conclusions. The 287 studies came from diverse health fields, making it hard to generalize about which reporting gaps matter most in specific contexts. Importantly, the review focused on consensus Delphi studies only—other Delphi variants (used for forecasting or policy exploration) were excluded. The findings reflect a three-year publication window, so more recent studies may show improvement. Still, the review highlights a pattern: many Delphi studies shape clinical recommendations without transparently documenting the judgments and analytic steps that produced consensus.

What this means for everyday life

When your doctor references a clinical guideline or a specialist recommends a treatment protocol, there’s a reasonable chance a Delphi consensus process contributed to that recommendation. This review suggests you should view such consensus-based guidance with informed caution—not dismissing it, but recognizing it reflects expert opinion shaped by unstated methodological choices. If you’re curious about a guideline, it might be worth asking whether it’s based on experimental evidence, observational data, or expert consensus (and if consensus, how that consensus was reached). For researchers and clinicians, the review underscores the need for transparent reporting standards so that Delphi-derived recommendations can be properly evaluated and compared, ultimately strengthening the evidence base that guides patient care.


Source

  • PMID: 39810238 (read full paper on PubMed)
  • Journal: Systematic reviews (2025)

Articles on this site are adapted from PubMed abstracts as general-interest explainers. They are not intended as medical advice.

📝 This article was adapted by the PubMed Trivia editorial team using Claude (Anthropic) as an adaptation assistant, based on the PubMed abstract cited above. Our editorial workflow includes automated NG-term checks (medical-claims law), careful "correlation vs causation" distinction, and mandatory PMID + source URL disclosure. See the full pipeline on our editorial policy and editor pages. Please report errors to sciencepubmedjp@gmail.com (we respond within 48 hours).