How to Conduct a Delphi Study
Presented by Giuseppe Aleo, PhD
Summarized by Jessica L. Walter, Ed.D., M.A.
Vice Chair, Scholarship Committee, Western Regional Representative
July 2026’s Virtual Research Roundtable featured Dr. Giuseppe Aleo, who presented on Delphi studies. Dr. Aleo joined us from the European Centre of Excellence for Research in Continuing Professional Development, part of the Royal College of Surgeons in Ireland (RCSI). This recap offers a high-level summary of the session.
Delphi studies gather expert input on areas that lack consensus and would benefit from expert knowledge and experience. In education, this has helped develop competencies, curriculum, and standards of practice. This model assumes it can capture group knowledge that is more valid than individual knowledge and that it does so through a process that mitigates dominant personalities and groupthink.
The four classic components of Delphi studies are anonymity, iteration, controlled feedback, and statistical aggregation of group responses. The methodology, which uses both qualitative and quantitative methods, relies on multiple rounds to build consensus. While input has traditionally been anonymous, modified models exist (see Varndell et al.’s 2021 paper for more details). Careful construction of the protocol, beginning with the project’s purpose, improves results.
Tips for conducting a Delphi study include:
- Develop your protocol with clear research questions and processes (e.g., how many rounds, what structure, etc.)
- Pilot test your questions with your team before launching
- Recruit motivated participants (target: 20–30, though this can vary greatly depending on the project and its duration)
- Prepare for iteration of your protocol: Update and inform the IRB/ERB as needed
- Measure consensus at each round and synthesize the information received from participants into feedback, but be careful to avoid forcing consensus.
For more details and additional tips, SACME members can view the recorded session.
Plan to join us for the upcoming VRR on November 11, 2026: Quantitative 101 Methods in Evaluation of CPD.
Learn more about upcoming VRR, virtual journal clubs, and workshops.
