The Opt‐in/Opt‐out Feature in a Multi‐Stage Delphi Method Study

Abstract

Policy Delphi methods have not received the level of methodological scrutiny evidenced by more established techniques. This paper provides an examination of the potential for study participants to opt in/opt out of consecutive Delphi rounds. The literature proposes that this is a positive feature of the approach but evidence to support this position is lacking. This paper provides a brief review of the Policy Delphi method and than presents details of participation patterns in a study where the opt‐in/opt‐out option was available. Findings showed that participants exercised the option of opting in/opting out of different Delphi rounds. Although only 20.6% of the original participants completed all three Delphi rounds, the response rate (regardless of participants’ involvement in previous rounds) across all three Delphi rounds held fairly consistent at around 40%. These findings are significant as they relate to the need for an expanded repertoire of research tools that can address the complex, non‐linear questions emerging in post‐modern society.