Ten ways to ask – the question types in Pronoia
The quality of a Delphi study is often settled the moment the facilitator decides how to ask. The same theme yields different knowledge as a scale rating, as a timing estimate or as a division of resources. Pronoia now offers ten question types, and every one of them has its own button in the New thesis form of the thesis editor.
The rule of thumb is simple: choose the lightest question type that answers your research question – and always ask for reasoning in words. In every type, the experts' argumentation is the most valuable part of the material.
Basic types
- Scale – the panelist rates a statement on a scale, 1–9 by default. With criterion variables (probability and desirability, for example) one thesis yields several ratings, and the gap between them reveals the tension between what is hoped for and what is feared. The basic tool of a Delphi study.
- Open question – a free-form text answer. Use it to map a new phenomenon that cannot yet be condensed into statements, as in round 0 and round 1 ideation. The answers often become the next round's theses.
- Ranking – the panelist puts the options in order of importance. The result is the mean rank of each option, and the spread of the ranks points to the most contested choices.
- Multichoice – one or several choices among given options. A quick situational picture for "which of the following" questions.
Structuring and prioritisation
- Grouping – the panelist sorts items into categories defined by the facilitator, for example weak signals into Hot, Cool and Cold. Disagreement shows in how the placements of the same item spread across categories.
- Allocation – the panelist divides a fixed number of points, 100 by default, among the options. When a rank order is not enough, allocation tells you how large the weights are – when targeting resources, say, or dividing probability among alternative scenarios.
- 2×2 placement – the panelist places the thesis as a point on a two-axis map, classically impact × uncertainty. Answers splitting into opposite corners is a significant finding and a sound basis for scenario axes.
Time
- Time estimate – the panelist gives a single year in which the statement comes true, or chooses "not within this time window". A quick way to time a large set of theses.
- Time window – the panelist defines a span from earliest to latest, as either possible or probable. The width of the window is itself a result: a narrow window signals confidence, a wide one uncertainty. A "never" option is also available.
- Time series – the facilitator supplies the realised history and the panelist continues the curve into the future, by dragging or by entering numbers. Everyone is anchored to the same starting point, and the median curve and spread band show how far the panel's view carries.
How do I choose?
- support or probability → scale
- ideation and mapping → open question
- order of importance → ranking
- classifying into ready-made options → multichoice
- sorting topics into categories → grouping
- resources and weights → allocation
- comparing two dimensions → 2×2 placement
- a quick timing estimate → time estimate
- timing and the respondent's own uncertainty → time window
- a quantitative development forecast → time series
You will find fuller examples and guidance on reading the results in the Pronoia help library article Question types: a selection guide with examples. Open it from the Help menu on the dashboard.