A consultation summary can contain hundreds of replies and still leave a basic question unanswered: whose views does this describe? The number of contributions measures participation in a process. It does not, by itself, establish the views of everyone affected.
That is a reason to read consultations carefully, rather than dismiss them. They can reveal practical obstacles, experiences, and proposals that a simple vote would miss. A useful summary should explain both what contributors said and how those contributors came to be heard.
The denominator belongs beside the percentage
Consider a hypothetical consultation about an evening bus timetable. Two hundred people submit responses. Eighty answer a particular question, and sixty of those support one proposal. The support figure for that question is 75% of the eighty who answered it.
It is not 75% of all two hundred contributors, still less 75% of the town’s residents. A summary that drops the denominator turns a precise calculation into a broader claim that the calculation cannot carry.
Question routing can add another layer. If a follow-up is shown only to people who gave a particular earlier answer, its percentage describes that selected group. Readers need the route through the questionnaire to understand what the result means.
An open invitation creates a particular kind of evidence
In an open consultation, people generally decide for themselves whether to respond. Interest, time, confidence, language, and awareness of the invitation can all affect who takes part. A large collection of voluntary replies does not automatically become a representative sample of the wider population.
That limitation does not mean the replies lack value. Someone describing an inaccessible stop or an impossible connection may identify an important problem. The experience deserves consideration even if it comes from a small number of respondents.
The mistake is to move unnoticed between two claims: these contributors reported a problem, and this proportion of the entire population has that problem. The first may be well supported while the second needs a different evidential basis.
Look for the people the process could miss
A strong account should describe where the invitation appeared, how people could reply, and which groups the organisers tried to reach. An online form, an attended meeting, and an interview do not create identical opportunities to participate.
In the bus example, a meeting held during working hours might be difficult for some evening passengers to attend. That is a question to investigate, not proof that absent passengers hold any particular view.
Organisations also need careful description. A response from an association may summarise substantial member work, or it may express its leadership’s position. The summary should explain what is known about its basis without pretending that one organisational response equals a fixed number of individual votes.
Keep the reasons attached to the counts
Support and opposition are not always self-explanatory categories. Someone may support a later service but object to its proposed route. Another may favour the route while needing a different departure time. Compressing both replies into a single overall label can erase the useful part.
Read the question’s actual wording and the available answer choices. Then look for how free-text responses were grouped. If a summary uses themes, it should help readers understand what those themes include and how mixed responses were handled.
A repeated template response still expresses participation. It should be identified transparently so readers can distinguish the number of submissions from the range of independently expressed arguments. Neither quietly excluding it nor treating repetition as additional kinds of evidence produces a clear account.
Ask what the decision-maker did with the evidence
The most informative conclusion explains how the responses influenced the next step. Which concern changed the proposal? Which suggestion was considered but not adopted? What uncertainty remains?
A consultation need not function as a binding referendum to deserve scrutiny. Equally, acknowledging every submission does not require giving every argument the same weight. A clear explanation can discuss evidence, feasibility, and competing needs without pretending that a headcount settled them all.
Readers can apply one compact test: identify who could respond, who did respond, who answered the particular question, and how the answers informed the decision. When those distinctions remain visible, consultation becomes easier to assess as a form of public evidence, with both its contribution and its limits intact.
