What By-Elections Reveal About the Failure of Political Judgment

Every time a by-election is called, the political establishment treats it like a minor inconvenience. A footnote. A mid-term blip that gets a few days of breathless coverage before everyone forgets about it. The pundits frame it as a test of the government's popularity or a referendum on the prime minister. The party machines roll out their standard talking points. And the voters either stay home or treat it as a free protest vote. That is the conventional wisdom, and it is almost entirely wrong.

Let me give you a different lens, one drawn from first principles, from the insight of Friedrich Hayek, from the Founders' design of republican government, and from the simple economic lesson that Henry Hazlitt taught us about looking beyond what is immediately visible. A by-election is not a popularity contest. It is a judgment correction. It is the price signal that reveals knowledge the central planners in party headquarters cannot possibly possess. And the political class hates it precisely because they cannot control it.

The Knowledge Problem in Plain Sight

Friedrich Hayek's great contribution to political economy was explaining what he called the knowledge problem. No central planner, no matter how brilliant, no matter how many data points he collects, can ever aggregate the dispersed, local, tacit knowledge held by millions of individuals across a nation. The price system works because it coordinates that knowledge through voluntary exchange. Central planning fails because the planner is necessarily ignorant of the time, place, and circumstance that matter to actual people. The same principle applies to politics.

Consider a safe seat. The party machine has years of polling, focus groups, demographic data, and a massive fundraising apparatus. They believe they know exactly what the constituency thinks. They are certain their candidate will win. They have models and spreadsheets that prove it. Then a by-election is triggered, perhaps by a resignation, a scandal, or a death. Suddenly, the voters can speak directly, without the filter of a general election where the choice is between two national parties, both running on heavily scripted platforms. In a by-election, the local constituency can send an unambiguous signal. You have taken us for granted. You have misallocated your political capital. You are out of touch. Here is your correction.

That is the price mechanism at work. And it works because the party cannot know what the locals know, the resentment simmering over a misplaced highway, the anger at a school closure, the quiet fury at a broken promise. The party's polling might miss it. The candidate's focus groups might not capture it. But the by-election reveals it. The judgment of the political class is exposed as flawed, incomplete, and arrogant. The correction is swift and public.

The Founders Designed This

The Framers of the American Constitution, and the principle translates across Westminster-style systems, understood that frequent elections were the cornerstone of republican government. James Madison wrote in Federalist No. 57 that the House of Representatives should have an immediate dependence on, and an intimate sympathy with, the people. He called frequent elections unquestionably the foundation of republican government. They did not design a system where the party chairman in the capital decides who sits in Parliament or Congress. They designed one where the people can, at any moment, recall their delegate and send a new signal. A by-election is that signal in its purest form, a local, immediate, and unmistakable communication from the governed to the governors.

The Founders understood a truth the modern political class has forgotten. Power must be checked, not just at scheduled intervals, but whenever the people decide they have something to say. A general election every four or five years is not enough. The knowledge that matters is constantly changing. The market needs continuous price discovery, not a single annual report. By-elections provide that continuous feedback, forcing those in power to regularly confront the limits of their own judgment.

The Seen and the Unseen

Henry Hazlitt, in his timeless Economics in One Lesson, taught us to judge a policy not by its immediate, visible effects, but by its long-term, often invisible consequences. The same lesson applies to by-elections. The seen effect is a seat changing hands. The government loses one member. The opposition gains one. The media covers it for a few days, the party spins it as an anomaly, and everyone moves on. That is the visible, short-term outcome.

The unseen effect is far more important, and far harder to measure. Every by-election loss imposes discipline on the ruling party. It forces the central planners, the strategists, the cabinet ministers, the prime minister's office, to confront knowledge they would rather ignore. It tells them your national formula does not work here. Your assumptions are flawed. You cannot take any voter for granted. That discipline is the hidden benefit of the system. It prevents the political class from becoming completely detached from the people they are supposed to serve. It forces them to listen, to adjust, to reallocate their attention and resources. Without by-elections, the only corrective mechanism is a general election, and by then, the damage may already be done.

Consider the British by-election in Clacton in 2014, when the UK Independence Party won a seat from the Conservatives. The visible effect was a single seat. The unseen effect was a seismic shock that forced the Conservative Party to confront the depth of Eurosceptic feeling in the electorate, knowledge they had ignored for years. That by-election was a market signal that changed the course of British politics. Or consider the special election in Pennsylvania's 18th congressional district in 2018. The Democrat won a seat in a deeply Republican area. The visible effect was one seat. The unseen effect was a warning that the GOP's national strategy was failing to connect with working-class voters in critical regions. That signal shaped the party's approach for the next cycle.

Why the Political Class Hates This

Here is the uncomfortable truth. The political establishment prefers predictability. They want to control the narrative, manage the message, and schedule elections at their convenience. A by-election disrupts that order. It introduces uncertainty. It forces them to respond to events they did not script. That is precisely why by-elections are essential. They are a check on the hubris of central planners, whether those planners are party strategists, cabinet ministers, or prime ministers. The unconstrained vision, as Thomas Sowell called it, believes that smart people at the top can engineer the perfect outcome. But the constrained vision recognizes that human beings are fallible, that no authority has perfect knowledge, and that feedback mechanisms are necessary to correct error.

A by-election is that feedback mechanism. It is the Constitution's built-in antidote to arrogance. It exposes the gap between what the political class thinks it knows and what the people actually feel. The judgment of the voters, expressed in a single local contest, can upend the assumptions of a national party. That is precisely why the establishment tries to dismiss by-elections as aberrations, as protests without consequence. They know that if voters start treating every local contest as a serious judgment on their performance, the entire edifice of managed politics begins to crack.

A Republican Check, Not a Democratic Tantrum

The critics call by-elections disruptive, unpredictable, and even wasteful. They want to minimize them, weaken them, or turn them into low-turnout curiosities. That is exactly what you would expect from those who prefer the unconstrained vision, the belief that a few experts can manage society from the top down. But a republic does not need perfect outcomes. It needs checks. It needs accountability. It needs a system that forces the powerful to listen to the people, not just when the calendar says so, but whenever the people decide they have something to say.

A by-election is not a disruption. It is a correction. It is the price system that prevents the ruling class from becoming completely detached from the governed. It is the small, local, powerful act of republican self-correction that keeps the system honest. The judgment of the many must always check the power of the few. The market is speaking. The question is whether the political class will listen, or whether they will keep pretending they already know everything.