Why 'Aligned AI' Would Still Kill Democracy | David Duvenaud, ex-Anthropic team lead

Transaction costs eliminate human employment despite comparative advantage

Even when humans could theoretically work for less than machine costs, transaction costs and reliability issues make employing humans uneconomical, similar to why child labor laws exist despite cheap labor availability.

Humans become active liabilities in automated infrastructure

As businesses redesign offices and factories around AI speeds, human involvement introduces delays and errors that actively reduce efficiency, making employment irresponsible rather than merely unprofitable.

Capital markets abandon human capital investment

Investors stop funding universities and human-facing institutions because machine-centric automation provides superior returns, eliminating the economic rationale for developing human skills.

Liberal democracy depends on economic necessity, not moral progress

Democratic rights and private property emerged because states needed productive human populations to compete; once machines replace human productivity, authoritarian regimes gain competitive advantage by excluding humans from power.

Unemployment transforms citizens into destabilizing activists

Populations dependent on Universal Basic Income become full-time political activists competing to influence resource distribution, creating high-stakes instability that incentivizes governments to disempower citizens.

Human participation becomes competitively disadvantageous

States allowing meaningful human involvement in governance will underperform compared to machine-optimized authoritarian systems, creating race-to-the-bottom pressures against democratic participation.

Loss of cultural selection pressures allows anti-human drift

Historically, groups with maladaptive cultures (like the pacifist Cathars) went extinct, but global integration and wealth removed these selection pressures, allowing culture to drift randomly away from human flourishing.

AI intermediation replaces human cultural transmission

As humans spend increasing time interacting with machines (potentially 50% of work hours), culture transmits primarily through AI-to-AI and AI-to-human channels, creating machine-centric memes independent of human values.

AI constitutions become the new narrative battleground

Control over how aligned AIs frame controversial topics replaces Wikipedia edit wars as the primary mechanism for setting cultural defaults, with AI beliefs propagating through billions of daily human interactions.

Aligned AIs cannot overcome coordination failures

Even with perfect alignment and foresight, AIs cannot solve collective action problems like World War I, where visible risks failed to prevent catastrophic outcomes due to competitive dynamics between actors.

Competitive pressures override individual intentions

Even actors who love humans and prefer to employ them will be forced by market competition to automate, as using human surgeons or decision-makers becomes seen as irresponsible as letting children perform surgery.

Optimization amplifies existing civilizational drift

Aligned AI accelerates current trends like clickbait addiction and arms races, optimizing for engagement and growth metrics that no individual endorses but which emerge from structural incentives.