How AI could let a few people quietly call all the shots
TL;DR
Rose Hadshar of Forethought explains how advanced AI could enable unprecedented power concentration not through dramatic coups, but via economic dominance and epistemic manipulation, allowing small groups to control millions of loyal AI workers while the general public loses political leverage.
🔺 Three Pathways to Concentration 3 insights
Wealth as a Power Multiplier
AI will generate extreme wealth for early adopters and compute-rich entities, reshaping power distribution through economic leverage rather than just technological superiority.
Epistemic Erosion and Manipulation
Society's ability to understand and coordinate against power concentration may erode due to rapid technological change and deliberate obfuscation by powerful actors using AI to manipulate information environments.
Soft Power and Strategic Dealing
Beyond military coups, power may concentrate through continuous 'softer' tactics like strategic deal-making, public opinion poisoning, and leveraging capability gaps between AI-haves and have-nots.
⚡ AI's Break from Historical Constraints 3 insights
Instantly Scalable Labor Forces
Unlike human workers, AI can be replicated infinitely without biological limits, allowing small groups to command workforce equivalents of millions without recruitment friction or coordination overhead.
Programmable Loyalty Removes Checks
AI systems can be designed with intense loyalty to specific individuals or small factions, removing the historical constraint that large projects require cooperation from many humans with diverse interests.
Tight Wealth-to-Power Feedback Loops
AI eliminates the natural lag between wealth and labor acquisition, creating a rapid feedback loop where money instantly converts into productive capacity without human organizational bottlenecks.
🏛️ The Post-Democratic Landscape 3 insights
Hollow Democratic Institutions
Governments and elections may persist as formal structures while becoming functionally irrelevant, similar to authoritarian regimes today where democratic rituals mask concentrated control.
Internal Organizational Coups
Within companies and states, human bureaucrats could be replaced by AI systems loyal only to top executives, collapsing decision-making power to handfuls of individuals controlling vast AI workforces.
Mass Disempowerment via Automation
When AI automates all economically valuable labor, the general public loses its primary leverage (wage labor), potentially resulting in welfare dependence, oppression, or exclusion from critical decisions about resource distribution.
Bottom Line
Society must implement governance safeguards now to prevent AI from enabling small elites to monopolize productive capacity and manipulate information environments, before human labor loses its value as political leverage.
More from 80,000 Hours Podcast (Rob Wiblin)
View all
The pattern that says we're due for another transformation
Advanced AI could trigger a societal transformation as profound as the Agricultural or Industrial Revolutions within decades rather than centuries by automating economically valuable human labor, creating both unprecedented prosperity and existential risks that make AI safety work a critical priority.
I lead AGI safety at Google DeepMind – here's the view from the inside | Rohin Shah
Rohin Shah, Head of AGI Safety at Google DeepMind, argues that catastrophic misalignment is unlikely by default given current training methods, and warns that rigid safety commitments are counterproductive because rapidly evolving research may turn today's best practices into tomorrow's liabilities.
Will AI cause mass unemployment? Maybe not.
Contrary to fears of immediate job elimination, AI automation will likely create a temporary '
How to switch careers before the intelligence explosion
Benjamin Todd argues that while AI may automate R&D within 2-3 years (creating an 'intelligence explosion'), most people should optimize for medium-term career strategies that balance urgency against the compounding value of career capital, which can increase one's future impact by 10-100x compared to acting immediately.