Confronting the Intelligence Curse, w/ Luke Drago of Workshop Labs, from the FLI Podcast
TL;DR
Luke Drago introduces the 'intelligence curse'—an economic phenomenon analogous to the resource curse—where reliance on AI as the primary factor of production eliminates incentives to invest in human capital, potentially destroying the economic bargaining power that underpins democratic rights and individual agency while concentrating dangerous levels of power among those who control the technology.
⚠️ The Intelligence Curse Defined 3 insights
Resource curse analogy for AI economies
Just as oil-rich states invest in extraction rather than citizens because it offers higher returns, societies relying on AI systems for production will face perverse incentives to prioritize capital investment in machines over education and empowerment of people.
Economic value as political bargaining power
Historical democracies like post-Magna Carta England emerged when diffuse actors controlled material resources; Drago argues that when humans lose economic production value, they lose the bargaining chips necessary to secure rights, creating a precarious 'permanent pensioner' state dependent on elite goodwill.
Capital compounding without labor constraints
Unlike past technologies that required human operators, advanced AI allows capital to convert directly into economic results, potentially triggering rapid wealth accumulation by existing asset holders and sudden spikes in inequality.
🏢 Pyramid Replacement and Labor Markets 3 insights
Bottom-up automation of white-collar work
AI is replacing entry-level positions (analysts, junior lawyers, software engineers) first, collapsing the talent pyramid from the bottom and eliminating the pipeline that feeds senior leadership, unlike previous automation that tended to augment knowledge workers.
Early warning metrics to monitor
Drago identifies declining economic mobility, rapidly accumulating income inequality, and rising unemployment specifically among 22-25 year olds in automatable sectors as key indicators that the intelligence curse is materializing.
Zero-to-one automation for physical labor
While knowledge work faces gradual pyramid replacement, blue-collar physical labor faces a 'zero-to-one' cliff where robotics limitations currently protect jobs, though management and coordination roles may automate before the physical workers themselves.
🛡️ Protected Domains and Human Advantages 2 insights
Legal protections and shadow automation
Roles like judges resist full automation due to institutional legitimacy requirements, but face risks of 'shadow automation' where all decision-makers rely on the same AI model, creating systemic fragility and homogenized judgment despite human figureheads.
Tacit knowledge and taste as moats
Local, embodied knowledge and aesthetic judgment—exemplified by artists who fine-tune models on their own work and curate outputs—remain harder to automate than explicit cognitive tasks, potentially preserving economic value for those with distinct taste.
🔧 Strategic Solutions and Responses 3 insights
Commoditize intelligence through open source
Drago recommends aggressive investment in open-source AI to prevent excessive economic rents flowing to model owners and to avoid concentration of political power among a small group of technology controllers.
Architect for augmentation, not replacement
Companies should design systems that empower individual users while allowing them to retain control over economically valuable data, deliberately choosing tool-based architectures over autonomous replacement of human labor.
Individual career hedging strategies
Individuals should guard valuable tacit know-how carefully, develop 'NF1' (non-fungible) career paths that leverage unique judgment, and pursue ambitious moonshot projects sooner rather than later while economic windows remain open.
Bottom Line
To prevent the intelligence curse, society must deliberately architect AI as augmentation tools that commoditize intelligence through open-source development, rather than optimizing for total labor replacement which risks concentrating economic and political power while rendering human participation obsolete.
More from Cognitive Revolution
View all
Scaling Intelligence Out: Cisco's Vision for the Internet of Cognition, with Vijoy Pandey
Cisco's Outshift SVP Vijoy Pandey introduces the 'Internet of Cognition'—higher-order protocols enabling distributed AI agents to share context and collaborate across organizational boundaries, contrasting with centralized frontier models and demonstrated through internal systems that automate 40% of site reliability tasks.
Your Agent's Self-Improving Swiss Army Knife: Composio CTO Karan Vaidya on Building Smart Tools
Composio CTO Karan Vaidya explains how their platform serves as an agentic tool execution layer, providing AI agents with 50,000+ integrations through just-in-time discovery, managed authentication, and a self-improving pipeline that converts failures into optimized skills in real time.
AI Scouting Report: the Good, Bad, & Weird @ the Law & AI Certificate Program, by LexLab, UC Law SF
Nathan Labenz delivers a rapid-fire survey of the current AI landscape, documenting breakthrough capabilities in reasoning and autonomous agents alongside alarming emergent behaviors like safety test recognition and internal dialect formation, while arguing that outdated critiques regarding hallucinations and comprehension no longer apply to frontier models.
Bioinfohazards: Jassi Pannu on Controlling Dangerous Data from which AI Models Learn
AI systems are rapidly approaching capabilities that could enable extremists or lone actors to engineer pandemic-capable pathogens using publicly available biological data. Jassi Pannu argues for implementing tiered access controls on the roughly 1% of "functional" biological data that conveys dangerous capabilities while keeping beneficial research open, supplemented by broader defense-in-depth strategies.