The Ex-Congressman Who Says AI Isn't Unstoppable — Brad Carson
TL;DR
Former Congressman and Pentagon official Brad Carson argues that AI development is not inevitable and can be controlled through strategic regulation, particularly by treating AI as products subject to liability laws rather than granting them human rights, while leveraging chip controls and mandatory testing to shape the technology's future.
🎯 Strategic Governance and Control 3 insights
Semiconductor controls provide strategic leverage
The U.S. controls the most critical AI input through chip restrictions, giving it the ability to stop other nations from developing superintelligent AI systems.
Mandatory testing prevents regulatory capture
Carson advocates for mandatory evaluation of frontier models by independent verification organizations, similar to how the SEC oversees public company accounting.
Rejecting technological determinism
Society should not passively accept AI development as inevitable but must actively shape it through democratic oversight and congressional accountability.
⚖️ Product Liability and Legal Accountability 3 insights
Developers bear primary liability for harms
Following traditional tort law, AI companies should bear significant liability for downstream harms when they fail to remove child sexual abuse material from training data or enable foreseeable misuse.
Shared responsibility for AI-enabled crimes
Both developers and users should be held accountable for AI misuse such as deepfake pornography, with developers liable when they reasonably foresee harmful applications.
Tort system serves as social insurance
Liability should fall on entities most capable of preventing risks and bearing costs through insurance, placing the burden on well-resourced AI labs rather than individual victims.
🤖 Anthropomorphization and Military Applications 2 insights
AI systems lack First Amendment rights
Carson argues that AI is a machine and product, not a person, and therefore should not receive human rights protections such as free speech.
Warfare remains fundamentally human-centric
Drawing from Iraq and Afghanistan, Carson warns that technology cannot substitute for human judgment in occupation and governance, despite the American tendency to favor capital over labor in military strategy.
Bottom Line
Treat AI systems as products subject to strict liability and safety standards rather than human-like entities, while using export controls and mandatory independent testing to actively shape AI development rather than accepting it as predetermined.
More from Machine Learning Street Talk
View all
The Benchmark With No Instructions — Tufa Labs (ARC-AGI-3)
Researchers from Tufa Labs dissect the ARC-AGI-3 benchmark, which evaluates AI agents on learning abstract goals from raw pixel inputs without instructions. They reveal that while LLM-guided coding agents currently outperform pure reinforcement learning approaches, success on the benchmark may exploit latent training priors rather than represent genuine abstraction acquisition, raising fundamental questions about the relationship between language, exploration, and general intelligence.
The Thermodynamic AI Chip · Thomas Ahle
Thomas Ahle explores thermodynamic computing chips that harness physical noise for probabilistic ML, while detailing how AI agents can democratize prohibitively expensive chip design tools—though this raises urgent questions about verification and 'understanding debt' when AI generates complex systems humans no longer fully comprehend.
He won a Nobel here for AlphaFold. Then he left. - John Jumper
Nobel laureate John Jumper explains how AlphaFold solved the 50-year protein structure prediction problem by collapsing years of experimental work into minutes, while emphasizing its narrow scope as a starting point for biological research rather than a universal model of life.
Inference, not prediction — Prof. Michael I. Jordan on what modern AI is still missing
Professor Michael I. Jordan critiques the hype around AGI and prediction-based LLMs, arguing that modern AI lacks economic and social thinking; he advocates for 'inference' systems grounded in game theory and market dynamics that respect human agency and create collective value.