Daniela Amodei, Co-Founder and President of Anthropic: Building AI the Right Way
TL;DR
Daniela Amodei traces her unconventional path from English literature and politics to co-founding Anthropic, explaining why she and six colleagues left OpenAI to establish a Public Benefit Corporation focused on 'radical responsibility' in AI, and how they navigate the growing tension between commercial demands and safety imperatives.
📚 From Literature to AI: A Non-Linear Path 3 insights
Liberal arts backgrounds enable unconventional career pivots
Amodei studied English literature and worked in global health and politics before entering tech, demonstrating that curiosity and impact-driven motivation matter more than specific technical degrees.
Cross-functional experience bridges technical gaps
Six years at Stripe provided foundational tech literacy and exposure to engineering culture, while growing up with a physicist sibling normalized complex technical concepts.
Learning AI requires intellectual humility and pattern recognition
She emphasizes asking questions until understanding emerges, recognizing comparative advantages rather than mastering every technical skill, and knowing 'your lane' within the ecosystem.
🛡️ Founding Anthropic: Safety as Core Mission 3 insights
Public Benefit Corporation structure institutionalizes responsibility
Anthropic incorporated as a PBC to legally prioritize safety and societal impact alongside shareholder value, ensuring the mission persists beyond immediate commercial pressures.
Safety means preventing predictable externalities
Drawing lessons from social media's unintended consequences, the company focuses on preemptive risk mitigation across chemical/biological weapons, cyber warfare, election integrity, and user wellness.
Departing OpenAI enabled vision alignment
The seven co-founders left to build an organization where responsibility could be central rather than secondary, running toward a specific safety-focused vision rather than away from their previous employer.
🤝 Co-Founder Dynamics and Team Building 3 insights
Long-term relationships predict startup success
All seven co-founders had 10-15 year histories or prior reporting relationships at OpenAI, providing established conflict resolution patterns and interpersonal trust.
Shared vision prevents fundamental misalignment
Amodei stresses ensuring co-founders describe identical end goals—avoiding scenarios where 'one has drawn a unicorn and the other has drawn a platypus'—before formalizing partnerships.
Stress-test partnerships before committing
She suggests intense shared experiences like vacations or high-pressure projects to assess whether you want more time together or need recovery from the interaction.
⚖️ Navigating Commercial and Safety Tensions 3 insights
Safety and revenue were historically aligned
Most business customers are risk-averse and prefer reliable, non-harmful models, creating natural alignment between commercial success and safety investments.
Capability speed now creates release tensions
As models advance rapidly, the primary conflict emerges around timing—delaying launches for safety work (like Project Glass Wing) sacrifices immediate revenue despite customer demand.
Mission serves as the ultimate tiebreaker
When commercial pressure conflicts with safety confidence, Anthropic defaults to caution, accepting customer frustration to prevent potential harms until thorough risk assessment is complete.
Bottom Line
Build AI companies as Public Benefit Corporations with deeply trusted co-founders to institutionalize the discipline of delaying capabilities until safety measures demonstrably match potential risks.
More from My First Million
View all
Ep78 “What’s Wrong With Taxing Billionaires More?” with Joshua Rauh
Finance professors from Stanford and Wharton argue that California's proposed 5% billionaire wealth tax would likely lose money for the state due to taxpayer flight, violates the implicit contracts that drive innovation, and ignores that the wealthy already pay the vast majority of income taxes while generating massive economic value.
A Conversation with faculty about Stanford GSB's People, Culture, and Performance Program
Stanford GSB's People, Culture, and Performance program teaches executives to treat human capital as a competitive advantage through a 5.5-day immersive experience that blends social science research with real-world Silicon Valley practices.
Our AI Future: From Abundance to Apocalypse
Stanford economist Chad Jones explores AI's economic potential through two divergent scenarios: explosive growth driven by recursive self-improvement and full automation, versus continued 2% annual growth constrained by historical patterns and persistent human bottlenecks in production chains.
Tekedra Mawakana, Co-CEO of Waymo: Building a Safer Way Home
Waymo Co-CEO Tekedra Mawakana discusses her journey from Mississippi to leading autonomous vehicle technology, emphasizing that transformative innovation requires betting on terrifying opportunities while building safety-first cultures that aim for a 13x improvement over human drivers rather than settling for 'safe enough'.