The Early Days of Anthropic & How 21 of 22 VCs Rejected It | The Four Bottlenecks in AI | Anj Midha

| Podcasts | April 14, 2026 | 33.9 Thousand views | 1:15:19

TL;DR

Anj Midha, founding investor of Anthropic and founder of AMP, argues that culture and unique context feedback loops—not algorithms—are the primary bottlenecks to AI progress, while sharing how 21 of 22 VCs rejected Anthropic in 2021 despite the team's pedigree inventing GPT-3.

🧠 The Four Bottlenecks of AI Progress 4 insights

Culture is the primary constraint

Algorithmic innovation is a function of culture; mission-driven environments attract flexible researchers who solve architectural challenges naturally, making culture more limiting than technical specifications.

Context feedback loops create defensibility

Unique data generation and verification systems—such as Periodic Labs' physical robots validating superconductor predictions—provide greater moats than generic pre-training data.

Scaling laws remain domain-dependent

While coding shows diminishing returns, domains like material science exhibit super-exponential gains from increased compute, with no saturation in superconductor discovery.

Infrastructure requires structured capital

Beyond algorithms, progress requires coordinated deployment of land, power, shells, and diverse financing vehicles to sustain RL loops at scale.

🌍 Sovereign AI & Vertical Integration 3 insights

Data sovereignty reshapes cloud competition

The US Cloud Act prevents mission-critical European workloads from running on American infrastructure, creating openings for sovereign providers like Mistral to capture enterprise and government demand.

Physical vertical integration beats general models

Companies like Periodic Labs avoid being 'Claudified' by owning proprietary data generation through physical labs, whereas horizontal tools without unique data moats face commoditization.

Scientific reasoning requires physical verification

Current LLMs lack physics and chemistry capabilities because the data is locked in national labs and manufacturing plants, necessitating physical infrastructure to unlock scientific frontiers.

💰 Inside Anthropic's Early Fundraising 3 insights

21 of 22 VCs rejected the seed pitch

Despite the team inventing GPT-3, most investors in 2021 lacked technical literacy to evaluate the scaling hypothesis, asking 'What's GPT-3?' during pitches.

The inference flywheel strategy

Anthropic's early operational model focused on deploying coding assistants to generate both revenue and context feedback simultaneously, creating a sustainable capability improvement loop.

Bridging research and business timing

Success required converting the research hypothesis of scaling laws into a business hypothesis through methodical operationalization over 12-24 months.

Bottom Line

Founders should prioritize building unique context feedback loops and sovereign infrastructure capabilities over pure research, as proprietary data generation and local compute sovereignty determine sustainable competitive advantage.

More from 20VC with Harry Stebbings

View all
The Most Intense Workplace Culture in America | The Journey from $0 to $2.6BN Valuation
56:55
20VC with Harry Stebbings 20VC with Harry Stebbings

The Most Intense Workplace Culture in America | The Journey from $0 to $2.6BN Valuation

Corgi Insurance CEO Nico details the company's radical '7-day week' work culture where employees live in the office, revealing a philosophy that prioritizes asymmetric upside and winning at all costs over work-life balance, traditional credentials, and even longevity. The interview explores how this intensity serves as a filter to attract 'killers' while repelling those unwilling to sacrifice health and weekends for trillion-dollar ambitions.

about 6 hours ago · 10 points
Cerebras CEO on the Future of Data Centres, Token Costs & Memory | Should US Companies Sell to China
1:07:45
20VC with Harry Stebbings 20VC with Harry Stebbings

Cerebras CEO on the Future of Data Centres, Token Costs & Memory | Should US Companies Sell to China

Cerebras CEO Andrew Feldman argues AI infrastructure is not a bubble because supply is struggling to catch up with explosive demand, evidenced by $25 billion in data center backlogs and severe memory shortages. Cerebras' recent IPO reflects this reality, with the company positioned advantageously using SRAM instead of scarce HBM memory while industry-wide compute costs continue their historical decline.

4 days ago · 10 points