The history and future of AI at Google, with Sundar Pichai

Transformers emerged from product needs

Google researchers developed Transformers to solve specific scaling challenges like translation and TPU inference for two billion users, immediately deploying them via BERT and MUM to achieve the largest search quality jumps in company history.

LaMDa existed before ChatGPT

Google had already built LaMDa—an internal ChatGPT equivalent—but constrained its release due to toxicity concerns and a higher product quality bar rooted in search reliability standards.

Coding revealed the capability curve

OpenAI recognized the potential of large language models earlier partly because the coding use case via GitHub Copilot demonstrated more pronounced sequential jumps between GPT versions than general language tasks alone.

Millisecond latency budgets enforce speed

Search teams operate under strict latency budgets where shaving off milliseconds earns credits for future features, resulting in a 30% latency improvement over five years despite massive AI capability additions.

Gemini Flash optimizes capability per millisecond

Google deliberately trades maximum capability for speed with Flash models that deliver 90% of Pro model performance at radically lower latency, enabled by vertical integration with seventh-generation TPUs.

Speed reflects technical health

Pichai views latency as a distinguishing feature that almost always reflects superior technical underpinnings, requiring rigorous balancing between the frontier of capabilities and user-perceived responsiveness.

Search becomes an agent manager

The future of search involves handling asynchronous, long-running tasks where users delegate complex workflows to AI agents rather than typing one-line queries into a search box.

Sentiment shift validated vertical strategy

After negative sentiment drove shares to approximately $150, Gemini 2.5's multimodal capabilities demonstrated Google's full-stack strength, justifying plans to scale CapEx from $30 billion to roughly $175-180 billion.

AI is expansionary, not zero-sum

Google views the AI transition as analogous to the shift from single-cell to complex organisms, where Search and Gemini will overlap and diverge simultaneously rather than cannibalize each other.