"Vibe Coding is a Slot Machine" - Jeremy Howard
TL;DR
Deep learning pioneer Jeremy Howard argues that 'vibe coding' with AI is a dangerous slot machine that produces unmaintainable code through an illusion of control, contrasting it with his philosophy that true software engineering insight emerges from interactive exploration (REPLs/notebooks) and deep engagement with models, drawing on his foundational ULMFiT research to demonstrate how understanding—not gambling—drives sustainable productivity.
🎰 The 'Vibe Coding' Trap 3 insights
Slot machine psychology
AI coding tools create an illusion of control where developers craft prompts and MCPs but ultimately 'pull the lever,' gambling on code they cannot understand or maintain.
Productivity hype vs. reality
Despite claims of 50x productivity gains, empirical studies show only a 'tiny uptick' in actual software shipping, with no evidence of massive increases in high-quality output.
Betting on black boxes
Howard questions the professional wisdom of betting company products on code that 'no one understands,' noting that current AI systems are 'really bad at software engineering.'
🧠 Interactive Understanding 3 insights
The feedback loop of insight
Real understanding emerges from 'poking at a problem until it pushes back' through interactive environments like notebooks and REPLs, allowing developers to manipulate objects and build mental models.
LLMs cosplay comprehension
While language models excel at surface statistical correlations, they lack true hierarchical abstractions; they 'pretend to understand things' without the deep structural knowledge gained through interaction.
Human-AI learning parallels
Like humans learning new skills, models can learn specific tasks without catastrophic forgetting if engineers monitor activations and gradients rather than treating training as a mystery.
⚙️ ULMFiT & Transfer Learning 3 insights
Gradual unfreezing discipline
ULMFiT pioneered training only the last layer first, then gradually unfreezing earlier layers with discriminative learning rates (different rates per layer) to prevent destroying pre-trained representations.
General corpus prerequisite
Effective transfer learning requires pre-training on general-purpose corpora (like Wikipedia) rather than specialized domains, enabling the model to compress world knowledge into hierarchical abstractions for downstream tasks.
Visualizing dead neurons
Effective fine-tuning requires actively monitoring for 'dead neurons' (zero gradients) and training issues via activation visualization, which are fixable patterns rather than inevitable mysteries.
Bottom Line
Stop gambling with AI-generated code you don't understand and instead build software through interactive exploration, as sustainable engineering requires deep comprehension of the systems you create, not just prompts that pull a lever.
More from Machine Learning Street Talk
View all
He won a Nobel here for AlphaFold. Then he left. - John Jumper
Nobel laureate John Jumper explains how AlphaFold solved the 50-year protein structure prediction problem by collapsing years of experimental work into minutes, while emphasizing its narrow scope as a starting point for biological research rather than a universal model of life.
The Ex-Congressman Who Says AI Isn't Unstoppable — Brad Carson
Former Congressman and Pentagon official Brad Carson argues that AI development is not inevitable and can be controlled through strategic regulation, particularly by treating AI as products subject to liability laws rather than granting them human rights, while leveraging chip controls and mandatory testing to shape the technology's future.
Inference, not prediction — Prof. Michael I. Jordan on what modern AI is still missing
Professor Michael I. Jordan critiques the hype around AGI and prediction-based LLMs, arguing that modern AI lacks economic and social thinking; he advocates for 'inference' systems grounded in game theory and market dynamics that respect human agency and create collective value.
Inference, not prediction — Prof. Michael I. Jordan on what modern AI is still missing
Professor Michael I. Jordan critiques AGI as harmful PR that demoralizes young engineers, arguing that true intelligence requires economic and social systems thinking—treating billions of humans as agents in value-creating ecosystems—rather than isolated prediction engines built without intellectual foundations.