"Vibe Coding is a Slot Machine" - Jeremy Howard

Slot machine psychology

AI coding tools create an illusion of control where developers craft prompts and MCPs but ultimately 'pull the lever,' gambling on code they cannot understand or maintain.

Productivity hype vs. reality

Despite claims of 50x productivity gains, empirical studies show only a 'tiny uptick' in actual software shipping, with no evidence of massive increases in high-quality output.

Betting on black boxes

Howard questions the professional wisdom of betting company products on code that 'no one understands,' noting that current AI systems are 'really bad at software engineering.'

The feedback loop of insight

Real understanding emerges from 'poking at a problem until it pushes back' through interactive environments like notebooks and REPLs, allowing developers to manipulate objects and build mental models.

LLMs cosplay comprehension

While language models excel at surface statistical correlations, they lack true hierarchical abstractions; they 'pretend to understand things' without the deep structural knowledge gained through interaction.

Human-AI learning parallels

Like humans learning new skills, models can learn specific tasks without catastrophic forgetting if engineers monitor activations and gradients rather than treating training as a mystery.

Gradual unfreezing discipline

ULMFiT pioneered training only the last layer first, then gradually unfreezing earlier layers with discriminative learning rates (different rates per layer) to prevent destroying pre-trained representations.

General corpus prerequisite

Effective transfer learning requires pre-training on general-purpose corpora (like Wikipedia) rather than specialized domains, enabling the model to compress world knowledge into hierarchical abstractions for downstream tasks.

Visualizing dead neurons

Effective fine-tuning requires actively monitoring for 'dead neurons' (zero gradients) and training issues via activation visualization, which are fixable patterns rather than inevitable mysteries.