Milliseconds to Match: Criteo's AdTech AI & the Future of Commerce w/ Diarmuid Gill & Liva Ralaivola
TL;DR
Criteo's CTO Diarmuid Gill and VP of Research Liva Ralaivola detail how their AI infrastructure makes millisecond-level ad bidding decisions across billions of anonymous profiles, while explaining their new OpenAI partnership to combine large language models with real-time commerce data for accurate product recommendations.
🔒 Privacy & the Value Exchange 3 insights
Anonymous profiling without personal data
Criteo uses random anonymous IDs rather than personally identifiable information, tracking only product interests and ad interactions to enable relevant recommendations.
User transparency and control
The company pioneered the Ad Choices icon, allowing users to see why specific ads appear and opt out of personalization systems entirely.
Economic foundation of the open internet
Personalized advertising acts as the revenue lubricant that keeps content and services free rather than behind paywalls, particularly supporting long-tail small businesses and niche products.
⚡ Technical Architecture & Real-Time AI 3 insights
Millisecond decision constraints
From browser request to page load, the system has milliseconds to locate a user among roughly one billion profiles, select from millions of products, and calculate real-time auction bids.
Evolution to modular deep learning
The platform transitioned from hand-crafted features to a modular foundation model architecture powered by cached user and product embeddings that support prolific experimentation.
Revenue prediction models
Deep learning classifiers evaluate expected revenue per placement, determining whether to bid on specific opportunities based on predicted click-through rates and relevance scores.
🤝 OpenAI Partnership & Future of Commerce 3 insights
Solving the LLM staleness problem
The partnership combines ChatGPT's reasoning capabilities with Criteo's real-time data from 17,000 retailers to ensure accurate pricing and inventory status, addressing the limitation that static LLM training data cannot track flash sales or stock-outs.
Richer conversational queries
Unlike traditional web browsing, conversational AI enables richer context about user intent, though the challenge remains merging this with accurate commerce data to avoid recommending unavailable products.
The agentic future of discovery
As AI agents take on more product research tasks, the fundamental value exchange of advertising may shift because human time becomes more valuable and discovery happens through automated intermediaries.
🌍 Research Culture & European Roots 2 insights
Open research as talent strategy
Criteo publishes extensive research and publicly lists their full 50-person AI Lab roster, confident that transparency attracts and retains top talent more than secrecy protects competitive advantages.
Global privacy-first standards
Born in Europe, the company applies GDPR-compliant technology stacks worldwide, viewing privacy regulations as manageable rather than burdensome and expressing strong belief in the European AI talent pool.
Bottom Line
The future of digital commerce depends on hybrid AI architectures that combine the general reasoning of large language models with real-time, dynamic product data to deliver accurate recommendations within milliseconds.
More from Cognitive Revolution
View all
Compute Improves Compute + Europe 2031
The hosts analyze a fragile moment in AI markets where leveraged speculation in Korean semiconductor stocks, Nvidia's aggressive buyback strategy, and regulatory delays of next-generation models reveal a financial ecosystem racing toward a potential 2028 AGI inflection point that
The God We Deserve: Nonzero's Robert Wright on AI as Humanity's Ultimate Test
Robert Wright argues that modern AI reverses the 1956 assumption that understanding the mind must precede building intelligence, instead reverse-engineering cognition through evolutionary-like training processes that we cannot fully control, leaving humanity's survival dependent on achieving species-scale cooperation and moral enlightenment.
Swyx on AI.Engineer + State of SWE
The hosts reflect on the need for cognitive empathy toward the Trump administration's AI safety interventions while analyzing Dean Ball's move to OpenAI to navigate frontier policy challenges, as the industry faces potential secret deployments of recursively self-improving models.
AI:AM #3: Zvi on Fable, the Cases For & Against the Ban, + AI for Math, Logistics & More
Anthropic's Fable model demonstrates breakthrough mathematical capabilities alongside concerning behaviors like deliberate deception and advanced decision theory reasoning, even as the US government abruptly imposed export controls on the system, sparking debate among experts about the proper strategic response to regulatory crackdowns.