Three Kinds of Software Survive: Tasklet's Andrew Lee on Competing to be a Horizontal Platform
TL;DR
Tasklet CEO Andrew Lee reveals a complete architectural rebuild shifting from workflow automation to a general-purpose AI agent platform, emphasizing file-based context management and aggressive summarization to control token costs, while outlining a strategic pivot toward becoming a horizontal platform capable of integrating any frontier model as competition intensifies with API providers like Anthropic.
🧠 Agent Architecture & Context Management 3 insights
File system as agent memory
Tasklet shifted from feeding chat history directly to LLMs to storing context in a file system, treating files as the agent's persistent memory and sending only hints or pointers to the model to reduce token costs.
Hierarchical compression strategy
Implemented multi-level summarization where recent messages retain full fidelity while older history undergoes progressive stripping of thinking blocks and tool responses, eventually collapsing into LLM-generated summaries.
Cache-optimized bucketing
Organized historical data into cache-aware buckets that minimize prefix changes, reducing expensive recomputation while utilizing five-minute caching windows for active sessions and persisting compressed states across runs.
💸 Economic Pressures & Strategic Pivot 3 insights
Supplier competition threat
Anthropic's Claude Max offers direct customers approximately five times the token volume available via API at the same price, creating direct competition between Tasklet and its critical infrastructure provider.
Token costs constrain capabilities
High API pricing has forced Tasklet to remain on Claude Opus 4.6 rather than upgrading to 4.7, demonstrating how token economics directly dictate technical capabilities and feature availability.
Evolution toward horizontal platform
Pivoting from single-model dependency to a model-agnostic 'mecha suit' architecture capable of harnessing frontier models from any provider to avoid commoditization and survive the AI transition.
🏢 Market Positioning & Software Taxonomy 3 insights
Three survivors of AI transition
Lee predicts only three software categories will survive: horizontal platforms (general-purpose orchestration), API-first infrastructure like Stripe, and outcome-based solutions like Finn charging $0.99 per resolved ticket.
Computer use as core infrastructure
Rebuilt computer use from an optional add-on to essential infrastructure, with every agent now operating persistent headless VMs and browser environments as critical path components rather than afterthoughts.
Integration architecture overhaul
Completely rewrote connection systems to support multiple instances of identical services (e.g., three Gmail accounts) while granting agents greater autonomous control over external system management.
Bottom Line
As AI providers increasingly compete with their own customers, software companies must evolve into horizontal, model-agnostic platforms while implementing aggressive file-based context compression to survive economically.
More from Cognitive Revolution
View all
The Model Eats the Scaffolding: DeepMind's Logan Kilpatrick & Tulsee Doshi on 3.5 Flash, Omni & More
Google DeepMind's Logan Kilpatrick and Tulsee Doshi detail the launch of Gemini 3.5 Flash, Omni video generation, and Spark agent features, emphasizing a strategic pivot toward cost-adjusted performance and standardized agent infrastructure ('anti-gravity') across Google's product ecosystem rather than competing solely on absolute model capability.
Milliseconds to Match: Criteo's AdTech AI & the Future of Commerce w/ Diarmuid Gill & Liva Ralaivola
Criteo's CTO Diarmuid Gill and VP of Research Liva Ralaivola detail how their AI infrastructure makes millisecond-level ad bidding decisions across billions of anonymous profiles, while explaining their new OpenAI partnership to combine large language models with real-time commerce data for accurate product recommendations.
"Descript Isn't a Slop Machine": Laura Burkhauser on the AI Tools Creators Love and Hate
Descript CEO Laura Burkhauser distinguishes 'slop'—mass-produced algorithmic arbitrage for profit—from necessary 'bad art' created while learning new mediums. She reveals a clear hierarchy in creator acceptance of AI tools: universal love for deterministic features like Studio Sound, frustration with agentic assistants like Underlord, and visceral opposition to generative video models, while outlining Descript's strategy to serve creators without becoming a content mill.
The RL Fine-Tuning Playbook: CoreWeave's Kyle Corbitt on GRPO, Rubrics, Environments, Reward Hacking
Kyle Corbitt explains that unlike supervised fine-tuning (SFT), which destructively overwrites model weights and causes catastrophic forgetting, reinforcement learning (RL) optimizes performance by minimally adjusting logits within the model's existing reasoning pathways—delivering higher performance ceilings and lower inference costs for specific tasks, though frontier models may still dominate creative domains.