Warp Claims 2,000 Monthly PRs with Its AI Factory

Key Takeaways

1Warp claims to generate 2,000 pull requests per month through its AI software factory, Wilson

2The system tracks the cost per PR, uses LLMs as judges, and maintains human review as a bottleneck

3The pipeline transitions from Slack to GitHub with automatic triggers and relies on tools like Sentry, Figma MCP, Granola, and Grok Bot

Why it matters : Warp highlights advanced automation in software development while emphasizing the ongoing role of humans in the final validation.

Warp introduces an AI-driven software factory that transforms an idea shared in Slack into a merged pull request. Zach Lloyd, its CEO, details the metrics, human bottlenecks, and cost-quality trade-offs. The company claims to generate 2,000 PRs monthly through this system.

Cost per PR, LLM Evaluation, and Human Bottlenecks

Zach Lloyd notes that human code review remains a bottleneck. The cost per pull request is tracked across different model configurations. LLMs are used as judges to evaluate each agent's execution, and the number of human interactions per PR serves as an indicator of automation and productivity. A cost-quality Pareto chart is constructed to select the models. Rating agents are employed to identify failure modes, with self-improving workflows, and the factory self-improves based on failed executions.

From Ticket to Merge: A Cloud Pipeline and Triggers

The factory system transforms an idea expressed in Slack into a merged PR. The workflow passes through Slack, Linear, GitHub, and then QA, with Slack serving as the entry layer. Linear is used for project tracking and ticket management, while GitHub handles version control and pull request management. Automatic factory triggers are employed, and Sentry is involved for crash reporting and automated issue triggers.

Le brief IA que lisent les pros

Le brief IA que les pros lisent chaque soir

Les 7 actus IA du jour, décryptées en 5 min. Gratuit.

Inclus dès l'inscription : notre sélection des meilleurs guides & comparatifs IA.

Choisissez votre rythme

Gratuit · Pas de spam · Désabonnement en 1 clic

Claimed Capabilities and the Scope of the Wilson Factory

Warp claims to ship 2,000 pull requests per month through its AI factories. A software factory is presented as going beyond a simple coding agent, and Warp names its AI factory Wilson. The platform is an AI-powered terminal and software factory, with fully cloud-based factories. Warp has been designed as a modern, AI-native alternative to traditional terminals. The tool is used by tens of thousands of engineers, with Zach Lloyd as its CEO and co-founder.

MCP Tools and Non-Technical Uses Mentioned by the CEO

Figma is used via Figma MCP, and Granola provides meeting notes with MCP integration, with demonstrations mentioned for Figma MCP, Granola MCP, and GOG CLI. Zach Lloyd also discusses the use of AI for non-technical CEO tasks. Grok Bot is cited for quick inference with cost-quality trade-offs. A parallel task thinking mode rather than sequential and a prompting strategy for factory tasks are highlighted. A personal X link is shared for contacting him.