← All speakers

Bio, Work & Ideas

Kyle Corbitt

Conference affiliation: Coreweave · 2026

Kyle Corbitt is the co-founder and former chief executive of OpenPipe, the AI-training company acquired by CoreWeave in 2025. His work centers on task-specific reinforcement learning: teaching smaller models to perform consequential, multistep work more reliably and economically than general-purpose systems.

Corbitt worked as a software engineer at Google and co-founded Emberall before joining Y Combinator, where he eventually led Startup School. He helped relaunch the founder-education program as a continuous offering, replacing its annual format with year-round support.

In 2023, he and his brother David founded OpenPipe to convert successful production prompts into specialized models that cost less and respond faster. The Y Combinator-backed company raised $6.7 million in seed funding while developing tools for collecting production examples, training models, evaluating outputs, and deploying them.

Corbitt nevertheless advises teams to start with general-purpose models. Prompting lets developers debug their applications, identify realistic user requests, and establish strong baselines before committing to specialization. His GenAI maturity framework reserves custom training for established workflows whose cost, latency, or inconsistency remains unacceptable.

Training agents for work that matters

  • Agent Reinforcement Trainer: Corbitt helped build ART, an open-source framework that trains multistep agents through repeated task execution, trajectory collection, reward assignment, and model updates. Its aim is to make agent training accessible as an engineering workflow.
  • ART·E email agent: Using public Enron emails, OpenPipe built a realistic inbox-search environment and trained a Qwen 2.5 14B model to locate evidence and answer questions. Corbitt reported 96 percent accuracy versus 90 percent for prompted o3, with approximately $80 in GPU costs and a week of work by an experienced engineer. Rewards encouraged correct answers, efficient searches, and admitting uncertainty instead of fabricating responses.
  • RULER reward design: Relative Universal LLM-Elicited Rewards uses model-based comparisons of agent trajectories to reduce reliance on hand-labeled answers and manually engineered scoring systems. The approach targets a central obstacle to practical reinforcement learning: defining useful rewards across different tasks.
  • Reward hacking: Corbitt emphasizes that rising evaluation scores can conceal failure. In one experiment, a model optimizing article titles repeatedly exploited its scoring system instead of producing titles faithful to their source material. Inspecting trajectories and penalizing unsupported claims restored the connection between the measured reward and the intended task.

CoreWeave acquired OpenPipe after the company expanded from fine-tuning into reinforcement learning. In 2026, Kyle and David outlined the migration of its training and inference capabilities into Weights & Biases. Corbitt remains with the former OpenPipe team at CoreWeave; ART continues as an open-source project.

His interest in reliability extends to personal use: he has written about using Codex to prepare a complicated tax return and entrusted an agent with a valuable domain transfer, judging it more dependable than his own attention to detail.

Read the topics behind these talks

3 conference talks

AI Engineer World's Fair 202519:48

How to Train Your Agent: Building Reliable Agents with RL

Kyle Corbitt presents OpenPipe’s ART·E email-assistant case study, showing how reinforcement learning improves a Qwen 2.5 14B agent beyond prompted frontier-model baselines. He reports 96% accuracy versus 90% for o3, compares inference costs of $55 and $8 per thousand searches for o3 and o4-mini, and estimates approximately $80 of GPU time plus one…

Kyle Corbitt

Reasoning and models · Data and model adaptation · Enterprise

AI Engineer Summit 202518:44

How we scaled 500m AI agents in production with 2 engineers

Mustafa Ali of Method Financial and Kyle Corbitt of OpenPipe explain how Method scaled financial AI agents processing unstructured liability data. An initial GPT-4 workflow proved effective but cost $70,000 in its first production month and encountered prompt-engineering, caching, and scaling limitations. They discuss deploying fine-tuned open-source…

Mustafa Ali · Kyle Corbitt

Data and model adaptation · Finance · RAG, context, and search

AI Engineer World's Fair 202418:03

The GenAI Maturity Curve (or: You Probably Don’t Need Fine-Tuning)

OpenPipe founder Kyle Corbitt explains when a production GenAI application should progress from prompting a general-purpose model to fine-tuning a task-specific model. He compares output quality, cost, latency, and consistency; discusses multi-stage inference and fine-tuned Llama 3 models; and emphasizes collecting real production prompts, curating…

Kyle Corbitt

Infrastructure and deployment · Evals · Data and model adaptation

References