← All speakers

Bio, Work & Ideas

Jason Liu

Conference affiliation: Developer Experience, OpenAI · OpenAI · 2026

Jason Liu is a developer experience engineer on OpenAI’s Codex team and the creator of Instructor, the open-source library that helped establish structured outputs as a practical foundation for language-model applications. His work gives developers concrete ways to make AI systems predictable: typed schemas, validated responses, actionable evaluation, and agent workflows that preserve context without surrendering human oversight.

Liu studied computational mathematics and statistics at the University of Waterloo, worked as a data scientist at Meta, and became a staff machine-learning engineer at Stitch Fix. There, he built Flight, a framework for moving recommendation logic into observable, maintainable production systems. He subsequently founded 567 Studios and developed a consulting and education practice focused on retrieval, evaluation, and AI products; his teaching continues through Systematically Improving RAG.

Instructor distilled that experience into a lightweight interface built around Pydantic models, Python type hints, validation, and retries. Developers describe the object they need; the model returns structured data that conventional software can inspect and use. Liu released Instructor 1.0 in 2024, extending support across providers and programming languages. OpenAI later named Instructor among the projects that inspired its Structured Outputs API.

  • Structure is an engineering contract. Liu treats schemas as executable specifications encompassing the prompt, response, and business rules. Validators can catch fabricated URLs, inconsistent receipt totals, and unsupported claims; informative errors enable targeted retries. Typed search requests can encode dates, sources, and dependencies, letting conventional software execute retrieval plans and parallel searches. His work on Pydantic and language models argues that developers should retain ownership of objects, functions, and control flow.
  • Impact-weighted product evaluation. His open-source Kura project summarizes and clusters chatbot conversations to identify recurring requests, frustration, tool failures, and differences between user segments without exposing individual conversations. Combining usage with performance reveals whether a team should repair a heavily used weakness, promote an overlooked capability, or disregard an inconsequential edge case. Evaluation becomes a product-roadmap instrument instead of an isolated quality score.
  • Computer use with permission boundaries. Liu differentiates native computer control, authenticated Chrome sessions, and the in-app browser according to the access each task requires. He emphasizes approval and organizational safeguards around consequential actions, recognizing that an agent capable of switching interfaces can also circumvent restrictions unless its permissions remain explicit.

Liu also writes about taste, attention, and judgment: as AI makes execution easier, recognizing quality and articulating what needs improvement become more valuable. His approach makes automation serve informed human decisions, not replace them.

Talks by Jason Liu

5 talks
AI Engineer World's Fair 20261:15:02

Full Workshop: Setting Yourself Up for Success — Jason Liu, OpenAI Codex

OpenAI developer-experience engineer Jason Liu leads an interactive workshop on using Codex as a general-purpose assistant for computer use and sustained knowledge work. He demonstrates persistent memory systems, context compaction, parallel threads and sub-agents, Slack-based automation, personal knowledge and relationship tracking, long-running task…

Jason Liu

Coding and developer tools · Agent engineering · RAG, context, and search

AI Engineer World's Fair 202519:23

How to look at your data; what to look for, how to measure

Jeff Huber and Jason Liu present a two-part approach to improving AI applications by examining both retrieval inputs and application outputs. Huber explains how generated and real queries, application-specific embedding evaluations, and recall@10 can reveal performance differences that broad MTEB rankings obscure, illustrated with a Weights & Biases…

Jeff Huber · Jason Liu

Other / unclassified · RAG, context, and search · Agent engineering

AI Engineer World's Fair 202415:21

Pydantic is STILL all you need

Jason Liu argues that Pydantic models and Instructor-style response schemas provide a more reliable, ergonomic foundation for LLM applications than parsing unstructured JSON. He discusses multilingual implementations, integrations with multiple model providers, typed response models, validated streaming, and field- and model-level validators, illustrating…

Jason Liu

Developer workflows and testing · Reasoning and models · Other / unclassified

AI Engineer World's Fair 202435:21

What We Learned From A Year of Building With LLMs

Six coauthors translate a year of real-world LLM application experience into strategic, operational, and tactical guidance. They argue that models themselves are rarely a durable moat, discuss switching providers as capabilities and costs change, examine AI engineering roles and team workflows, and emphasize production evaluations, monitoring, guardrails,…

Eugene Yan · Hamel Husain · Jason Liu · Dr Bryan Bischof · Charles Frye · Shreya Shankar

Leadership · Infrastructure and deployment · Reasoning and models

References