AI Engineer Summit 2023

The 1,000x AI Engineer: Swyx

Swyx· Writer and editor, Latent Space9:27

Read the talk

The 1,000x AI Engineer

AI engineering combines better tools, software built around models, and increasingly capable agents—but its largest multiplier may be how engineers teach and organize one another.

From a talk by Swyx

What if the clicker had more dimensions?

A presentation clicker moves forward and backward. Swyx arrives carrying a Magic Trackpad instead: what could a presenter do with more dimensions? His Tome slides extend the experiment into two-dimensional navigation. Before the argument begins, the presentation itself is an invitation to reconsider a familiar tool.

The deliberately provocative 1,000x title asks engineers to make a similar adjustment to their ambitions. It is an invitation to think in higher orders of magnitude, not a measured productivity result. Even the AI-generated artwork belongs to the experiment: at an AI conference, the medium should participate in the subject.

0:160:24
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

0:16 · section reference included

Being just in time

When would you want to be alive if you were a mathematician? Swyx nominates the era around 600 AD, crediting Brahmagupta with inventing zero after a roughly four-thousand-year wait. That compressed historical example introduces a broader idea: some periods make participation in a field unusually consequential. The mathematics slide widens the view from geometry and primes to zero and algebra, then calculus and probability.

Slide listing geometry and primes, zero and algebra, and calculus and probability above an illustrated timeline of mathematicians.Open full source frame
“Imagine you were a Mathematician” pairs three historical periods with a timeline of mathematics.

For physics, he points to 1905 and 1927. The Solvay Conference supplies an explicit inspiration for this gathering: Einstein, Marie Curie, and figures familiar to an audience that has recently seen Oppenheimer. His other suggested windows are 1900–1930 for cars and 1980–2010 for personal computing products. The common thread is a period when foundational changes create room for many people to contribute.

That framing answers the internet lament about being born too late to explore Earth and too early to explore the stars. Swyx adds a demographic claim: humanity is roughly 73% of the way through what he calls “all concurrent intelligences,” conditional on neither expanding our intelligence nor going to other planets. The denominator is not defined, so the percentage cannot establish where we stand. The underlying invitation is clearer: AI offers a field in which the audience may be just in time.

1:041:14
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

1:04 · section reference included

From technology cycles to training compute

Carlota Perez’s Technological Revolutions and Financial Capital provides the next frame: technological revolutions have installation and deployment periods. This longer perspective matters when enthusiasm coexists with the suspicion that AI might be another fad, or another Web3. Swyx places the Industrial Revolution, railways, heavy engineering and steel, oil, and the recent technology revolution in that historical sequence. He describes these technology cycles as lasting roughly 50–70 years.

Where should the AI cycle begin? Swyx chooses AlexNet in 2012, roughly a decade before the talk. Unlike a schematic technology curve with an undefined vertical axis, the chart he describes uses the amount of compute devoted to training models. He identifies AlexNet as the blue-dot inflection where the field began recognizing that scale worked. Training compute measures resources committed to model development; it is not itself a measure of intelligence or engineer productivity. The practical instruction is to take continued scaling seriously when deciding what to build.

2:362:53
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

2:36 · section reference included

Three reasons to plan for more

Swyx groups three scaling arguments around the number six:

  • Compute investment. An unnamed investor recommends planning for roughly six orders of magnitude more compute by the end of the decade. This is a planning forecast, accompanied by an expectation of continued investment in language models.
  • Conceptual progress. Swyx credits John Carmack with the view that six key insights remain on the path to AGI. More hardware and new ideas are distinct sources of progress; neither establishes the other.
  • Human-scale analogy. Swyx attributes to George Hotz an analogy in which GPT-3 required about one person-year of compute and GPT-4 about 100 person-years. He then extends the comparison across six further model generations to a hypothetical GPT-10, suggesting compute beyond that of every human who has ever lived. The human-compute conversion and the scaling formula are not specified in the talk, so this remains a conditional analogy rather than a model forecast established by measurement.

These arguments serve a planning purpose: an engineer’s future working environment will be shaped by investment and research far larger than any individual project. Being present at the right moment makes it possible to build on those changes rather than having to produce every improvement oneself.

4:144:23
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

4:14 · section reference included

The engineering work around the model

At the organizational level, AI engineering occupies an opening among ML researchers, ML engineers, and software engineers. Swyx makes a supply-and-demand argument: he estimates roughly 100,000 data-science and ML engineers, against GitHub’s claimed 100 million registered developers. He explicitly allows that the relevant developer population might instead be 40–50 million. These are not matched occupational counts; his prediction that AI engineers will outnumber ML engineers rests on the much larger pool of people who already write software.

The companion essay, The Rise of the AI Engineer, develops the emerging role. Here, the immediate distinction is engineering rather than prompting alone. In the talk’s framing, LLMs are not yet AGIs: useful products require code that coordinates models inside larger software systems.

The slide makes that design space concrete. One diagram places an LLM core inside a shell of code; another shows code coordinating multiple LLM components. In the first arrangement, software surrounds a model. In the second, software also determines how model components work together. That surrounding coordination is a substantial part of the product—and it uses skills software engineers already have.

Slide titled “LLM Core apps are limited by LLM capabilities,” with text about composing software systems and diagrams contrasting an LLM core inside a code shell with code coordinating multiple LLM components.Open full source frame
LLM capabilities and the software systems built around them.
5:065:21
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

5:06 · section reference included

Three meanings of AI engineer

The label covers three different relationships between software engineers and AI. First comes the engineer using AI tooling, illustrated by Copilot. Second comes the engineer building an AI product, illustrated by Midjourney. Third comes an AI product that could itself perform the engineer’s work, illustrated prospectively by AutoGPT and possibly Replit Ghostwriter. Ghostwriter is a historical coding-assistance example here; its inclusion in the replacement category expresses a possibility, not a demonstrated replacement capability.

To distinguish assistance from replacement, Swyx borrows the language of level-two and level-three self-driving systems. The consequential question is whether the human remains in the loop or serves as the fallback. He then names the three categories:

CategoryWho does the engineering?AI’s role
AI-enhanced engineerA human software engineerAssists the engineer
AI product engineerA human building an AI productSupplies product capabilities
AI engineer agentA nonhuman agentPotentially performs engineering work

The categories separate the use of AI tools, the construction of AI products, and the delegation of engineering work to AI.

6:086:20
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

6:08 · section reference included

Stacking improvements

Swyx playfully casts enhanced engineer, product engineer, and engineer agent as a career-ladder progression. The framing draws inspiration from Amjad Masad’s appearance on a16z’s The 1000x Developer; Amjad is also the next speaker. Swyx attributes to Sam Altman the observation that he sees 1,000x engineers at OpenAI every day. The anecdote motivates a decomposition into stackable improvements rather than supplying a measured comparison.

The 1,000x ambition becomes three compounding 10x improvements:

10×10×10=1,00010 \times 10 \times 10 = 1{,}000

The multiplication does not identify three proven, independent productivity gains. It gives the audience a way to look for improvements at different layers, with speakers over the next two days addressing different parts of that stack. The personal question is where AI can increase productivity in one’s own work and life.

The same ambition extends to the gathering itself. Swyx sees a small room that could grow by 100x or 1,000x, and treats participation as part of that growth: meet other attendees, talk with speakers, and engage with sponsors. Tools and presentations alone do not create a field; the people making connections also contribute to its capacity.

7:017:20
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

7:01 · section reference included

The multiplier that travels home

The final account of engineering impact is deliberately nontechnical: a 10x engineer can be someone who teaches ten other people what they know. This shifts attention from how much one person produces to how much capability they help others acquire.

Swyx expresses the widening reach through O(N), O(N²), and O(2ᴺ). These are network-growth analogies, not measured outcomes for the conference. At the first level, attendees learn from talks, consume content, and welcome others into conversations through the Pac-Man rule. At the next level, they help others learn. His own first blog post came from encouragement at a conference like this one—and its subject was machine learning.

The final step happens after the event: go home, build local networks of AI engineers, and help create further networks of learning. The opportunity is not confined to absorbing knowledge in this room. It includes giving other people a place to begin, so that experiencing the start of an industry becomes something participants can carry into their own communities.

8:088:18
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

8:08 · section reference included

Resources

From the talk

  • AI and computeArticle

    OpenAI's 2018 analysis of training-compute growth in large AI experiments beginning in 2012.

  • A George Hotz interview with a transcript discussing tinygrad, hardware and the person-of-compute analogy.

  • Replit's 2023 introduction to Ghostwriter Chat and its code-assistance features.

Transcript download
Read the transcript and explore slides

Loading transcript and slides…