CCXO Notes
CXO Notes› Library› AI & technology strategy

2026-08-21

The Future of Software

Sherwin Wu, head of engineering for OpenAI's API and developer platform, reveals that 95% of OpenAI engineers now use Codex daily and 100% of PRs are reviewed by AI. He frames the engineering role shift through the lens of SICP's “sorcery” metaphor — engineers are becoming sorcerers managing fleets of 10-20 parallel agents. The conversation spans the second-order effects of AI leverage (a coming startup boom), why most enterprise AI deployments have negative ROI, and why the models will “eat your scaffolding for breakfast.”

The talk itself: youtube.com/watch?v=B26CwKm5C1k

The verdict

OpenAI's API engineering lead on a team where 95% use Codex daily and every pull request is reviewed by a model. The most concrete account of an AI-native engineering org here.

Best forChanging how your team writes and reviews code
Length1h19m
Quotes20 timestamped

The argument, in 7 sections

20 quotes, none repeated

01Theme 1: Engineers Are Becoming Sorcerers

The most striking data point from the conversation: at OpenAI, 95% of engineers use Codex daily and 100% of PRs are reviewed by Codex. Engineers who use Codex more open 70% more PRs — and the gap is widening. IC engineers are essentially becoming tech leads, managing fleets of 10-20 parallel AI agent threads simultaneously.

Sherwin draws on SICP (Structure and Interpretation of Computer Programs), the MIT textbook from 1980 that described programming as sorcery — languages as incantations, engineers as wizards casting spells. That metaphor, he argues, is now literally playing out: “It literally feels like we're wizards now... we're closer to having it feel like this magical experience where we're casting all these spells and having software do all these things for you.”

The Sorcerer's Apprentice from Fantasia is the sharper analogy. When engineers dispatch 20 Codex threads, there's real skill and seniority required — you don't want the brooms going off the rails. But it's extremely high leverage.

“I don't know what job has changed more in the past couple years... where the job of an engineer is so different.”
7:02 · Sherwin Wu
“It literally feels like we're wizards now. You know, it feels like we're closer to making it feel like this magical experience where we're casting all these spells and having software do all these things for you.”
11:39 · Sherwin Wu
“This is the worst the models will ever be.”

The single most important mental model for building in AI right now — things get better fast, so build for where they're going.

5:55 · Kevin Wheel (quoted by Sherwin)

02Theme 2: The One-Person Billion-Dollar Startup — and Its Ripple Effects

Sherwin thinks people aren't pricing in the second and third order effects of extreme individual leverage. The obvious first-order effect is the “one-person billion-dollar startup.” But the real implications are:

Second order: If one person can build a billion-dollar company, it's also way easier for anyone to build any startup. Sherwin predicts a “huge startup boom and SMB-style boom” — anyone can build vertical software. We might enter a “golden age of B2B SaaS.”

Third order: For every one-person billion-dollar startup, there might be “a hundred other small startups building bespoke software” to support it. The $10M-$50M individual business becomes life-changing for founders. But this could shrink venture-scale returns — the VC ecosystem changes when most companies are smaller.

“In order to enable a one-person billion-dollar startup, there might be a hundred other small startups building bespoke software that works extremely well.”
26:16 · Sherwin Wu
“As an individual, it's actually pretty great to have a $10 million business. That's like enough — you're set for life.”
27:08 · Sherwin Wu

03Theme 3: Why Most Enterprise AI Deployments Have Negative ROI

Sherwin observes that many companies are deploying AI top-down without bottom-up adoption. The anti-pattern: CEO mandates “AI-first,” ties it to performance reviews, but employees have no idea what to do with the tools and no one to learn from.

The companies where it works have both top-down buy-in AND bottom-up evangelism. They staff internal “tiger teams” — often not software engineers, but “software-engineering-adjacent” people like an operations lead who's an “Excel wizard” — who explore capabilities, build best practices, run hackathons, and create internal excitement.

“A lot of these AI deployments are actually negative ROI... a lot of these AI deployments don't have bottoms-up adoption. Like it was an exec mandate and it's extremely top down and is very divorced from what the actual work looks like.”
41:10 · Sherwin Wu
“Find the high performers in AI adoption and empower them. Let them build hackathons, hold seminars, do knowledge sharing, kind of create the seeds of excitement internally.”
43:58 · Sherwin Wu

04Theme 4: The Models Will Eat Your Scaffolding for Breakfast

Sherwin cites a quote from Nicholas, founder of Finool: “The models will eat your scaffolding for breakfast.” In 2022-2023, everyone built elaborate scaffolding around weak models — vector stores, agent frameworks, complex embedding pipelines. As models improved, much of that scaffolding became unnecessary. File-based skills, agents.md files, and simple search replaced complex RAG pipelines.

Even current scaffolding (skills files, context management) may eventually be eaten. Sherwin's advice: “Make sure you're building for where the models are going and not where they are today.” The best startups build products for a capability level that's ~80% of the way there today — then when the model improves, the product suddenly clicks.

He connects this to the “bitter lesson” — the less you over-complicate AI systems, the more they scale. Even OpenAI's own API team has been “guilty of this” — taking architectural turns they shouldn't have.

“The models will eat your scaffolding for breakfast.”

A warning against over-engineering around current model limitations — vector stores, agent frameworks, and complex pipelines all have an expiration date.

45:03 · Nicholas of Finool (quoted by Sherwin)
“Make sure you're building for where the models are going and not where they are today.”

The core strategic advice for anyone building AI products — assume capabilities will improve dramatically.

49:09 · Sherwin Wu
“There's literally a version of the bitter lesson applied to building with AI where we were trying to architect all this stuff around and turns out the models are just kind of eat it all away.”
48:32 · Sherwin Wu

05Theme 5: Management in the AI Era

Sherwin's management philosophy centers on the “surgeon” analogy from The Mythical Man-Month: your job as a manager is to make every engineer feel like a surgeon — empowered, with an army of support around them (even though it's really just you).

In the AI world, this means spending 50%+ of your time with top performers. Codex supercharges high-agency engineers — the productivity spread on teams is widening. Managers should focus on unblocking top talent, especially from organizational/process blockers.

He also predicts managers will manage much larger teams. Tools like ChatGPT with organizational knowledge (hooked up to GitHub, Notion, docs) can help managers understand context better, run performance reviews, and anticipate blockers.

“Spending actually the majority of my time with top performers — just like make sure they're unblocked, make sure they're happy, make sure they feel productive and they feel heard. I think this is even more true in an AI world.”
20:55 · Sherwin Wu
“The way in which I act as a manager is I want to empower them, make them feel like they're a surgeon.”
34:00 · Sherwin Wu

06Theme 6: Business Process Automation — The Underrated Opportunity

Sherwin is “extremely bullish” on business process automation, which he thinks is underrated because Silicon Valley focuses on open-ended knowledge work. Most of the economy runs on repeatable business processes — support operations, utility companies, standard operating procedures. AI can automate these with high determinism, and the impact could be even bigger than software engineering.

“A lot of jobs are just business processes. They're like repeatable things, repeatable operations that some manager at a company has kind of like iterated on.”
55:00 · Sherwin Wu
“I'm just extremely bullish on this general category... how can we apply AI towards this business process automation.”
55:37 · Sherwin Wu

07Theme 7: Where the Platform Is Heading

Two major trends Sherwin is excited about over the next 12-18 months:

1. Longer coherent tasks: The “meter benchmark” shows models can already handle multi-hour software engineering tasks 50% of the time. In 12-18 months, models may handle multi-hour tasks reliably, and eventually “six-hour-long tasks where you dispatch it and have it do things on its own for a while.”

2. Audio and multimodal models: Audio is “hugely underrated” in enterprise and business settings. A lot of the world's business happens via audio, and native speech-to-speech models are improving rapidly.

On the platform stack: Responses API (lowest-level primitive for long-running agents), Agents SDK (scaffolding for multi-agent orchestration), and Agent Kit (UI components for deploying agents).

“In the next 12 to 18 months we could see models that could do multi-hour-long tasks very coherently.”
51:45 · Sherwin Wu
“Audio especially in the enterprise and in a business setting I think is a hugely underrated domain still.”
53:08 · Sherwin Wu

Also worth keeping

4 more · each links to its minute
“95% of engineers use Codex. 100% of our PRs are reviewed by Codex for engineers.”

The hard numbers behind OpenAI's internal AI adoption — this is the most aggressive AI-first engineering org in the world.

4:18 · Sherwin Wu
“I think we might actually enter into a golden age of B2B SaaS.”

Counterintuitive bullish take — AI doesn't kill software, it creates a massive new wave of vertical SaaS startups.

26:33 · Sherwin Wu
“Find the high performers in AI adoption and empower them.”

The playbook for enterprise AI adoption — don't mandate from the top, seed excitement from the bottom.

43:58 · Sherwin Wu
“The next two to three years are going to be some of the most fun in tech and in the startup world that we'll have in a very long time.”

A reminder to not take this moment for granted — the window of rapid change won't last forever.

1:08:30 · Sherwin Wu

What to take away

5 lines
  1. 01Build for where models are going, not where they are today

    The best AI products are built for a capability level ~80% of what exists now — they're “almost there” and then suddenly click when the next model drops. Don't over-scaffold for today's limitations.

  2. 02AI adoption requires bottom-up evangelism, not top-down mandates

    Staff internal tiger teams of excited non-engineers who explore, build best practices, and create seeds of excitement. Top-down mandates without grassroots adoption produce negative ROI.

  3. 03Spend more time with your top performers

    AI amplifies the best engineers disproportionately — the productivity gap widens. As a manager, 50%+ of your time should go to unblocking and empowering your top 10%. This is even more true in an AI world.

  4. 04The real AI opportunity is business process automation, not just coding

    Most of the economy runs on repeatable processes — support, operations, standard procedures. Silicon Valley underestimates this because it's not in our wheelhouse.

  5. 05Don't overthink OpenAI competition — just build something people love

    Every startup Sherwin has seen fizzle out failed because the product didn't resonate, not because a big lab squashed them. The market is enormous. ---

See also

who said it · next to it
Sherwin WuSherwin Wu, Head of Engineering at OpenAI's API and developer platform