@mylifcc: OpenAI just disclosed a pretty outrageous engineering case study. With just 2 engineers + Codex + GPT-5.5, they complet…

X AI KOLs Timeline News

Summary

OpenAI 用 2 名工程师配合 Codex 和 GPT-5.5 将核心存储服务 Habitat 从 Python 重写为 Rust,CPU 效率提升 6 倍、内存效率提升 15 倍,并承担 95% 的生产请求,展示了 AI 编程对大型系统重构成本结构的潜在改变。

OpenAI just disclosed a pretty outrageous engineering case study. With just 2 engineers + Codex + GPT-5.5, they completely rewrote a core storage service underlying ChatGPT from Python to Rust. Results: CPU efficiency improved 6x Memory efficiency improved 15x Average latency and tail latency significantly reduced Rust now handles 95% of production requests Even more outrageous: The original Python version had already peaked at handling 20 million requests per second. This might be a key case study in how AI Coding could fundamentally change the cost structure of software engineering. The service is called Habitat. It's OpenAI's online storage access platform, relied on by products like ChatGPT and Codex. When users log into ChatGPT, start a conversation, or read settings, it all likely involves this system behind the scenes. How big is the entire platform? Over 500 PB of data, more than 70 million requests per second, serving over 1 billion weekly active ChatGPT users. Interestingly, OpenAI had long known about Python's performance bottlenecks but deliberately waited a year before rewriting. Because there were more pressing engineering issues at the time: asyncio event loop latency, tail latency from Feature Flags, uneven connection pool loads, and burst traffic overwhelming downstream databases First get the architecture and stability right, then think about language migration. The Python version holding up to 20 million RPS was itself a pretty successful engineering feat. Notably, this refactor involved only 2 engineers, aided by Codex and GPT-5.5. Previously, rewriting a large production system across languages would typically require massive human effort for code migration, interface adaptation, testing, and validation. Now, AI Coding has the chance to dramatically cut those implementation costs. Also, OpenAI didn't abandon Python from the start. They first used Python to support rapid business growth and fix architecture issues, then migrated to Rust once the performance gains were clearly worthwhile. This path is very worth emulating: Prioritize development efficiency early on, tackle architecture bottlenecks mid-stage, and optimize runtime efficiency once scale is massive enough. In the past, a stable-running Python service meant that even if Rust performed better, it might not justify the heavy manpower for a rewrite. Now, Coding Agents could shift that economic calculus. In the future, competition in software engineering might increasingly hinge on who can use Agents to safely handle large-scale refactors, testing, and migrations. But the premise remains: Performance gains must be real, correctness backed by evidence, and migration risks controllable. Do you think we'll see more cases of "a few engineers + Agent" rewriting large-scale infrastructure in the future?
Original Article
View Cached Full Text

Cached at: 10/12/26, 03:20 AM

OpenAI just disclosed a pretty outrageous engineering case study.

With just 2 engineers + Codex + GPT-5.5, they completely rewrote a core storage service underlying ChatGPT from Python to Rust.

Results: CPU efficiency improved 6x

Memory efficiency improved 15x

Average latency and tail latency significantly reduced

Rust now handles 95% of production requests

Even more outrageous: The original Python version had already peaked at handling 20 million requests per second.

This might be a key case study in how AI Coding could fundamentally change the cost structure of software engineering.

The service is called Habitat. It’s OpenAI’s online storage access platform, relied on by products like ChatGPT and Codex. When users log into ChatGPT, start a conversation, or read settings, it all likely involves this system behind the scenes.

How big is the entire platform?

Over 500 PB of data, more than 70 million requests per second, serving over 1 billion weekly active ChatGPT users.

Interestingly, OpenAI had long known about Python’s performance bottlenecks but deliberately waited a year before rewriting.

Because there were more pressing engineering issues at the time: asyncio event loop latency, tail latency from Feature Flags, uneven connection pool loads, and burst traffic overwhelming downstream databases

First get the architecture and stability right, then think about language migration.

The Python version holding up to 20 million RPS was itself a pretty successful engineering feat.

Notably, this refactor involved only 2 engineers, aided by Codex and GPT-5.5.

Previously, rewriting a large production system across languages would typically require massive human effort for code migration, interface adaptation, testing, and validation.

Now, AI Coding has the chance to dramatically cut those implementation costs.

Also, OpenAI didn’t abandon Python from the start.

They first used Python to support rapid business growth and fix architecture issues, then migrated to Rust once the performance gains were clearly worthwhile.

This path is very worth emulating: Prioritize development efficiency early on, tackle architecture bottlenecks mid-stage, and optimize runtime efficiency once scale is massive enough.

In the past, a stable-running Python service meant that even if Rust performed better, it might not justify the heavy manpower for a rewrite.

Now, Coding Agents could shift that economic calculus.

In the future, competition in software engineering might increasingly hinge on who can use Agents to safely handle large-scale refactors, testing, and migrations.

But the premise remains: Performance gains must be real, correctness backed by evidence, and migration risks controllable.

Do you think we’ll see more cases of “a few engineers + Agent” rewriting large-scale infrastructure in the future?

Similar Articles

How Codex Happened (40 minute read)

TLDR AI

Every 的长篇深度报道,讲述 OpenAI 的 Codex 如何从一个未找到产品市场契合的云端编码工具,转型为终端/编辑器内的 AI 软件工程师,并在 GPT-5 之后成为 OpenAI 复兴的核心产品。

@xeophon: i love the future

X AI KOLs Following

OpenAI's Habitat storage platform, which powers services like ChatGPT and Codex, has grown over 10x year-over-year and was rewritten in Rust to handle more than 20 million requests per second at peak.

@CopperForgeAI: OpenAI's official blog revealed firsthand engineering practices from the core team using the GPT-6 series to maintain t…

X AI KOLs Timeline

OpenAI's official blog revealed how its core engineering team uses the GPT-6 series (including GPT-6 Astra) and Codex for large-scale codebase maintenance, merging over 1,400 cleanup PRs in two weeks, deleting 800k+ lines of code, and sharing the actual production prompts used for dead-code cleanup, feature-flag pruning, CI optimization, flaky test fixes, and agent instruction self-inspection.

@Easycompany333: The Codex video officially named by OpenAI is worth collecting. In less than 2 hours, it thoroughly explains the Codex + GPT-5.5 combo: - How to configure skills. - How to use plugins. - How to build automation workflows. - How to run multiple tasks in parallel. - And most importantly, how to turn Codex into a development system that continuously works for you.

X AI KOLs Timeline

Recommends a Codex video tutorial officially named by OpenAI, detailing how to configure skills, use plugins, and build automation workflows to turn Codex into a continuously working development system.

@Pluvio9yte: OpenAI released an internal PDF about how their own engineers use Codex. Their security, infra, frontend, and API teams use it daily: • Quickly understand completely unfamiliar codebases • Refactor across dozens of files • Generate edge case tests that devs easily miss …

X AI KOLs Timeline

OpenAI published a guide detailing how their internal engineering teams use Codex for code understanding, refactoring, performance optimization, and more, highlighting practical use cases and best practices.