OpenAI has scaled its internal online storage platform, Habitat, to handle over 70 million requests per second for more than one billion weekly ChatGPT users across nearly 40 geographic regions. The system now serves more than 500 petabytes of data, evolving from a simple Python client-side library into a complex distributed service.
- Habitat manages 70M+ requests per second and supports 1B+ people each week.
- The platform handles over 500 PB of data across almost 40 geographic regions.
- OpenAI transitioned Habitat from a client-side library to a standalone service to reduce operational complexity and improve reliability.
- The team optimized Python performance by addressing asyncio scheduling delays and fixing load balancing issues with connection pooling.
This architectural shift allows OpenAI to centrally enforce security policies and streamline deployments, ensuring fast and reliable data access for its growing product suite.