Friday, February 28th 2025
OpenAI Has "Run Out of GPUs" - Sam Altman Mentions Incoming Delivery of "Tens of Thousands"
Yesterday, OpenAI introduced its "strongest" GPT-4.5 model. A research preview build is only available to paying customers—Pro-tier subscribers fork out $200 a month for early access privileges. The non-profit organization's CEO shared an update via social media post; complete with a "necessary" hyping up of version 4.5: "it is the first model that feels like talking to a thoughtful person to me. I have had several moments where I've sat back in my chair and been astonished at getting actual good advice from an AI." There are apparent performance caveats—Sam Altman proceeded to add a short addendum: "this isn't a reasoning model and won't crush benchmarks. It's a different kind of intelligence, and there's a magic to it (that) I haven't felt before. Really excited for people to try it!" OpenAI had plans to make GPT-4.5 available to its audience of "Plus" subscribers, but major hardware shortages have delayed a roll-out to the $20 per month tier.
Altman disclosed his personal disappointment: "bad news: it is a giant, expensive model. We really wanted to launch it to Plus and Pro (customers) at the same time, but we've been growing a lot and are out of GPUs. We will add tens of thousands of GPUs next week, and roll it out to the plus tier then...Hundreds of thousands coming soon, and I'm pretty sure y'all will use every one we can rack up." Insiders believe that OpenAI is finalizing a proprietary AI-crunching solution, but a rumored mass production phase is not expected to kick-off until 2026. In the meantime, Altman & Co. are still reliant on NVIDIA for new shipments of AI GPUs. Despite being a very important customer, OpenAI is reportedly not satisfied about the "slow" flow of Team Green's latest DGX B200 and DGX H200 platforms into server facilities. Several big players are developing in-house designs, in an attempt to ween themselves off prevalent NVIDIA technologies.
Sources:
Sam Altman Tweet, Tom's Hardware, PC Gamer
Altman disclosed his personal disappointment: "bad news: it is a giant, expensive model. We really wanted to launch it to Plus and Pro (customers) at the same time, but we've been growing a lot and are out of GPUs. We will add tens of thousands of GPUs next week, and roll it out to the plus tier then...Hundreds of thousands coming soon, and I'm pretty sure y'all will use every one we can rack up." Insiders believe that OpenAI is finalizing a proprietary AI-crunching solution, but a rumored mass production phase is not expected to kick-off until 2026. In the meantime, Altman & Co. are still reliant on NVIDIA for new shipments of AI GPUs. Despite being a very important customer, OpenAI is reportedly not satisfied about the "slow" flow of Team Green's latest DGX B200 and DGX H200 platforms into server facilities. Several big players are developing in-house designs, in an attempt to ween themselves off prevalent NVIDIA technologies.



48 Comments on OpenAI Has "Run Out of GPUs" - Sam Altman Mentions Incoming Delivery of "Tens of Thousands"
But as a side note, government agencies have another kind of massive use cases as well. Face recognition, all kinds of surveillance, tracking of individuals, etc.
Also, the US energy company, is going to restart the reactor of old closed nuclear plant, to satisfy AI "demands".
Simply to note, in 1995 I had my first desktop computer, used 100% for software development, with 32 MB of memory and Windows 95 PE operating system, with a price tag of 2,500 USD.
Just to compare, In 2002 I paid for my first car 1,500 USD. The computer was more expensive than the car!
Jensen is like ya boy, cha-ching!
AMD talks 1.2 million GPU AI supercomputer to compete with Nvidia — 30X more GPUs than world's fastest supercomputer
www.tomshardware.com/tech-industry/artificial-intelligence/elon-musk-plans-to-scale-the-xai-supercomputer-to-a-million-gpus-currently-at-over-100-000-h100-gpus-and-counting
This is how much power is needed for three exascale supercomputers already deployed:
- El Capitan: Approximately 30 MW
- Frontier: Around 21 MW
- Aurora: About 38.7 MW
Also, there is another problem of reliability of that "fictional" supersystem with 10 million GPUs. On average, a Mean Time Before Failure ( MTBF ) on these three exascale supercomputers is just several hours.For example, Are we going to be happy if our cars would have MTBF just 3 or 4 hours?
PS Things evolve. If we where doing this conversation 10 years ago, we would be talking about how unrealistic is a supercomputer with the specs of El Capitan.
Your example would have cars/computers having a complete failure where it was nonfunctional based on 10 million batteries/GPU's where one might individually fail but the rest take over the load with no appreciable loss in performance.
Get in touch with Software Engineers and Computer Scientists working on Frontier and Aurora exascale supercomputers! Then, talk to them, and you'll see that situation is Not so simple and they Constantly have reliability problems.
My point of view and statements are based on real communications with professionals from both teams. I'm a C/C++ Software Engineer and really understand the scope of the problem on these machines.
If you're a Software Developer you could even apply for a Small Node allocation for a middle size project and you'll see how it works in the real life. It is Not so simple.
In the end, the only one having a party here, is that 10 years old kid that is taking advantage of your posts.
I guess Huang slept through his Economics 101 lectures & fails to mention anything about "opportunity costs".