OpenAI CEO Argues Home PCs Waste the World's Limited DRAM Supply
OpenAI CEO Sam Altman thinks the DRAM sitting inside personal computers would be better used in data centers. He made the comments on the Cheeky Pint podcast, hosted by Stripe co-founder John Collison, in an episode released on October 29. The two were discussing the memory supply chain when the topic turned to local inference, meaning running AI models on your own hardware instead of the cloud. Here's what Altman said, at roughly the 29-minute mark:
Sam Altman, OpenAI CEOA lot of people want local inference. And somehow, they assume that the problem is solved now. Because, we are going to have open-source models. We're going to be able to run them on our computers. And so we're not going to need all the stuff in the data center. But from a global allocation perspective, actually, it's quite terrible to have everybody have a bunch of the world's limited supply of DRAM sitting in their own computer. And, being used 5% of the time. You want maximum utilization in the cloud if you're trying to deal with this very supply constrained environment. And somehow everyone's... many people's intuition is the opposite of that.




















































