Tuesday, March 11th 2025
Oracle Plans to Use 30,000 AMD Instinct MI355X GPUs for AI Cloud
AMD's Instinct MI355X accelerators for AI workloads are gaining traction, and Oracle just became one of the bigger customers. According to Oracle's latest financial results, the company noted that it had acquired 30,000 AMD Instinct MI355X accelerators. "In Q3, we signed a multi billion dollar contract with AMD to build a cluster of 30,000 of their latest MI355X GPUs," noted Larry Ellison, adding that "And all four of the leading cloud security companies, CrowdStrike, Cyber Reason, Newfold Digital and Palo Alto, they all decided to move to the Oracle Cloud. But perhaps most importantly, Oracle has developed a new product called the AI data platform that enables our huge install base of database customers to use the latest AI models from OpenAI, XAI and Meta to analyze all of the data they have stored in their millions of existing Oracle databases. By using Oracle version 23 AI's vector capabilities, customers can automatically put all of their existing data into the vector format that is understood by AI models. This allows those AI models to learn, understand and analyze every aspect of your company or government agency, instantly unlocking the value in your data while keeping your data private and secure."
AMD's Instinct MI355X accelerator introduces the CDNA4 architecture on TSMC's N3 process node with a focus on AI workload acceleration. The chiplet-based GPU delivers 2.3 petaflops of FP16 compute and 4.6 petaflops of FP8 compute, marking a 77% performance increase over the MI300X series. The MI355X's key advancement comes through support for reduced-precision FP4 and FP6 numerical formats, enabling up to 9.2 petaflops of FP4 compute. Memory specifications include 288 GB of HBM3E across eight stacks, providing 8 TB/s of total bandwidth. Production timelines place the MI355X's market entry in the second half of 2025, continuing AMD's annual cadence for data center GPU launches. By second half, Oracle will likely prepare data center space for these GPUs and just power them on once AMD ships these accelerators.
Source:
Oracle Earning Transcript
AMD's Instinct MI355X accelerator introduces the CDNA4 architecture on TSMC's N3 process node with a focus on AI workload acceleration. The chiplet-based GPU delivers 2.3 petaflops of FP16 compute and 4.6 petaflops of FP8 compute, marking a 77% performance increase over the MI300X series. The MI355X's key advancement comes through support for reduced-precision FP4 and FP6 numerical formats, enabling up to 9.2 petaflops of FP4 compute. Memory specifications include 288 GB of HBM3E across eight stacks, providing 8 TB/s of total bandwidth. Production timelines place the MI355X's market entry in the second half of 2025, continuing AMD's annual cadence for data center GPU launches. By second half, Oracle will likely prepare data center space for these GPUs and just power them on once AMD ships these accelerators.
15 Comments on Oracle Plans to Use 30,000 AMD Instinct MI355X GPUs for AI Cloud
Though, I suppose it's possible that they paid through the nose to get an extra product line at priority at TSMC
1. Datacentre GPUs are a much more lucrative business, and
2. A shortage of gaming GPUs can keep prices high. Win-win (for them).
I was referring to the former, whereas for the latter I know they have tons of well-paid consultants readily available for bigger companies that are mostly stuck with their software.
They sell the GPU for X amount, and then the AIBs adds Y amount, and the retailer adds Z amount to the price, but all AMD will see is the X amount, not anything more than that, that the others added on to the price, so in the overall scope of things, AMD will lose out on market share since they can't produce enough product when needed because of fab space
Oh and MSRP stands for manufacturer's suggested retail price, you know that, right? It's not what chips are sold to AIBs at.
Stop using AI - more GPU for me :) WIN - WIN.