Wednesday, September 17th 2025

AMD Launches ROCm 7.0, Up to 3.8x Performance Uplift Over ROCm 6.0

AMD today unveiled ROCm 7.0, a massive update to its open GPU software platform for AI workloads across datacenter racks and even client devices. The release focuses on support for the new Instinct MI350 accelerator series, built on CDNA 4. It pairs hardware-level refinements, including advanced HBM utilization and expanded datatype handling, with software improvements designed to enhance throughput for both training and inference. AMD classifies this release as a generational step that widens deployment choices for enterprises, from single-node servers to multi-rack clusters. Company benchmarks shared with partners indicate multi-fold gains over previous ROCm 6.0 versions on select large-model tasks, and AMD shows tighter integration with open-source serving stacks to help teams transition from prototype to production more quickly.

Under the hood, ROCm 7.0 delivers algorithmic and systems advances intended to reduce cost and improve utilization: enhanced attention and reasoning primitives, sparse mixture-of-experts techniques, and support for FP4, FP6, and FP8 precision formats that trade a bit of accuracy for massive memory savings. ROCm 7.0 also focuses on scale and manageability by enabling GPU-direct communications, distributed inference across nodes with vLLM-d and DeepEP compatibility, and cluster tools such as AMD Resource Manager and a new AI Workbench for orchestration and monitoring. To smooth adoption, AMD provides prebuilt Docker images with quantized model examples and turnkey stacks for common frameworks. AMD is also expanding endpoint support to Ryzen AI processors and Radeon RX series GPUs, so developers can deploy consistent pipelines from edge devices to cloud racks. ROCm 7 is available now through AMD's developer resources, with documentation, examples, and enterprise support to help teams get started.
Source: AMD
Add your own comment

4 Comments on AMD Launches ROCm 7.0, Up to 3.8x Performance Uplift Over ROCm 6.0

#3
Jeager
There is absolutely no reason the 7900 inst supported if the 7800 is listed
But if this PBM is important to you, we can swap GPUs :)
Posted on Reply
#4
lambda
JeagerThere is absolutely no reason the 7900 inst supported if the 7800 is listed
But if this PBM is important to you, we can swap GPUs :)
Looks like miniscule perf improvements for the consumer GPUs as per some tests on the phoronix forums. Also APUs still aren't supported properly.

Let's hope they can pull it off although I won't hold my breath for it.

If you had a 5000 series NV card I might've been ok with a swap 🙂.
Posted on Reply
Nov 22nd, 2026 17:45 CST change timezone

New Forum Posts

Popular Reviews

TPU on YouTube

Controversial News Posts