Wednesday, September 17th 2025
AMD Launches ROCm 7.0, Up to 3.8x Performance Uplift Over ROCm 6.0
AMD today unveiled ROCm 7.0, a massive update to its open GPU software platform for AI workloads across datacenter racks and even client devices. The release focuses on support for the new Instinct MI350 accelerator series, built on CDNA 4. It pairs hardware-level refinements, including advanced HBM utilization and expanded datatype handling, with software improvements designed to enhance throughput for both training and inference. AMD classifies this release as a generational step that widens deployment choices for enterprises, from single-node servers to multi-rack clusters. Company benchmarks shared with partners indicate multi-fold gains over previous ROCm 6.0 versions on select large-model tasks, and AMD shows tighter integration with open-source serving stacks to help teams transition from prototype to production more quickly.
Under the hood, ROCm 7.0 delivers algorithmic and systems advances intended to reduce cost and improve utilization: enhanced attention and reasoning primitives, sparse mixture-of-experts techniques, and support for FP4, FP6, and FP8 precision formats that trade a bit of accuracy for massive memory savings. ROCm 7.0 also focuses on scale and manageability by enabling GPU-direct communications, distributed inference across nodes with vLLM-d and DeepEP compatibility, and cluster tools such as AMD Resource Manager and a new AI Workbench for orchestration and monitoring. To smooth adoption, AMD provides prebuilt Docker images with quantized model examples and turnkey stacks for common frameworks. AMD is also expanding endpoint support to Ryzen AI processors and Radeon RX series GPUs, so developers can deploy consistent pipelines from edge devices to cloud racks. ROCm 7 is available now through AMD's developer resources, with documentation, examples, and enterprise support to help teams get started.
Source:
AMD
Under the hood, ROCm 7.0 delivers algorithmic and systems advances intended to reduce cost and improve utilization: enhanced attention and reasoning primitives, sparse mixture-of-experts techniques, and support for FP4, FP6, and FP8 precision formats that trade a bit of accuracy for massive memory savings. ROCm 7.0 also focuses on scale and manageability by enabling GPU-direct communications, distributed inference across nodes with vLLM-d and DeepEP compatibility, and cluster tools such as AMD Resource Manager and a new AI Workbench for orchestration and monitoring. To smooth adoption, AMD provides prebuilt Docker images with quantized model examples and turnkey stacks for common frameworks. AMD is also expanding endpoint support to Ryzen AI processors and Radeon RX series GPUs, so developers can deploy consistent pipelines from edge devices to cloud racks. ROCm 7 is available now through AMD's developer resources, with documentation, examples, and enterprise support to help teams get started.



4 Comments on AMD Launches ROCm 7.0, Up to 3.8x Performance Uplift Over ROCm 6.0
For reference, my GPU is 7900xt i.e gfx1100
Here is ROCm 7 listed as supported - rocm.docs.amd.com/en/latest/compatibility/compatibility-matrix.html
But not here - rocm.docs.amd.com/projects/radeon/en/latest/docs/compatibility/native_linux/native_linux_compatibility.html
But if this PBM is important to you, we can swap GPUs :)
Let's hope they can pull it off although I won't hold my breath for it.
If you had a 5000 series NV card I might've been ok with a swap 🙂.