AMD’s Answer to AI Advancement: ROCm 7.0 Is Here

Early benchmarks are encouraging. On one test, an Instinct MI300X running ROCm 7 reached roughly three times the speed recorded with the original ROCm 6 release. Of course, your mileage will vary depending on model choice, quantization, and other factors. This shift follows comments from AMD’s Senior Vice President and Chief Software Officer, Andrej Zdravkovic, whom we interviewed last September. He emphasized ROCm’s open-source design and the utility of HIPIFY, a tool that converts CUDA code to run on ROCm. This will enable a full-scale ROCm transition, now accelerated by a 3x performance uplift simply by updating the software version. If ROCm 7 lives up to its promise, AMD could finally unlock the potential of its hardware across devices, both big and small, and provide NVIDIA with good competition in the coming years.

