According to SemiAnalysis research published Wednesday, AMD is rapidly closing its AI inference performance gap with Nvidia through software optimization alone, with the MI355X chip now matching or exceeding some Nvidia configurations.
AMD's MI355X achieved approximately 9% lower inference cost compared to Nvidia's B200 when both systems must respond within two seconds, according to a September study. Additionally, AMD increased MI355X workload capacity by up to 38% in MLPerf industry benchmarks through software updates only, with no hardware changes. In another test, a system using 72 AMD GPUs outperformed a prior setup requiring 94 identical chips.