AMD Narrows Nvidia Inference Gap With Software Optimization, Cuts MI355X Cost 9% Below B200

According to SemiAnalysis research published Wednesday, AMD is rapidly closing its AI inference performance gap with Nvidia through software optimization alone, with the MI355X chip now matching or exceeding some Nvidia configurations.

AMD's MI355X achieved approximately 9% lower inference cost compared to Nvidia's B200 when both systems must respond within two seconds, according to a September study. Additionally, AMD increased MI355X workload capacity by up to 38% in MLPerf industry benchmarks through software updates only, with no hardware changes. In another test, a system using 72 AMD GPUs outperformed a prior setup requiring 94 identical chips.

Disclaimer: This content is for informational purposes only and does not constitute investment advice or encourage the buying or selling of crypto assets. It is intended to provide information about industry developments and is not directly related to the services offered by Gate TR. Although information obtained from third-party sources has been carefully reviewed, Gate TR assumes no responsibility for any errors or omissions. Crypto assets involve high risks and may experience significant price fluctuations. Before making any investment decisions, you should assess your financial situation and risk tolerance, conduct your own research, and make decisions independently.