AMD's latest AI solutions for data centres generate good interest
The Hindu
AMD's Instinct MI300 Series AI accelerators are generating good demand from data centre operators. Dell, Microsoft, Meta and HPE have announced plans to integrate the product into their offerings. It is the highest-performing accelerator for generative AI and the market is expected to grow at 70% CAGR.
Chipmaker AMD's latest product Instinct MI300 Series Artificial Intelligence (AI) accelerators is generating good demand from data centre operators.
The Santa Clara-based semiconductor company on Wednesday introduced multiple new products, including the AMD Instinct MI300 Series data centre AI accelerators, ROCm 6 open software stack with new features supporting large language models (LLMs) and Ryzen 8040 Series processors with Ryzen AI.
The largest data centre infrastructure providers, including Dell, have announced plans to integrate AMD Instinct MI300 accelerators across their product portfolios.
During the launch, Microsoft informed how it is deploying the product to power the new Azure ND MI300x v5 Virtual Machine (VM) series optimised for AI workloads.
(For top technology news of the day, subscribe to our tech newsletter Today’s Cache)
Another player Meta expressed that the company is adding Instinct MI300X accelerators to its data in combination with ROCm 6 to power AI inferencing workloads.
Dell announced the integration of the new solution with their PowerEdge XE9680 server solution to deliver groundbreaking performance for generative AI workloads in a modular and scalable format for customers. At the same time, HPE announced plans to bring AMD Instinct MI300 accelerators to its enterprise and HPC offerings.