Thu Sep 26 13:02:54 UTC 2024: ## AMD’s Instinct MI300X Powers Oracle Cloud’s New AI Supercluster

**SANTA CLARA, Calif. – September 26, 2024** – AMD announced today that Oracle Cloud Infrastructure (OCI) has chosen AMD Instinct™ MI300X accelerators with ROCm™ open software to power its newest OCI Compute Supercluster instance called BM.GPU.MI300X.8.

This new instance boasts the ability to support up to 16,384 GPUs in a single cluster, making it ideal for handling demanding AI workloads, including large language model (LLM) inference and training. Companies like Fireworks AI, a generative AI platform provider, have already begun using this powerful new instance.

“The inference capabilities of AMD Instinct MI300X accelerators add to OCI’s extensive selection of high-performance bare metal instances to remove the overhead of virtualized compute commonly used for AI infrastructure,” said Donald Lu, senior vice president, software development, Oracle Cloud Infrastructure.

The AMD Instinct MI300X’s impressive memory capacity and bandwidth have garnered attention from AI model developers. Fireworks AI, for example, utilizes the MI300X’s capabilities to scale its services and accommodate the growing size of AI models.

“The amount of memory capacity available on the AMD Instinct MI300X and ROCm open software allows us to scale services to our customers as models continue to grow,” said Lin Qiao, CEO of Fireworks AI.

This collaboration between AMD and Oracle is set to revolutionize the field of AI computing by providing a powerful, flexible, and efficient solution for training and deploying large-scale AI models.

Read More