Supermicro AS -8125GS-TNMR2-G1 8U rack server dual EPYC 9654 96-core 2.4GHz 2.3TB DDR5 1.9TB NVMe 8x MI300X

Dual EPYC 9654 server for dense GPU compute

The Supermicro AS -8125GS-TNMR2-G1 is an 8U rack system built around two AMD EPYC 9654 processors. Each CPU provides 96 cores at 2.40 GHz with 384 MB cache, giving 192 cores total. It ships with 2.3 TB of DDR5 5600 ECC RDIMM memory running at 4800 MT/s across 24 slots, expandable to 6 TB. Eight AMD Instinct MI300X GPUs with 192 GB each are installed for large-model training and inference.

PCIe 5.0 and 400 GbE set the I/O ceiling

The platform uses PCIe 5.0 lanes from the EPYC 9004 series CPUs to feed the eight OAM GPUs and the single 1.9 TB U.2 NVMe boot drive. Front bays accept 12 NVMe and 2 SATA 2.5-inch drives, all hot-swap. Networking is limited to four single-port 400 GbE QSFP112 links and one dual-port 10 GbE RJ45 controller. No additional PCIe expansion slots are documented, so extra accelerators or storage controllers cannot be added internally.

Rack mounting requires 8U space and 3 kW circuits

Installation means sliding an 8U chassis into a standard rack and connecting six 3000 W titanium power supplies to suitable PDUs. The 12 NVMe bays use U.2 connectors that need correct carrier alignment; mis-seated drives are the most common cause of boot failures. GPU firmware and driver stacks must match the MI300X OAM specification, and memory population must follow the 1DPC rule to reach the rated 4800 MT/s speed.