loading
reading
writing
saving
searching
AI/ML GPU Server, 12x Nvidia 4090 GPUs, AMD 9554, 512GB - $40,000
condition:
excellent
make / manufacturer:
ASUS/AMD/Nvidia/C-Payne
model name / number:
9004 CPU, 4090 GPUs
QR Code Link to This Post
This system uses C-Payne switches for 10 of the 12 GPUs (the other two are connected via PCIe gen4 risers).
The C-Payne switches create two full (16-lane) PCIe gen4 slots from one PCIe gen5 slot, which is how it has 12 GPUs on one CPU, running at full PCIe bandwidth.
- 1Asus K14PA-U12 MLB
- 1AMD 9554 CPU (64-core)
- 1 High-Performance CPU Cooler
- 512gb 4800Mhz ECC/Registered RAM
- 2tb PCIe gen5 NVME SSD
- (12) Nvidia 4090 GPUs - Assorted Vendors, mostly PNY
- (5) C-Payne MCIO PCIe5 gen5 Switch 52-Lane (Switchtec PM50052)
- (10) C-Payne MCIO PCIe gen5 Device Adapter x8/x16
- (1) C-Payne MCIO PCIe gen5 Host Adapter x16 (Retimer)
- (2) PCI gen4 SFF-8088 Hoster Adapter x16
- (2) PCIe gen5 SFF 8088 Device Adapters
- (2) PCIe gen5 SFF-8088 Cables
- (32) MCIO 0.75m SFF-TA-1016 Cables
- (8) MCIO 0.2m SFF-TA-1016 Cables
- (8) Bitmain APW7++ 1600W PSUs
- Additional PSUs inside the server with breakout boards for fans, risers, etc.
- Additional Y-Splitters for 4090 GPUs (2x8-pin to 1x12-pin)
- (4) Server Cases with Fans
- C14/16 Power Cables
- Caster Wheel Rack
There are two minor issues but nothing outstanding that affects performance:
- BIOS, if reset, requires an EFI modification to re-adjust PCIe bifurcation. I have all the tools and procedures for this.
- One DIMM slot was damaged and the fix is a journey-rig that’s worked fine, but it is a journey-rig.
System is awesome, has some serious torque and speed.
Delivery available within 400mi radius of Brandon, VT
Was making upwards of $90-100/day on GPU rental marketplaces.
System max draw: 6.3kW
Cash only !