Harness the power of AI
Drive traditional AI, HPC and simulation applications with optimized compute and accelerated throughput for automating insights into outcomes. Develop and deploy machine learning models, maximize AI initiatives with the latest NVIDIA® GPUs with a 4-way architecture.
Purpose-built performance
Efficiently drive traditional AI training, HPC and data analytics applications with four high performance accelerators and air-cooling. Get the ultimate balance of performance, power and price with Intel® CPUs and the newest NVIDIA® H100 Tensor Core GPUs.
- Drive a wide range of AI workloads with two powerful 4th generation Intel ® Xeon® processors®
- Four (4) NVIDIA H100 Tensor core 700W SXM5 GPUs for extreme performance, fully interconnected with NVIDIA NVLink technology.
- Improve training performance with up to 900GB/s bandwidth for GPU-GPU communication, 1.5x more than the previous generation.
- Built for dense inferencing in fields like oil and gas, finance and healthcare
- Boost performance with DDR5 memory and PCIe Gen5 support
- Support for the highest wattage next-gen technologies up to 35°C ambient temperature with a 4U air-cooled design
Transform your business
Strike the perfect balance between performance, power and cost when deploying a solution to suit your IT strategy.
- Next generation NVIDIA® GPUs achieve superior AI performance in medical imaging, business decision making applications and most other applications
- Get continuous data processing and faster I/O performance with GPU Direct Storage transfers, bypassing server CPUs
- Scale with confidence thanks to support for up to 32 DDR5 memory DIMM slots, up to eight drives and up to 4 PCIe Gen 5 expansion slots
Accelerated I/O Throughput
Deploy latest generation technologies including DDR5, NVLink, PCIe Gen 5.0, and NVMe SSDs to push the boundaries of data flow and computing possibilities.
- Up to four PCIe Gen 5 slots and up to 8 drives enable optimal expansion for high-performance AI operations.
- Supports NVIDIA GDS (GPUDirect® Storage), a direct data path for direct memory access (DMA) transfers between GPU memory and storage, increasing system bandwidth and decreasing latency and utilization load on the CPU
- 4U air-cooled design chassis supports the highest wattage next-gen technologies in up to 35C ambient
Cyber Resilient Architecture for Zero Trust IT environment & operations
Security is integrated into every phase of the PowerEdge lifecycle, including protected supply chain and factory-to-site integrity assurance. Silicon-based root of trust anchors end-to-end boot resilience while Multi-Factor Authentication (MFA) and role-based access controls ensure trusted operations.
Cooling & Fans
With most GPU servers the cooling is a major part of the success of the machine running smoothly and efficiently. The XE8640 Rack Server holds up to 6 Standard (STD) fans installed in the mid tray and up to 5 High performance (HPR) gold grade fans installed on the front of the system. A keynote is that all the fans are hot-swappable and when GPUs are installed you can install the Liquid Assisted Air Cooling for GPU.
Note: No facility water to rack required.
Memory
The system memory is organized into eight channels per processor (two memory sockets per channel),16 DIMMs per processor, and 32 DIMMs per system. The system only supports ECC DDR5 memory with speeds up to 4800Mhx on a (1DPC) and 4400Mhz on a (2DPC) configuration.
| DIMM type |
Rank per DIMM and Data Width |
DIMM capacity (GB) |
Speed (MT/s); Voltage (V); DIMM per channel (DPC) |
| 1 DIMM per channel (DPC) |
2 DIMMs per channel (DPC) |
| RDIMM |
DR X 8 |
32 GB |
4800 MT/s |
4400 MT/s |
| DR X 4 |
64 GB |
4800 MT/s |
4400 MT/s |
| RDIMM 3DS |
4R X 4 |
128GB |
4800 MT/s |
4400 MT/s |
GPU
The H100 SMX5 GPUs are on the bottom layer of the XE8640 Rack Server. Three different components make up the bottom layer, PDB, H100 Tray, and the LAAC. The Power Distribution Board sits at the very bottom with the H100 Tray on top. The LAAC gets laid on top of the H100 in the GPU tray to cool the H100 SMX5 GPUs. The Top Tray Layer gets placed on top of this bottom layer to support the CPU. DIMMs, and Drives.
This is a GPU-intense server for HPC, AI, and Machine Learning systems. The Dell XE8640 Rack Server supports 4x NVIDIA SMX5 GPUs w/ NVLINK HGX H100 80 GB/700 W. The system board connects to these GPUs via the Versabay Board (VSB). The Versabay Boards are designed to offer flexibility in terms of adding extra functionalities such as additional storage controllers, network interface cards (NICs), or specialized processing units.
The Dell PowerEdge XE8640 supports the LAAC liquid Cooling option to help with the system temperature. View the manual for more details into the GPU and cooling.
Expansion Slots
PCIe Riser Configurations 1. R1A+R4A
| Location |
Height |
Length |
CPU1 |
CPU2 |
| Riser R1A |
Riser R4A |
| PCIe Slot -1 |
FH |
HL |
PCIe Gen5 X16 |
N/A |
| PCIe Slot -2 |
FH |
HL |
PCIe Gen5 X16 |
N/A |
| PCIe Slot -3 |
FH |
HL |
N/A |
PCIe Gen5 X16 |
| PCIe Slot -4 |
FH |
HL |
N/A |
PCIe Gen5 X16 |
The XE8640 GPU server only has 1 riser configuration. You simply have the choice of whether to install risers or not.
Networking / Boot Options
Storage Controllers
The XE8640 Rack server supports the PERC 12 H965i for Hardware RAID along with the S160 for Software RAID. In addition, the rack server also holds the BOSS-N1 Modular Internal Boot device. This BOSS-N1 holds two M.2 NVMe SSD drives with a capacity of 480GB or 960GB.
| Supported storage controller card |
Software RAID ● S160 |
Hardware RAID ● H965i |
Power & Dimensions
The PowerEdge XE8640 system supports up to 4 AC or DC power supply units (PSUs) with 3+1 redundancy, autosensing, and auto-switching capability. Similar to the Riser config there is only one choice for a Power Supply Unit. The XE8640 can support up to 4x 2800W 200-240V PSUs. This type of battery is needed when installing a SMX5 GPU which consumes 700W during peak performance.
Dimensions & Weight:
- Width: 447 mm (17.6 inches)
- Height: 174.3 mm (6.86 inches)
- Length: 901mm (35.46 inches)
- Weight: 61.4 kg (135.36 lb)