Graphic Output

Vendors

Matrox 51 Miscellaneous Vendors 1 NVIDIA 32

GPU memory

16GB GDDR6 4 16GB GDDR7 1 20GB GDDR6 2 24GB GDDR6 3 24GB GDDR7 2 2 GB DDR2 1 32GB GDDR6 1 32GB GDDR7 1 48GB GDDR6 2 48GB GDDR7 1 4GB GDDR6 1 72GB GDDR7 1 8GB GDDR6 1 96GB GDDR7 3

Memory bandwidth

1344 GB/s 2 1597 GB/s 1 1792 GB/s 2 192 GB/s 1 200 GB/s 3 224 GB/s 1 288 GB/s 1 300 GB/s 1 320 GB/s 2 432 GB/s 2 576GB/s 1 600 GB/s 1 672 GB/s 1 864GB/s 1 896 GB/s 1 960 GB/s 1 96 GB/s 1

Error-correcting code (ECC)

None 2 Yes 19

CUDA Cores

10496 1 12800 1 14080 2 18176 2 2304 1 24064 3 2816 1 4352 1 6144 2 768 1 7680 1 8960 2

Tensor Cores

192 2 24 1 240 1 400 1 568 2 5th Generation 8 72 1 752 (5th Gen) 1 88 1

RT Cores

10 3 100 1 142 2 18 1 188 (4th Gen) 1 22 1 48 2 4th Generation 8 6 1 60 1

System interface

PCIe 4.0 x 16 5 PCIe 4.0 x 8 3 PCIe 5.0 x16 6 PCIe 5.0 x 8 2 PCIe Gen4: 64 GB/s 1 PCIe Gen4 x16 64GB/s 1 PCIe Gen4x16: 64GB/s bi-directional 1 PCIe Gen4 x8 3 PCIe x16 1 PCI Express 5.0 x16 1

Thermal solution

Active 15 Passive 6

Display connectors

4 x DisplayPort 1.4a 4 4x DisplayPort 2.1 1 4x DisplayPort 2.1b 6 4x Mini DisplayPort 1.4a 5 4x mini DisplayPort 2.1b 2

Max simultaneous displays

2x 7680 x 4320 @ 100 Hz 5 2x 7680 x 4320 @ 30Hz 1 2x 7680 x 4320 @ 60 Hz 8 4x 5120 x 2880 @ 60 Hz 1 8x 2560 x 1600 1 Up to four simultaneous displays 1

Power connector

PCIe 5.0 x16 1 PEX 8-pin 1 16-pin 1 1x PCIe CEM5 16-pin 7

Encode/decode engines

1x encode 1x decode (+AV1 decode) 1 1x encode 1x decode (+AV1 encode and decode) 1 1x encode 2x decode (+AV1 decode) 1 2x encode 2x decode (+AV1 encode and decode) 4 3x encode 3x decode (+AV1 encode and decode) 1 3x encode 3x decode (support 4:2:2 color formats) 2 4:2:2 encoding and decoding 4

Graphics APIs

DirectX 12 Shader Model 6.6 OpenGL 4.63 Vulkan 1.3 2 DirectX 12 Shader Model 6.6 OpenGL 4.6 Vulkan 1.3 3 OpenGL 4.6 Vulkan 1.3 8 OpenGL 4.6 Vulkan 1.4 2 Vulkan 1.3 1

Compute APIs

CUDA 11.6 DirectCompute OpenCL 3.0 4 CUDA 11.6 OpenCL 3.0 DirectCompute 2 CUDA 12.2 OpenCL 3.0 DirectCompute 2 CUDA 12.8 OpenCL 3.0 2 CUDA 12.8 OpenCL 3.0 DirectCompute 6

Single-precision performance

110 TFLOPS 1 117 TFLOPS 1 12.0 TFLOPS 1 125 TFLOPS 1 17 TFLOPS 1 19.2 TFLOPS 2 2.7 TFLOPS 1 39.6 TFLOPS 1 65.3 TFLOPS 1 65 TFLOPS 1 6.7 TFLOPS 1 91.1 TFLOPS 1

RT Core performance

13.2 TFLOPS 1 151.0 TFLOPS 1 196 TFLOPS 1 210.6 TFLOPS 1 27.7 TFLOPS 1 333 TFLOPS 1 354.5 TFLOPS 1 380 TFLOPS 1 44.3 TFLOPS 2 52 TFLOPS 1 5.4 TFLOPS 1 91.6 TFLOPS 1

Memory Interface

128-bit 6 160-bit 2 192-bit 3 256-bit 2 384-bit 2 512-bit 4 64-bit 1

vGPU software support

ATX 1 Low Profile/ATX 7 Matrox PowerDesk 1 No 4 NVIDIA RTX Desktop Manager 1 NVIDIA Virtual PC NVIDIA Virtual Applications NVIDIA RTX VirtualWorkstation NVIDIA AI Enterprise 3 NVIDIA vPC/vApps NVIDIA RTX Virtual Workstation 2 NVIDIA vPC/vApps NVIDIA RTX vWS NVIDIA AI Enterprise 1 Supports vGPU 15.2 or later 1 Yes 1

Unit Dimensions (L x H x D mm)

12.83 x 2.59 x 10.9 cm 1 13.97 x 3.18 x 18.11 cm 2 16.8 x 6.9 cm 1 18.07 x 13.97 x 3.33 cm 2 18.9 x 4.26 x 21.66 cm 4 21.59 x 2.59 x 10.16 cm 1 21.7 x 19.1 x 4.3 cm 2 30 x 2.8 x 14.6 cm 1

HDMI Outputs (#)

1 2 2 1 4 3

HDMI Type

1x HDMI 2.0 2 2x HDMI (Type A) 1 4x HDMI 2 4x HDMI (Type A) 1

Display Port Outputs (#)

1 2 2 1

Display Port Type

1x DisplayPort 1.1 1 1x DisplayPort 1.2 1

Edition

Receiver Appliance 1 Transmitter Appliance 3

NVIDIA NVLink

No 7 None 2

NVIDIA NVLink bandwidth

No 7 None 2

vGPU profiles supported

No 2 See the Virtual GPU Licensing Guide 2 See Virtual GPU Licensing Guide 1

Tensor performance

1044.4 TFLOPS 1 1457.0 TFLOPS 1 191.9 TFLOPS 1 21.7 TFLOPS 1 306.8 TFLOPS 2 53.8 TFLOPS 1 634.0 TFLOPS 1

VR ready

No 2 Yes 5

Power Consumption

Max power consumption: 70 W 1 150W 1 300W 1 40-60W (Configurable) 3 50 W 2 70W 1 72W 1 Total board power: 130W 1 Total board power: 140 W 1 Total board power: 200 W 1 Total board power: 210W 1 Total board power: 250W 1 Total board power: 300 W 4 Total board power: 600 W 1 Total board power: 70 W 2 Up to 600W (Configurable) 1

Filters and sorting

Vendors

Matrox 51 Miscellaneous Vendors 1 NVIDIA 32

GPU memory

16GB GDDR6 4 16GB GDDR7 1 20GB GDDR6 2 24GB GDDR6 3 24GB GDDR7 2 2 GB DDR2 1 32GB GDDR6 1 32GB GDDR7 1 48GB GDDR6 2 48GB GDDR7 1 4GB GDDR6 1 72GB GDDR7 1 8GB GDDR6 1 96GB GDDR7 3

Memory bandwidth

1344 GB/s 2 1597 GB/s 1 1792 GB/s 2 192 GB/s 1 200 GB/s 3 224 GB/s 1 288 GB/s 1 300 GB/s 1 320 GB/s 2 432 GB/s 2 576GB/s 1 600 GB/s 1 672 GB/s 1 864GB/s 1 896 GB/s 1 960 GB/s 1 96 GB/s 1

Error-correcting code (ECC)

None 2 Yes 19

CUDA Cores

10496 1 12800 1 14080 2 18176 2 2304 1 24064 3 2816 1 4352 1 6144 2 768 1 7680 1 8960 2

Tensor Cores

192 2 24 1 240 1 400 1 568 2 5th Generation 8 72 1 752 (5th Gen) 1 88 1

RT Cores

10 3 100 1 142 2 18 1 188 (4th Gen) 1 22 1 48 2 4th Generation 8 6 1 60 1

System interface

PCIe 4.0 x 16 5 PCIe 4.0 x 8 3 PCIe 5.0 x16 6 PCIe 5.0 x 8 2 PCIe Gen4: 64 GB/s 1 PCIe Gen4 x16 64GB/s 1 PCIe Gen4x16: 64GB/s bi-directional 1 PCIe Gen4 x8 3 PCIe x16 1 PCI Express 5.0 x16 1

Thermal solution

Active 15 Passive 6

Display connectors

4 x DisplayPort 1.4a 4 4x DisplayPort 2.1 1 4x DisplayPort 2.1b 6 4x Mini DisplayPort 1.4a 5 4x mini DisplayPort 2.1b 2

Max simultaneous displays

2x 7680 x 4320 @ 100 Hz 5 2x 7680 x 4320 @ 30Hz 1 2x 7680 x 4320 @ 60 Hz 8 4x 5120 x 2880 @ 60 Hz 1 8x 2560 x 1600 1 Up to four simultaneous displays 1

Power connector

PCIe 5.0 x16 1 PEX 8-pin 1 16-pin 1 1x PCIe CEM5 16-pin 7

Encode/decode engines

Graphics APIs

DirectX 12 Shader Model 6.6 OpenGL 4.63 Vulkan 1.3 2 DirectX 12 Shader Model 6.6 OpenGL 4.6 Vulkan 1.3 3 OpenGL 4.6 Vulkan 1.3 8 OpenGL 4.6 Vulkan 1.4 2 Vulkan 1.3 1

Compute APIs

CUDA 11.6 DirectCompute OpenCL 3.0 4 CUDA 11.6 OpenCL 3.0 DirectCompute 2 CUDA 12.2 OpenCL 3.0 DirectCompute 2 CUDA 12.8 OpenCL 3.0 2 CUDA 12.8 OpenCL 3.0 DirectCompute 6

Single-precision performance

110 TFLOPS 1 117 TFLOPS 1 12.0 TFLOPS 1 125 TFLOPS 1 17 TFLOPS 1 19.2 TFLOPS 2 2.7 TFLOPS 1 39.6 TFLOPS 1 65.3 TFLOPS 1 65 TFLOPS 1 6.7 TFLOPS 1 91.1 TFLOPS 1

RT Core performance

13.2 TFLOPS 1 151.0 TFLOPS 1 196 TFLOPS 1 210.6 TFLOPS 1 27.7 TFLOPS 1 333 TFLOPS 1 354.5 TFLOPS 1 380 TFLOPS 1 44.3 TFLOPS 2 52 TFLOPS 1 5.4 TFLOPS 1 91.6 TFLOPS 1

Memory Interface

128-bit 6 160-bit 2 192-bit 3 256-bit 2 384-bit 2 512-bit 4 64-bit 1

vGPU software support

Unit Dimensions (L x H x D mm)

12.83 x 2.59 x 10.9 cm 1 13.97 x 3.18 x 18.11 cm 2 16.8 x 6.9 cm 1 18.07 x 13.97 x 3.33 cm 2 18.9 x 4.26 x 21.66 cm 4 21.59 x 2.59 x 10.16 cm 1 21.7 x 19.1 x 4.3 cm 2 30 x 2.8 x 14.6 cm 1