NVIDIA A2 Tensor Core GPU 16GB

Graphic Cards And Accessories\ Datacenter GPUs

The NVIDIA A2 Tensor Core GPU provides entry-level inference with low power, a small footprint, and high performance for NVIDIA AI at the edge. Featuring a low-profile PCIe Gen4 card and a low 40-60W configurable thermal design power (TDP) capability, the A2 brings versatile inference acceleration to any server for deployment at scale.

Specifications

GPU FeaturesNVIDIA A2 16GB
GPU Memory16GB GDDR6
Memory bandwidth200 GB/s
FP32 Tensor Core9 TF | 18 TF¹
BFLOAT16 Tensor Core18 TF | 36 TF¹
FP16 Tensor Core18 TF | 36 TF¹
Peak INT8 Tensor Core36 TOPS | 72 TOPS¹
Peak INT4 Tensor Core72 TOPS | 144 TOPS¹
RT Core10 RT Cores
Max thermal design
power (TDP)

40-60W (Configurable)

 

InterconnectPCIe Gen4 x8
Form factor1-slot, Low-Profile PCIe

¹ With sparsity
² Supported in future vGPU release

Versatile Entry-Level GPU

THIRD-GEN TENSOR CORES

 

Mountain

The third-generation Tensor Cores in A2 support integer math,down to INT4, and floating point math, up to FP32, to deliver high AI training and inference performance. The NVIDIA Ampere architecture also supports TF32 and NVIDIA’s automatic mixed precision (AMP) capabilities.

ROOT OF TRUST SECURITY

 

Mountain

Providing security in edge deployments and end-points is critical for enterprise business operations. A2 optionally supports secure boot through trusted code authentication and hardened rollback protections to protect against malicious malware attacks.

SECOND-GEN RT CORES

 

Mountain

A2 includes dedicated RT Cores for ray tracing that enable groundbreaking technologies at breakthrough speed. With up to 2X the throughput over the previous generation and the ability to concurrently run ray tracing with either shading or denoising capabilities.

TRANSCODING PERFORMANCE
Mountain

Exponential growth in video applications demand real-time scalable performance, requiring the latest in hardware encode and decode capabilities. A2 GPUs use dedicated hardware to fully accelerate video decoding and encoding for the most popular codecs, including H.265, H.264, VP9, and AV1 decode.