Английская Википедия:Ada Lovelace (microarchitecture)
Шаблон:Short description Шаблон:Use mdy dates Шаблон:For Шаблон:Primary sources Шаблон:Infobox GPU microarchitecture
Ada Lovelace, also referred to simply as Lovelace,[1] is a graphics processing unit (GPU) microarchitecture developed by Nvidia as the successor to the Ampere architecture, officially announced on September 20, 2022. It is named after the English mathematician Ada Lovelace,[2] one of the first computer programmers. Nvidia announced the architecture along with the new GeForce 40 series consumer GPUs[3] and the RTX 6000 Ada Generation pro workstation graphics card.[4] The Lovelace chipset uses TSMC's new 5 nm "4N" process which offers increased efficiency over the previous Samsung 8 nm and TSMC N7 processes used by Nvidia for its previous-generation Ampere architecture.[5]
Background
The Ada Lovelace architecture follows on from the Ampere architecture that was released in 2020. The Ada Lovelace architecture was announced by Nvidia CEO Jensen Huang during a GTC 2022 keynote on September 20, 2022 with the architecture powering Nvidia's GPUs for gaming, workstations and datacenters.[6]
Architectural details
Architectural improvements of the Ada Lovelace architecture include the following:[7]
- CUDA Compute Capability 8.9[8]
- TSMC 4NШаблон:Nbspprocess (custom designed for NVIDIA) - not to be confused with TSMC's regular N4 node
- 4th-generation Tensor Cores with FP8, FP16, bfloat16, TensorFloat-32 (TF32) and sparsity acceleration
- 3rd-generation Ray Tracing Cores, plus concurrent ray tracing and shading and compute
- Shader Execution Reordering (SER)[9]
- Nvidia video encoder/decoder (NVENC/NVDEC) with 8K 10-bit 60FPS AV1 fixed function hardware encoding[10][11]
- No NVLink support[12][13]
Streaming multiprocessors (SMs)
CUDA cores
128 CUDA cores are included in each SM.
RT cores
Ada Lovelace features third-generation RT cores The RTX 4090 features 128 RT cores compared to the 84 in the previous generation RTX 3090 Ti. These 128 RT cores can provide up to 191 TFLOPS of compute with 1.49 TFLOPS per RT core.[14] A new stage in the ray tracing pipeline called Shader Execution Reordering (SER) is added in the Lovelace architecture which Nvidia claims provides a 2x performance improvement in ray tracing workloads.[6]
Tensor cores
Lovelace's new fourth-generation Tensor cores enable the AI technology used in DLSS 3's frame generation techniques. Much like Ampere, each SM contains 4 Tensor cores but Lovelace contains a greater number of Tensor cores overall given its increased number of SMs.
Clock speeds
There is a significant increase in clock speeds with the Ada Lovelace architecture with the RTX 4090's base clock speed being higher than the boost clock speed of the RTX 3090 Ti.
| RTX 2080 Ti | RTX 3090 Ti | RTX 4090 | |
|---|---|---|---|
| Шаблон:Midsize | Turing | Ampere | Ada Lovelace |
| Шаблон:Midsize | 1350 | 1560 | 2235 |
| Шаблон:Midsize | 1635 | 1860 | 2520 |
Cache and memory subsystem
| RTX 2080 Ti | RTX 3090 Ti | RTX 4090 | |
|---|---|---|---|
| Шаблон:Midsize | Turing | Ampere | Ada Lovelace |
| Шаблон:Midsize | 6.375Шаблон:NbspMB (96Шаблон:NbspKB per SM) |
10.5Шаблон:NbspMB (128Шаблон:NbspKB per SM) |
16Шаблон:NbspMB (128Шаблон:NbspKB per SM) |
| Шаблон:Midsize | 5.5Шаблон:NbspMB | 6Шаблон:NbspMB | 72Шаблон:NbspMB |
The fully enabled AD102 Lovelace die features 96Шаблон:NbspMB of L2 cache, a 16x increase from the 6Шаблон:NbspMB in the Ampere-based GA102 die.[15] The GPU having quick access to a high amount of L2 cache benefits complex operations like ray tracing compared to the GPU seeking data from the GDDR video memory which is slower. Relying less on accessing memory for storing important and frequently accessed data means that a narrower memory bus width can be used in tandem with a large L2 cache.
Each memory controller uses a 32-bit connection with up to 12 present for a combined memory bus width of 384-bit. The Lovelace architecture can use either GDDR6 or GDDR6X memory. GDDR6X memory features on the desktop GeForce RTX 40 series while the more energy-efficient GDDR6 memory is used on its corresponding mobile versions and on RTX A6000 workstation GPUs.
Power efficiency and process node
The Ada Lovelace architecture is able to use lower voltages compared to its predecessor.[6] Nvidia claims a 2x performance increase for the RTX 4090 at the same 450W used by the previous generation flagship RTX 3090 Ti.[16]
Increased power efficiency can be attributed in part to the smaller fabrication node used by the Lovelace architecture. The Ada Lovelace architecture is fabricated on TSMC's cutting-edge 4N process, a custom designed process node for Nvidia. The previous generation Ampere architecture used Samsung's 8nm-based 8N process node from 2018, which was two years old by the time of Ampere's launch.[17][18] The AD102 die with its 76.3 billion transistors has a transistor density of 125.5 million per mm2, a 178% increase in density from GA102's 45.1 million per mm2.
Media engine
The Lovelace architecture utilizes the new 8th generation Nvidia NVENC video encoder and the 7th generation NVDEC video decoder introduced by Ampere returns.[19]
NVENC AV1 hardware encoding with support for up to 8K resolution at 60FPS in 10-bit color is added, enabling higher video fidelity at lower bit rates compared to the H.264 and H.265 codecs.[20] Nvidia claims that its NVENC AV1 encoder featured in the Lovelace architecture is 40% more efficient than the H.264 encoder in the Ampere architecture.[21]
The Lovelace architecture received criticism for not supporting the DisplayPort 2.0 connection that supports higher display data bandwidth and instead uses the older DisplayPort 1.4a which is limited to a peak bandwidth of 32Gbps.[22] As a result, Lovelace GPUs would be limited by DisplayPort 1.4a's supported refresh rates despite the GPU's performance being able to reach higher frame rates. Intel's Arc GPUs that also released in October 2022 included DisplayPort 2.0. AMD's competing RDNA 3 architecture released just two months after Lovelace included DisplayPort 2.1.[23]
Ada Lovelace dies
| Chip[24] | AD102[25] | AD103[26] | AD104[27] | AD106[28] | AD107[29] |
|---|---|---|---|---|---|
| Die size | 609 mm2 | 379 mm2 | 294 mm2 | 188 mm2 | 159 mm2 |
| Transistors | 76.3B | 45.9B | 35.8B | 22.9B | 18.9B |
| Transistor density | 125.3 MTr/mm2 | 121.1 MTr/mm2 | 121.8 MTr/mm2 | 121.8 MTr/mm2 | 118.9 MTr/mm2 |
| Graphics processing clusters (GPC) |
12 | 7 | 5 | 3 | 2 |
| Streaming multiprocessors (SM) |
144 | 80 | 60 | 36 | 24 |
| CUDA cores | 18432 | 10240 | 7680 | 4608 | 3072 |
| Texture mapping units | 576 | 320 | 240 | 144 | 96 |
| Render output units | 192 | 112 | 80 | 48 | 48 |
| Tensor cores | 576 | 320 | 240 | 144 | 96 |
| RT cores | 144 | 80 | 60 | 36 | 24 |
| L1 cache | 18Шаблон:NbspMB | 10Шаблон:NbspMB | 7.5Шаблон:NbspMB | 4.5Шаблон:NbspMB | 3Шаблон:NbspMB |
| 128Шаблон:NbspKB per SM | |||||
| L2 cache | 96Шаблон:NbspMB | 64Шаблон:NbspMB | 48Шаблон:NbspMB | 32Шаблон:NbspMB | |
Ada Lovelace-based products
Gaming
- GeForce 40 series
- GeForce RTX 4050 (mobile) (AD107)
- GeForce RTX 4060 (mobile) (AD107)
- GeForce RTX 4060 Ti (AD106)
- GeForce RTX 4070 (mobile) (AD106)
- GeForce RTX 4070 (AD104)
- GeForce RTX 4070 Ti (AD104)
- GeForce RTX 4080 (mobile) (AD104)
- GeForce RTX 4080 (AD103)
- GeForce RTX 4090 (mobile) (AD103)
- GeForce RTX 4090 (AD102)
Professional
Desktop Workstation
| Model | Launch | Launch MSRP (USD) |
Code name(s) |
rowspan="2" Шаблон:Vert header | Die size |
Core configШаблон:Efn |
SM countШаблон:Efn |
Cache | Clock speedsШаблон:Efn | FillrateШаблон:EfnШаблон:Efn | Memory | Processing power (TFLOPS) | TDP | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| L1 | L2 | Core clock (MHz) |
Memory (Gb/s) |
Pixel (Gpx/s) |
Texture (Gtex/s) |
Type | Size | Bandwidth (GB/s) |
Bus width |
Half precision (boost) |
Single precision (boost) |
Double precision (boost) |
Tensor compute [sparse] | |||||||||
| Шаблон:Nowrap | Шаблон:Dts | $1,250 | AD104-400 | 35.8 | 294.5Шаблон:Nbspmm2 | 6144 192:80:48:192 |
48 | 6Шаблон:NbspMB | 48Шаблон:NbspMB | 1290 (1565) |
16 Gbps | 103.2 (125.2) |
247.68 (300.48) |
GDDR6 | 20Шаблон:NbspGB | 320 | 160-bit | (19.2) |
153.4 [306.8] |
70Шаблон:NbspW | ||
| Шаблон:Nowrap | Шаблон:Dts | $6,799 | AD102-300 | 76.3 | 608.4Шаблон:Nbspmm2 | 18,176 568:192:142:568 |
142 | 17.75Шаблон:NbspMB | 96Шаблон:NbspMB | 915 (2505) |
20 Gbps | 175.68 (480.96) |
519.72 (1,422.84) |
48Шаблон:NbspGB | 960 | 384-bit | (91.1) |
728.5 [1457.0] |
300Шаблон:NbspW | |||
Mobile Workstation
| Model | Launch | Code name(s) |
rowspan="2" Шаблон:Vert header | Die size |
Core configШаблон:Efn |
SM countШаблон:Efn |
Cache | Clock speedsШаблон:Efn | FillrateШаблон:EfnШаблон:Efn | Memory | Processing power (TFLOPS) | TGP | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| L1 | L2 | Core clock (MHz) |
Memory (Gb/s) |
Pixel (Gpx/s) |
Texture (Gtex/s) |
Type | Size | Bandwidth (GB/s) |
Bus width |
Half precision (boost) |
Single precision (boost) |
Double precision (boost) |
Tensor compute [sparse] | ||||||||
| Шаблон:Nowrap | Шаблон:Dts | AD107 | 146Шаблон:Nbspmm2 | 3072 96:32:24:96 |
24 | 3Шаблон:NbspMB | 12Шаблон:NbspMB | 930 (1455) |
14 Gbps | 29.76 (46.56) |
89.28 (139.68) |
GDDR6 | 8Шаблон:NbspGB | 224 | 128-bit | 35Шаблон:NbspW | |||||
| Шаблон:Nowrap | 1635 (2115) |
16 Gbps | 52.32 (67.68) |
156.96 (203.04) |
256 | (14.5) |
115.8 [231.6] |
35–140Шаблон:NbspW | |||||||||||||
| Шаблон:Nowrap | AD106 | 22.9 | 190Шаблон:Nbspmm2 | 4608 144:48:36:144 |
36 | 4.5Шаблон:NbspMB | 32Шаблон:NbspMB | 1395 (1695) |
66.96 (81.36) |
200.88 (244.08) |
(19.9) |
159.3 [318.6] | |||||||||
| Шаблон:Nowrap | AD104 | 35.8 | 294.5Шаблон:Nbspmm2 | 5120 160:64:40:160 |
40 | 5Шаблон:NbspMB | 48Шаблон:NbspMB | 1290 (1665) |
18 Gbps | 82.56 (106.56) |
206.4 (266.4) |
12Шаблон:NbspGB | 432 | 192-bit | (23.0) |
184.3 [368.6] |
60–140Шаблон:NbspW | ||||
| Шаблон:Nowrap | 7424 232:80:58:232 |
58 | 7.25Шаблон:NbspMB | 1290 (1665) |
103.2 (133.2) |
299.28 (386.28) |
(33.6) |
269.0 [538.0] |
80–175Шаблон:NbspW | ||||||||||||
| Шаблон:Nowrap | AD103 | 45.9 | 378.6Шаблон:Nbspmm2 | 9728 304:112:76:304 |
76 | 9.5Шаблон:NbspMB | 64Шаблон:NbspMB | 1335 (1695) |
149.52 (189.84) |
405.84 (515.28) |
16Шаблон:NbspGB | 576 | 256-bit | (42.6) |
340.9 [681.8] | ||||||
Datacenter
| Model | Launch | Launch MSRP (USD) |
Code name(s) |
rowspan="2" Шаблон:Vert header | Die size |
Core configШаблон:Efn |
SM countШаблон:Efn |
Cache | Clock speedsШаблон:Efn | FillrateШаблон:EfnШаблон:Efn | Memory | Processing power (TFLOPS) | TBP | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| L1 | L2 | Core clock (MHz) |
Memory (MHz) |
Pixel (Gpx/s) |
Texture (Gtex/s) |
Type | Size | Bandwidth (GB/s) |
Bus width |
Half precision (boost) |
Single precision (boost) |
Double precision (boost) |
Tensor compute [sparse] | |||||||||
| Шаблон:Nowrap | Шаблон:Dts | $ | AD104-???-A1 | 35.8 | 295Шаблон:Nbspmm2 | 7,680 240:80:60:240 |
60 | 7.5Шаблон:NbspMB | 48Шаблон:NbspMB | 795 (2040) |
1313 | 63.6 (163.2) |
190.8 (489.6) |
GDDR6X | 24Шаблон:NbspGB | 504.2 | 192-bit | 285Шаблон:NbspW | ||||
| Шаблон:Nowrap | Шаблон:Dts | $ | AD102-895-A1 | 76.3 | 608.4Шаблон:Nbspmm2 | 18,176 568:192:142:568 |
142 | 17.75Шаблон:NbspMB | 96Шаблон:NbspMB | 735 (2490) |
2250 | 58.8 (199.2) |
176.4 (597.6) |
GDDR6 | 48Шаблон:NbspGB | 864 | 384-bit | 300Шаблон:NbspW | ||||
| Шаблон:Nowrap | $ | AD102-???-A1 | 48Шаблон:NbspMB | 1005 (2475) |
80.4 (198.0) |
241.2 (594.0) |
24Шаблон:NbspGB | |||||||||||||||
| Шаблон:Nowrap | $ | AD102-???-A1 | ||||||||||||||||||||
See also
References
- ↑ Шаблон:Cite web
- ↑ Шаблон:Cite news
- ↑ Шаблон:Cite press release
- ↑ Шаблон:Cite web
- ↑ Шаблон:Cite news
- ↑ 6,0 6,1 6,2 Шаблон:Cite web
- ↑ Шаблон:Cite web
- ↑ Шаблон:Cite web
- ↑ Шаблон:Cite web
- ↑ Шаблон:Cite web
- ↑ Шаблон:Cite web
- ↑ Шаблон:Cite web
- ↑ Шаблон:Cite news
- ↑ Шаблон:Cite web
- ↑ Шаблон:Cite web
- ↑ Шаблон:Cite web
- ↑ Шаблон:Cite web
- ↑ Шаблон:Cite web
- ↑ Шаблон:Cite web
- ↑ Шаблон:Cite web
- ↑ Шаблон:Cite web
- ↑ Шаблон:Cite web
- ↑ Шаблон:Cite web
- ↑ Шаблон:Cite web
- ↑ Шаблон:Cite web
- ↑ Шаблон:Cite web
- ↑ Шаблон:Cite web
- ↑ Шаблон:Cite web
- ↑ Шаблон:Cite web
