NVIDIA
NVIDIA GeForce RTX 3090 Ti
Ampere • 24GB GDDR6X • 450W TDP
15 Fair Value
AI Performance
SDXL 1024x1024 14 images/min
LLM 7B Inference 82 tokens/sec
LLM 13B Inference 46 tokens/sec
Max Model Size 30B parameters
Source: Tom's Hardware (2024-06-15)
Specifications
- Architecture
- Ampere
- VRAM
- 24GB GDDR6X
- Memory Bandwidth
- 1,008 GB/s
- CUDA Cores
- 10,752
- Tensor Cores
- 336
- Base Clock
- 1,560 MHz
- Boost Clock
- 1,860 MHz
- TDP
- 450W
- Release Date
- Mar 2022
- MSRP
- $1,999