amdrdna3MSRP $899

AMD Radeon RX 7900 XT AI Model Compatibility

What AI models can you run on a AMD Radeon RX 7900 XT? With 20GB VRAM, this card runs 108 of 109 models in our database. Below: full grades, recommended quantizations, and tokens-per-second estimates for every model.

VRAM
20GB
Excellent fit
107
S + A grade
Will run
1
B + C grade
Too large
1
Cannot run any quant

Language Models46 of 47 run

S
Mistral Small 22B
22B · Mistral AI
Q4_K_M · 12.93GB
34 tok/s
S
Phi-4
14B · Microsoft
Q5_K_M · 10.38GB
66 tok/s
S
Qwen 2.5 14B
14B · Alibaba
Q4_K_M · 8.87GB
66 tok/s
S
Gemma 3 12B
12B · Google
Q8_0 · 12.15GB
66 tok/s
S
Mistral Nemo 12B
12B · Mistral AI
Q8_0 · 12.63GB
66 tok/s
S
Solar 10.7B
10.7B · Upstage
Q8_0 · 11.12GB
66 tok/s
S
Falcon 3 10B
10B · TII
Q8_0 · 10.7GB
96 tok/s
S
Gemma 2 9B Instruct
9.2B · Google
Q8_0 · 9.65GB
96 tok/s
S
Yi 1.5 9B Chat
9B · 01.AI
Q8_0 · 9.24GB
96 tok/s
S
DeepSeek R1 Distill 8B
8B · DeepSeek
Q8_0 · 8.45GB
96 tok/s
S
Llama 3.1 8B Instruct
8B · Meta
Q8_0 · 8.45GB
96 tok/s
S
Granite 3.3 8B
8B · IBM
Q8_0 · 8.59GB
96 tok/s
S
EXAONE 3.5 7.8B
7.8B · LG AI
Q8_0 · 8.24GB
96 tok/s
S
InternLM 2.5 7B
7.7B · Shanghai AI Lab
Q8_0 · 8.16GB
96 tok/s
S
Qwen 2.5 7B Instruct
7.6B · Alibaba
Q8_0 · 9GB
96 tok/s
S
Mistral 7B Instruct v0.3
7.3B · Mistral AI
Q8_0 · 7.67GB
96 tok/s
S
Falcon 3 7B
7B · TII
Q8_0 · 8.3GB
96 tok/s
S
OLMo 2 7B
7B · Allen AI
Q8_0 · 7.73GB
96 tok/s
S
OpenChat 3.5 7B
7B · OpenChat
Q8_0 · 7.67GB
96 tok/s
S
Yi 1.5 6B Chat
6B · 01.AI
Q8_0 · 6.5GB
96 tok/s
S
Gemma 3 4B
4B · Google
Q8_0 · 4.35GB
144 tok/s
S
Nemotron Mini 4B
4B · NVIDIA
Q8_0 · 4.65GB
144 tok/s
S
Danube 3 4B
4B · H2O.ai
Q8_0 · 4.42GB
144 tok/s
S
Phi-3.5 Mini 3.8B
3.8B · Microsoft
Q8_0 · 4.28GB
144 tok/s
S
Phi-4 Mini 3.8B
3.8B · Microsoft
Q8_0 · 4.3GB
144 tok/s
S
Llama 3.2 3B Instruct
3.2B · Meta
Q8_0 · 3.69GB
144 tok/s
S
Qwen 2.5 3B
3B · Alibaba
Q8_0 · 3.87GB
144 tok/s
S
Falcon 3 3B
3B · TII
Q8_0 · 3.8GB
144 tok/s
S
StableLM Zephyr 3B
3B · Stability AI
Q8_0 · 3.27GB
144 tok/s
S
Rocket 3B
3B · Pansophic
Q8_0 · 3.27GB
144 tok/s
S
Gemma 2 2B
2.6B · Google
Q8_0 · 3.09GB
144 tok/s
S
EXAONE 3.5 2.4B
2.4B · LG AI
Q8_0 · 3.14GB
144 tok/s
S
Granite 3.3 2B
2B · IBM
Q8_0 · 3.01GB
192 tok/s
S
SmolLM2 1.7B
1.7B · HuggingFace
Q8_0 · 2.2GB
192 tok/s
S
Qwen 2.5 1.5B
1.5B · Alibaba
Q8_0 · 2.26GB
192 tok/s
S
DeepSeek R1 Distill 1.5B
1.5B · DeepSeek
Q8_0 · 2.26GB
192 tok/s
S
Llama 3.2 1B Instruct
1.24B · Meta
FP16 · 2.81GB
192 tok/s
S
TinyLlama 1.1B
1.1B · TinyLlama
Q8_0 · 1.59GB
192 tok/s
S
Gemma 3 1B
1B · Google
Q8_0 · 1.5GB
192 tok/s
S
Falcon 3 1B
1B · TII
Q8_0 · 2.16GB
192 tok/s
S
Qwen 2.5 0.5B
0.5B · Alibaba
Q8_0 · 1.13GB
192 tok/s
S
Danube 3 500M
0.5B · H2O.ai
Q8_0 · 1.01GB
192 tok/s
S
SmolLM2 360M
0.36B · HuggingFace
Q8_0 · 0.86GB
192 tok/s
S
SmolLM2 135M
0.135B · HuggingFace
FP16 · 0.75GB
192 tok/s
A
Gemma 3 27B
27B · Google
Q4_K_M · 15.91GB
34 tok/s
B
Qwen 2.5 32B
32B · Alibaba
Q4_K_M · 18.99GB
29 tok/s
F
Llama 3.1 70B Instruct
70B · Meta
Q4_K_M · 40.1GB

Code Models16 of 16 run

Multimodal & Vision6 of 6 run

Image Generation9 of 9 run

Speech Recognition9 of 9 run

Text-to-Speech14 of 14 run

Audio Generation1 of 1 run

Embedding Models5 of 5 run

Reranker Models2 of 2 run

How these grades work

Grades are computed from the ratio of AMD Radeon RX 7900 XT's effective VRAM (20GB) to each model's required VRAM at its highest-quality quantization that still fits. S: comfortable headroom (1.5×+). A: smooth (1.2×+). B: tight but works (1.0×+). C: partial offload (0.8×+). D: heavy offload (0.5×+). F: cannot run.

Tokens-per-second figures are based on real community benchmarks (llama.cpp discussions, MLX, vLLM) scaled to model size. Real-world numbers vary with batch size, context length, and driver version.