Boards / Jetson Orin NX 8GB Super
Jetson Orin NX 8GB (Super mode): LLM benchmarks
Orin NX 8GB module with JetPack 6.2 Super mode.
At a glance
- Measured runs7
- Models tested7
- Fastest run69.8 tok/s
- SmolLM2 1.7B, INT4, MLC · source ↗
- Sources1
Where to buy
- Jetson Orin NX 8GB module (Super mode): price not verified yet Check price on AmazonBuy at Seeed Studio
Every run on this board
| Model | Quant | Runtime | Gen tok/s | Prompt tok/s | TTFT ms | Source |
|---|---|---|---|---|---|---|
| SmolLM2 1.7B | INT4 | MLC | 69.8 | – | – | source ↗ 2025-01-16 |
| Llama 3.2 3B | INT4 | MLC | 46.5 | – | – | source ↗ 2025-01-16 |
| Phi-3.5 3.8B | INT4 | MLC | 41.3 | – | – | source ↗ 2025-01-16 |
| Gemma 2 2B | INT4 | MLC | 39.3 | – | – | source ↗ 2025-01-16 |
| Qwen2.5 7B | INT4 | MLC | 23.8 | – | – | source ↗ 2025-01-16 |
| Llama 3.1 8B | INT4 | MLC | 23.1 | – | – | source ↗ 2025-01-16 |
| Gemma 2 9B | INT4 | MLC | 13.38 | – | – | source ↗ 2025-01-16 |
Can the Jetson Orin NX 8GB Super run…
Can it run Gemma 2 2B?Can it run Gemma 2 9B?Can it run Llama 3.1 8B?Can it run Llama 3.2 3B?Can it run Phi-3.5 3.8B?Can it run Qwen2.5 7B?Can it run SmolLM2 1.7B?
Have this board? Submit your own run →