Skip to content

Jetson Orin NX 16GB (original mode)

Orin NX 16GB module in its original power mode.

Fastest measured run

59.5tok/s

SmolLM2 1.7B · INT4 · MLC · source ↗

Buy at Seeed Studio Check price on Amazon

For the Jetson Orin NX 16GB module. All options

Chip: Orin (Ampere GPU)
Memory: 16GB
Price: Not verified
Runs: 7
Models: 7
Sources: 1

Where to buy.

Jetson Orin NX 16GB moduleprice not verified yet
Buy at Seeed Studio Check price on Amazon

Every run on this board.

Model	Size	Quant	Runtime	Gen tok/s	Prompt tok/s	TTFT ms	Source
SmolLM2 1.7B	1.7B	`INT4`	MLC	59.5	–	–	source ↗ 2025-01-16
Llama 3.2 3B	3B	`INT4`	MLC	40.4	–	–	source ↗ 2025-01-16
Phi-3.5 3.8B	3.8B	`INT4`	MLC	35.9	–	–	source ↗ 2025-01-16
Gemma 2 2B	2B	`INT4`	MLC	31.6	–	–	source ↗ 2025-01-16
Qwen2.5 7B	7B	`INT4`	MLC	20.8	–	–	source ↗ 2025-01-16
Llama 3.1 8B	8B	`INT4`	MLC	20.5	–	–	source ↗ 2025-01-16
Gemma 2 9B	9B	`INT4`	MLC	10.56	–	–	source ↗ 2025-01-16

Can the Jetson Orin NX 16GB run…

Gemma 2 2B Gemma 2 9B Llama 3.1 8B Llama 3.2 3B Phi-3.5 3.8B Qwen2.5 7B SmolLM2 1.7B

Have this board? Submit your own run

Stay in the loop.

New boards, new runtimes, new numbers. One email a month, no hype.