How fast does AI run on small boards?
Measured tokens per second for LLMs on the Raspberry Pi, Jetson, Rockchip, Hailo and Axera boards that makers actually buy. Every number links to the public source it came from.
233measured runs
17boards & configs
42models
16public sources
Board
Model
Click a column header to sort. Gen tok/s = generation (decode) speed. Different sources use different prompts, runtimes and settings, so read the source before comparing two rows.
| Board | Model | Quant | Runtime | Gen tok/s | Prompt tok/s | TTFT ms | Source |
|---|---|---|---|---|---|---|---|
| Jetson AGX Orin Jetson AGX Orin | Llama 3.2 1B | INT4 | MLC 0.1.2 (dustynv/mlc:0.1.2-r36.3.0) | 163.9 | – | – | source ↗ accessed 2026-10-17 |
| Jetson AGX Thor Jetson AGX Thor | Gemma 4 E2B | not stated | not stated | 133 | – | – | source ↗ 2026-08-25 |
| Jetson AGX Thor Jetson AGX Thor | Gemma 4 E4B | not stated | not stated | 95 | – | – | source ↗ 2026-08-25 |
| Jetson AGX Orin Jetson AGX Orin | Llama 3.2 3B | INT4 | MLC 0.1.2 (dustynv/mlc:0.1.2-r36.3.0) | 80.4 | – | – | source ↗ accessed 2026-10-17 |
| Jetson AGX Thor Jetson AGX Thor | Qwen3.5 9B | not stated | not stated | 73 | – | – | source ↗ 2026-08-25 |
| Jetson Orin NX 8GB Super Jetson Orin NX 8GB (Super mode) | SmolLM2 1.7B | INT4 | MLC | 69.8 | – | – | source ↗ 2025-01-16 |
| Jetson Orin NX 16GB Super Jetson Orin NX 16GB (Super mode) | SmolLM2 1.7B | INT4 | MLC | 68.8 | – | – | source ↗ 2025-01-16 |
| Jetson AGX Thor Jetson AGX Thor | Qwen3.5 4B | not stated | not stated | 68 | – | – | source ↗ 2026-08-25 |
| Jetson Orin Nano Super Jetson Orin Nano 8GB (Super mode) | SmolLM2 1.7B | INT4 | MLC | 64.5 | – | – | source ↗ 2025-01-16 |
| Rockchip RK3588 Rockchip RK3588 (vendor reference board) | LFM2.5-VL 450M | w8a8 | RKLLM v1.3.1 | 62.16 | – | 102.74 | source ↗ commit 2026-09-29 |
| Jetson Orin NX 16GB Jetson Orin NX 16GB (original mode) | SmolLM2 1.7B | INT4 | MLC | 59.5 | – | – | source ↗ 2025-01-16 |
| Jetson Orin Nano Jetson Orin Nano | Llama 3.2 1B | INT4 | MLC 0.1.2 (dustynv/mlc:0.1.2-r36.3.0) | 54.8 | – | – | source ↗ accessed 2026-10-17 |
| Jetson Orin NX 8GB Jetson Orin NX 8GB (original mode) | SmolLM2 1.7B | INT4 | MLC | 51.5 | – | – | source ↗ 2025-01-16 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | LFM2.5-VL 450M | w4a16 | RKLLM v1.3.1 | 51.22 | – | 246.03 | source ↗ commit 2026-09-29 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | LFM2.5-VL 450M | w4a16_g128 | RKLLM v1.3.1 | 48.65 | – | 260.98 | source ↗ commit 2026-09-29 |
| Jetson Orin NX 8GB Super Jetson Orin NX 8GB (Super mode) | Llama 3.2 3B | INT4 | MLC | 46.5 | – | – | source ↗ 2025-01-16 |
| Jetson Orin NX 16GB Super Jetson Orin NX 16GB (Super mode) | Llama 3.2 3B | INT4 | MLC | 45.8 | – | – | source ↗ 2025-01-16 |
| Rockchip RK3588 Rockchip RK3588 (vendor reference board) | MiniCPM4 0.5B | w8a8 | RKLLM v1.3.1 | 45.34 | – | 135.29 | source ↗ commit 2026-09-29 |
| Jetson Orin Nano Super Jetson Orin Nano 8GB (Super mode) | Llama 3.2 3B | INT4 | MLC | 43.1 | – | – | source ↗ 2025-01-16 |
| Rockchip RK3588 Rockchip RK3588 (vendor reference board) | Qwen2 0.5B | w8a8 | RKLLM v1.3.1 | 41.58 | – | 145.9 | source ↗ commit 2026-09-29 |
| Jetson Orin NX 8GB Super Jetson Orin NX 8GB (Super mode) | Phi-3.5 3.8B | INT4 | MLC | 41.3 | – | – | source ↗ 2025-01-16 |
| Jetson Orin Nano Jetson Orin Nano 8GB (original mode) | SmolLM2 1.7B | INT4 | MLC | 41 | – | – | source ↗ 2025-01-16 |
| Jetson Orin NX 16GB Super Jetson Orin NX 16GB (Super mode) | Phi-3.5 3.8B | INT4 | MLC | 40.9 | – | – | source ↗ 2025-01-16 |
| Jetson Orin NX 16GB Jetson Orin NX 16GB (original mode) | Llama 3.2 3B | INT4 | MLC | 40.4 | – | – | source ↗ 2025-01-16 |
| Jetson Orin NX 8GB Super Jetson Orin NX 8GB (Super mode) | Gemma 2 2B | INT4 | MLC | 39.3 | – | – | source ↗ 2025-01-16 |
| Jetson Orin NX 16GB Super Jetson Orin NX 16GB (Super mode) | Gemma 2 2B | INT4 | MLC | 39 | – | – | source ↗ 2025-01-16 |
| Jetson Orin Nano Super Jetson Orin Nano 8GB (Super mode) | Phi-3.5 3.8B | INT4 | MLC | 38.1 | – | – | source ↗ 2025-01-16 |
| M5Stack AI Pyramid M5Stack AI Pyramid (AX8850) | Qwen2.5 0.5B Instruct | W4A16 | StackFlow | 37.11 | – | 140.17 | source ↗ accessed 2026-10-17 |
| Jetson Orin NX 16GB Jetson Orin NX 16GB (original mode) | Phi-3.5 3.8B | INT4 | MLC | 35.9 | – | – | source ↗ 2025-01-16 |
| Jetson Orin Nano Super Jetson Orin Nano 8GB (Super mode) | Gemma 2 2B | INT4 | MLC | 35 | – | – | source ↗ 2025-01-16 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | MiniCPM4 0.5B | w4a16 | RKLLM v1.3.1 | 34.57 | – | 330.8 | source ↗ commit 2026-09-29 |
| Jetson Orin NX 8GB Jetson Orin NX 8GB (original mode) | Llama 3.2 3B | INT4 | MLC | 34.5 | – | – | source ↗ 2025-01-16 |
| Jetson Orin Nano Jetson Orin Nano (post says "Orin Nano 2") | Gemma 4 E2B | not stated | not stated | 34 | – | – | source ↗ 2026-08-25 |
| Rockchip RK3588 Rockchip RK3588 (vendor reference board) | Qwen3 0.6B | w8a8 | RKLLM v1.3.1 | 32.91 | – | 199.09 | source ↗ commit 2026-09-29 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | LFM2.5-VL 450M | w8a8 | RKLLM v1.3.1 | 32.75 | – | 239.34 | source ↗ commit 2026-09-29 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | MiniCPM4 0.5B | w4a16_g128 | RKLLM v1.3.1 | 32.66 | – | 359.16 | source ↗ commit 2026-09-29 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | Qwen2 0.5B | w4a16 | RKLLM v1.3.1 | 32.56 | – | 342.37 | source ↗ commit 2026-09-29 |
| Rockchip RK3588 Rockchip RK3588 (vendor reference board) | DeepSeek-OCR 3B(A570M) | w8a8 | RKLLM v1.3.1 | 31.6 | – | 701.21 | source ↗ commit 2026-09-29 |
| Jetson Orin NX 16GB Jetson Orin NX 16GB (original mode) | Gemma 2 2B | INT4 | MLC | 31.6 | – | – | source ↗ 2025-01-16 |
| Jetson Orin NX 8GB Jetson Orin NX 8GB (original mode) | Phi-3.5 3.8B | INT4 | MLC | 30.8 | – | – | source ↗ 2025-01-16 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | Qwen2 0.5B | w4a16_g128 | RKLLM v1.3.1 | 30.33 | – | 361.78 | source ↗ commit 2026-09-29 |
| Jetson Orin Nano Jetson Orin Nano 8GB (original mode) | Llama 3.2 3B | INT4 | MLC | 27.7 | – | – | source ↗ 2025-01-16 |
| Rockchip RK3588 Rockchip RK3588 (vendor reference board) | Qwen3.5 0.8B | w8a8 | RKLLM v1.3.1 | 27.05 | – | 587.74 | source ↗ commit 2026-09-29 |
| M5Stack LLM8850 M5Stack LLM8850 M.2 card (AX8850) | Qwen2.5 0.5B Instruct | W4A16 | StackFlow | 27.05 | – | – | source ↗ accessed 2026-10-17 |
| M5Stack AI Pyramid M5Stack AI Pyramid (AX8850) | InternVL3 1B | W8A16 | StackFlow | 26.67 | – | 142.32 | source ↗ accessed 2026-10-17 |
| Jetson Orin NX 8GB Jetson Orin NX 8GB (original mode) | Gemma 2 2B | INT4 | MLC | 26.6 | – | – | source ↗ 2025-01-16 |
| M5Stack AI Pyramid M5Stack AI Pyramid (AX8850) | Qwen2.5 0.5B Instruct | W8A16 | StackFlow | 25.5 | – | 143.02 | source ↗ accessed 2026-10-17 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | Qwen3 0.6B | w4a16 | RKLLM v1.3.1 | 24.85 | – | 468.61 | source ↗ commit 2026-09-29 |
| Jetson Orin Nano Jetson Orin Nano 8GB (original mode) | Phi-3.5 3.8B | INT4 | MLC | 24.7 | – | – | source ↗ 2025-01-16 |
| Rockchip RK3588 Rockchip RK3588 (vendor reference board) | TinyLlama 1.1B | w8a8 | RKLLM v1.3.1 | 24.43 | – | 243.93 | source ↗ commit 2026-09-29 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | DeepSeek-OCR 3B(A570M) | w4a16 | RKLLM v1.3.1 | 24.38 | – | 1034.97 | source ↗ commit 2026-09-29 |
| Jetson Orin NX 8GB Super Jetson Orin NX 8GB (Super mode) | Qwen2.5 7B | INT4 | MLC | 23.8 | – | – | source ↗ 2025-01-16 |
| Jetson Orin NX 16GB Super Jetson Orin NX 16GB (Super mode) | Qwen2.5 7B | INT4 | MLC | 23.5 | – | – | source ↗ 2025-01-16 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | Qwen3 0.6B | w4a16_g128 | RKLLM v1.3.1 | 23.48 | – | 506.41 | source ↗ commit 2026-09-29 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | MiniCPM4 0.5B | w8a8 | RKLLM v1.3.1 | 23.28 | – | 321.12 | source ↗ commit 2026-09-29 |
| Jetson Orin NX 8GB Super Jetson Orin NX 8GB (Super mode) | Llama 3.1 8B | INT4 | MLC | 23.1 | – | – | source ↗ 2025-01-16 |
| Jetson Orin NX 16GB Super Jetson Orin NX 16GB (Super mode) | Llama 3.1 8B | INT4 | MLC | 22.8 | – | – | source ↗ 2025-01-16 |
| Jetson Orin Nano Super Jetson Orin Nano 8GB (Super mode) | Qwen2.5 7B | INT4 | MLC | 21.8 | – | – | source ↗ 2025-01-16 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | Qwen2 0.5B | w8a8 | RKLLM v1.3.1 | 21.73 | – | 344.27 | source ↗ commit 2026-09-29 |
| Jetson Orin Nano Jetson Orin Nano 8GB (original mode) | Gemma 2 2B | INT4 | MLC | 21.5 | – | – | source ↗ 2025-01-16 |
| M5Stack LLM8850 M5Stack LLM8850 M.2 card (AX8850) | MiniCPM4 0.5B | W8A16 | StackFlow | 21.05 | – | 212.91 | source ↗ accessed 2026-10-17 |
| Jetson Orin NX 16GB Jetson Orin NX 16GB (original mode) | Qwen2.5 7B | INT4 | MLC | 20.8 | – | – | source ↗ 2025-01-16 |
| Jetson Orin NX 16GB Jetson Orin NX 16GB (original mode) | Llama 3.1 8B | INT4 | MLC | 20.5 | – | – | source ↗ 2025-01-16 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | TinyLlama 1.1B | w4a16 | RKLLM v1.3.1 | 19.71 | – | 543.68 | source ↗ commit 2026-09-29 |
| Jetson Orin Nano Super Jetson Orin Nano 8GB (Super mode) | Llama 3.1 8B | INT4 | MLC | 19.1 | – | – | source ↗ 2025-01-16 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | Qwen3.5 0.8B | w4a16 | RKLLM v1.3.1 | 18.79 | – | 1369.31 | source ↗ commit 2026-09-29 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | TinyLlama 1.1B | w4a16_g128 | RKLLM v1.3.1 | 18.08 | – | 672.61 | source ↗ commit 2026-09-29 |
| Jetson Orin Nano Jetson Orin Nano (post says "Orin Nano 2") | Qwen3.5 4B | not stated | not stated | 18 | – | – | source ↗ 2026-08-25 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | Qwen3.5 0.8B | w4a16_g128 | RKLLM v1.3.1 | 17.88 | – | 1392.09 | source ↗ commit 2026-09-29 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | DeepSeek-OCR 3B(A570M) | w8a8 | RKLLM v1.3.1 | 17.26 | – | 1242.78 | source ↗ commit 2026-09-29 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | Qwen3 0.6B | w8a8 | RKLLM v1.3.1 | 17.17 | – | 461.54 | source ↗ commit 2026-09-29 |
| Jetson Orin NX 8GB Jetson Orin NX 8GB (original mode) | Qwen2.5 7B | INT4 | MLC | 17.1 | – | – | source ↗ 2025-01-16 |
| Jetson Orin Nano Jetson Orin Nano (post says "Orin Nano 2") | Gemma 4 E4B | not stated | not stated | 17 | – | – | source ↗ 2026-08-25 |
| M5Stack AI Pyramid M5Stack AI Pyramid (AX8850) | Qwen2.5 1.5B Instruct | W4A16 | StackFlow | 16.77 | – | 289.06 | source ↗ accessed 2026-10-17 |
| Rockchip RK3588 Rockchip RK3588 (vendor reference board) | Qwen2.5 1.5B | w8a8 | RKLLM v1.3.1 | 16.69 | – | 378.31 | source ↗ commit 2026-09-29 |
| Jetson Orin NX 8GB Jetson Orin NX 8GB (original mode) | Llama 3.1 8B | INT4 | MLC | 15.9 | – | – | source ↗ 2025-01-16 |
| Rockchip RK3588 Rockchip RK3588 (vendor reference board) | Spark-X2.5 1.7B | w8a8 | RKLLM v1.3.1 | 15.61 | – | 386.23 | source ↗ commit 2026-09-29 |
| Rockchip RK3588 Rockchip RK3588 (vendor reference board) | InternLM2 1.8B | w8a8 | RKLLM v1.3.1 | 15.45 | – | 380.14 | source ↗ commit 2026-09-29 |
| M5Stack LLM8850 M5Stack LLM8850 M.2 card (AX8850) | Qwen2.5 1.5B Instruct | W4A16 | StackFlow | 15.06 | – | – | source ↗ accessed 2026-10-17 |
| Rockchip RK3588 Rockchip RK3588 (vendor reference board) | Qwen3-VL 2B | w8a8 | RKLLM v1.3.1 | 14.98 | – | 383.62 | source ↗ commit 2026-09-29 |
| Jetson Orin Nano Jetson Orin Nano (~7.4 GiB usable) | Vinci Piccolo 1.0 (Qwen3.5-4B based) | Q4_K_M | llama.cpp | 14.77 | – | – | source ↗ 2026-10-05 |
| Jetson Orin Nano Jetson Orin Nano 8GB (original mode) | Qwen2.5 7B | INT4 | MLC | 14.2 | – | – | source ↗ 2025-01-16 |
| Jetson Orin Nano Jetson Orin Nano 8GB (original mode) | Llama 3.1 8B | INT4 | MLC | 14 | – | – | source ↗ 2025-01-16 |
| Jetson Orin Nano Jetson Orin Nano (~7.4 GiB usable) | Vinci Piccolo 1.0 (Qwen3.5-4B based) | Q4_K_M | llama.cpp | 13.98 | – | – | source ↗ 2026-10-05 |
| Rockchip RK3588 Rockchip RK3588 (vendor reference board) | RWKV7 1.5B | w8a8 | RKLLM v1.3.1 | 13.82 | – | 634.34 | source ↗ commit 2026-09-29 |
| Raspberry Pi 5 cluster 4x Raspberry Pi 5 8GB | Llama 3.2 3B Instruct | Q40 | distributed-llama v0.12.3 | 13.68 | 27.74 | – | source ↗ 2025-02-15 |
| Rockchip RK3588 Rockchip RK3588 (vendor reference board) | Qwen3.5 2B | w8a8 | RKLLM v1.3.1 | 13.59 | – | 776.95 | source ↗ commit 2026-09-29 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | Spark-X2.5 1.7B | w4a16 | RKLLM v1.3.1 | 13.57 | – | 768.66 | source ↗ commit 2026-09-29 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | InternLM2 1.8B | w4a16 | RKLLM v1.3.1 | 13.55 | – | 765.92 | source ↗ commit 2026-09-29 |
| Jetson Orin Nano Jetson Orin Nano (~7.4 GiB usable) | Vinci Piccolo 1.0 (Qwen3.5-4B based) | Q4_K_M | llama.cpp | 13.41 | – | – | source ↗ 2026-10-05 |
| Jetson Orin NX 8GB Super Jetson Orin NX 8GB (Super mode) | Gemma 2 9B | INT4 | MLC | 13.38 | – | – | source ↗ 2025-01-16 |
| Jetson Orin Nano Super Jetson Orin Nano Super Dev Kit | Qwen2.5 0.5B | not reported | Ollama | 13.31 | – | – | source ↗ 2026-04-24 |
| M5Stack LLM8850 M5Stack LLM8850 M.2 card (AX8850) | DeepSeek-R1-Distill-Qwen 1.5B | W4A16 | StackFlow | 13.29 | – | – | source ↗ accessed 2026-10-17 |
| Jetson Orin NX 16GB Super Jetson Orin NX 16GB (Super mode) | Gemma 2 9B | INT4 | MLC | 13.26 | – | – | source ↗ 2025-01-16 |
| Jetson Orin Nano Jetson Orin Nano (~7.4 GiB usable) | Vinci Piccolo 1.0 (Qwen3.5-4B based) | Q4_K_M | llama.cpp | 13.19 | – | – | source ↗ 2026-10-05 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | Qwen3.5 0.8B | w8a8 | RKLLM v1.3.1 | 13.18 | – | 1342.54 | source ↗ commit 2026-09-29 |
| Jetson Orin Nano Super Jetson Orin Nano Super Dev Kit (CPU only) | Qwen2.5 0.5B | not reported | Ollama | 13.04 | – | – | source ↗ 2026-04-24 |
| M5Stack LLM8850 M5Stack LLM8850 M.2 card (AX8850) | Qwen3 0.6B | W8A16 | StackFlow | 12.88 | – | 670.51 | source ↗ accessed 2026-10-17 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | Qwen3-VL 2B | w4a16 | RKLLM v1.3.1 | 12.68 | – | 802.94 | source ↗ commit 2026-09-29 |
| M5Stack Module LLM M5Stack Module LLM / LLM630 (AX630C) | Qwen2.5 0.5B Instruct | W4A16 | StackFlow | 12.52 | – | 442.95 | source ↗ accessed 2026-10-17 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | TinyLlama 1.1B | w8a8 | RKLLM v1.3.1 | 12.18 | – | 534.13 | source ↗ commit 2026-09-29 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | Spark-X2.5 1.7B | w4a16_g128 | RKLLM v1.3.1 | 12.14 | – | 981.5 | source ↗ commit 2026-09-29 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | InternLM2 1.8B | w4a16_g128 | RKLLM v1.3.1 | 12.05 | – | 986.14 | source ↗ commit 2026-09-29 |
| Jetson Orin Nano Jetson Orin Nano (post says "Orin Nano 2") | Qwen3.5 9B | not stated | not stated | 12 | – | – | source ↗ 2026-08-25 |
| M5Stack AI Pyramid M5Stack AI Pyramid (AX8850) | Qwen3-VL 2B Instruct | W8A16 | StackFlow | 11.93 | – | 159.79 | source ↗ accessed 2026-10-17 |
| Raspberry Pi 5 Raspberry Pi 5 / CM5 | Qwen2.5 1.5B Instruct | Ollama default | Ollama | 11.73 | – | – | source ↗ 2026-01-20 |
| Raspberry Pi 5 Raspberry Pi 5 | Gemma 3 1B | Q4_K_M | Ollama | 11.53 | – | – | source ↗ accessed 2026-10-17 |
| Rockchip RK3588 Indiedroid Nova (RK3588S, 16GB) | DeepSeek-R1-Distill-Qwen 1.5B | RKLLM conversion | RKLLM runtime 1.2.1 | 11.5 | – | – | source ↗ repo 2026-01-12 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | Qwen3-VL 2B | w4a16_g128 | RKLLM v1.3.1 | 11.42 | – | 983.2 | source ↗ commit 2026-09-29 |
| Raspberry Pi 5 Raspberry Pi 5 / CM5 | Qwen2 1.5B | Ollama default | Ollama | 11.29 | – | – | source ↗ 2026-01-20 |
| Raspberry Pi 5 Raspberry Pi 5 | Llama 3.2 1B Instruct | Q4_K_M | Ollama | 11.22 | – | – | source ↗ accessed 2026-10-17 |
| Rockchip RK3588 Rockchip RK3588 (vendor reference board) | Gemma 4 E2B | w8a8 | RKLLM v1.3.1 | 11.12 | – | 599.06 | source ↗ commit 2026-09-29 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | Qwen3.5 2B | w4a16 | RKLLM v1.3.1 | 11.03 | – | 1661.01 | source ↗ commit 2026-09-29 |
| Jetson Orin Nano Super Jetson Orin Nano Super Dev Kit | Llama 3.2 1B | not reported | Ollama | 10.96 | – | – | source ↗ 2026-04-24 |
| Jetson Orin NX 16GB Jetson Orin NX 16GB (original mode) | Gemma 2 9B | INT4 | MLC | 10.56 | – | – | source ↗ 2025-01-16 |
| Rockchip RK3588 Rockchip RK3588 (vendor reference board) | Gemma 2 2B | w8a8 | RKLLM v1.3.1 | 10.37 | – | 598.41 | source ↗ commit 2026-09-29 |
| Raspberry Pi 5 cluster 2x Raspberry Pi 5 8GB | Llama 3.2 3B Instruct | Q40 | distributed-llama v0.12.3 | 10.33 | 23.63 | – | source ↗ 2025-02-15 |
| M5Stack Module LLM M5Stack Module LLM / LLM630 (AX630C) | Qwen2.5 0.5B Instruct | W8A16 | StackFlow | 10.32 | – | 359.8 | source ↗ accessed 2026-10-17 |
| M5Stack Module LLM M5Stack Module LLM / LLM630 (AX630C) | Qwen3 0.6B | W8A16 | StackFlow | 10.28 | – | 361.81 | source ↗ accessed 2026-10-17 |
| Raspberry Pi 5 Raspberry Pi 5 / CM5 | Qwen2.5-Coder 1.5B | Ollama default | Ollama | 10.26 | – | – | source ↗ 2026-01-20 |
| Rockchip RK3588 Rockchip RK3588 (vendor reference board) | TeleChat2 3B | w8a8 | RKLLM v1.3.1 | 10.18 | – | 618.48 | source ↗ commit 2026-09-29 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | RWKV7 1.5B | w4a16 | RKLLM v1.3.1 | 10.18 | – | 1572.09 | source ↗ commit 2026-09-29 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | Qwen3.5 2B | w4a16_g128 | RKLLM v1.3.1 | 10.1 | – | 1852.42 | source ↗ commit 2026-09-29 |
| Raspberry Pi 5 Raspberry Pi 5 | Qwen2.5 1.5B | Q4_K_M | Ollama | 9.97 | – | – | source ↗ accessed 2026-10-17 |
| Rockchip RK3588 Rockchip RK3588 (vendor reference board) | Gemma 3n 2B | w8a8 | RKLLM v1.3.1 | 9.91 | – | 1124.51 | source ↗ commit 2026-09-29 |
| M5Stack Module LLM M5Stack Module LLM / LLM630 (AX630C) | InternVL3 1B | W8A16 | StackFlow | 9.78 | – | 534.95 | source ↗ accessed 2026-10-17 |
| Jetson Orin Nano Super Jetson Orin Nano Super Dev Kit | DeepSeek-R1-Distill-Qwen 1.5B | not reported | Ollama | 9.59 | – | – | source ↗ 2026-04-24 |
| Jetson Orin Nano Super Jetson Orin Nano Super Dev Kit (CPU only) | Llama 3.2 1B | not reported | Ollama | 9.51 | – | – | source ↗ 2026-04-24 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | RWKV7 1.5B | w4a16_g128 | RKLLM v1.3.1 | 9.49 | – | 1733.08 | source ↗ commit 2026-09-29 |
| M5Stack AI Pyramid M5Stack AI Pyramid (AX8850) | Qwen2.5 3B Instruct | W4A16 | StackFlow | 9.46 | – | 550.3 | source ↗ accessed 2026-10-17 |
| Jetson Orin Nano Super Jetson Orin Nano Super Dev Kit | Qwen2.5 1.5B | not reported | Ollama | 9.37 | – | – | source ↗ 2026-04-24 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | Gemma 4 E2B | w4a16 | RKLLM v1.3.1 | 9.23 | – | 1219.25 | source ↗ commit 2026-09-29 |
| Jetson Orin Nano Super Jetson Orin Nano 8GB (Super mode) | Gemma 2 9B | INT4 | MLC | 9.2 | – | – | source ↗ 2025-01-16 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | Gemma 2 2B | w4a16 | RKLLM v1.3.1 | 9.14 | – | 997.92 | source ↗ commit 2026-09-29 |
| Jetson Orin Nano Super Jetson Orin Nano Super Dev Kit | Qwen2.5 1.5B Instruct | not reported | Ollama | 9.09 | – | – | source ↗ 2026-04-24 |
| Raspberry Pi 5 Raspberry Pi 5 / CM5 | DeepSeek-R1-Distill-Qwen 1.5B | Ollama default | Ollama | 9.04 | – | – | source ↗ 2026-01-20 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | TeleChat2 3B | w4a16 | RKLLM v1.3.1 | 8.97 | – | 1153.96 | source ↗ commit 2026-09-29 |
| Jetson Orin NX 8GB Jetson Orin NX 8GB (original mode) | Gemma 2 9B | INT4 | MLC | 8.8 | – | – | source ↗ 2025-01-16 |
| Raspberry Pi 5 + AI HAT+ 2 Raspberry Pi 5 + Hailo-10H | Llama 3.2 1B | Hailo-compiled | hailo-ollama | 8.7 | – | – | source ↗ published 2026 |
| Jetson Orin Nano Super Jetson Orin Nano Super Dev Kit | Qwen2.5-Coder 1.5B | not reported | Ollama | 8.66 | – | – | source ↗ 2026-04-24 |
| Rockchip RK3588 ODROID-M2 (RK3588S2, 16GB) | Qwen2.5 3B Instruct | RKLLM conversion | RKLLM | 8.45 | – | – | source ↗ 2026-01-21 |
| Raspberry Pi 5 Raspberry Pi 5 | Llama 3.2 1B | not reported | CPU backend (per paper) | 8.4 | – | 985 | source ↗ published 2026 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | Gemma 2 2B | w4a16_g128 | RKLLM v1.3.1 | 8.27 | – | 1312.15 | source ↗ commit 2026-09-29 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | Gemma 4 E2B | w4a16_g128 | RKLLM v1.3.1 | 8.27 | – | 1445.36 | source ↗ commit 2026-09-29 |
| Raspberry Pi 5 Raspberry Pi 5 | SmolLM2 1.7B Instruct | Q4_K_M | Ollama | 8.23 | – | – | source ↗ accessed 2026-10-17 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | TeleChat2 3B | w4a16_g128 | RKLLM v1.3.1 | 8.14 | – | 1408.37 | source ↗ commit 2026-09-29 |
| Raspberry Pi 5 Raspberry Pi 5 | BitNet b1.58 2B-4T | Q1.5 | Ollama | 8.13 | – | – | source ↗ accessed 2026-10-17 |
| Raspberry Pi 5 + AI HAT+ 2 Raspberry Pi 5 + AI HAT+ 2 | Qwen2.5-Coder 1.5B | Hailo-compiled | hailo-ollama | 8.06 | – | – | source ↗ 2026-01-20 |
| Raspberry Pi 5 + AI HAT+ 2 Raspberry Pi 5 8GB + AI HAT+ 2 | Qwen2 1.5B | Hailo-compiled | hailo-ollama | 8.03 | – | – | source ↗ tested 2026-01-25 |
| Raspberry Pi 5 + AI HAT+ 2 Raspberry Pi 5 8GB + AI HAT+ 2 | Qwen2.5-Coder 1.5B | Hailo-compiled | hailo-ollama | 7.94 | – | – | source ↗ tested 2026-01-25 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | Spark-X2.5 1.7B | w8a8 | RKLLM v1.3.1 | 7.89 | – | 803.94 | source ↗ commit 2026-09-29 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | InternLM2 1.8B | w8a8 | RKLLM v1.3.1 | 7.86 | – | 750.31 | source ↗ commit 2026-09-29 |
| Raspberry Pi 5 Raspberry Pi 5 | Qwen3 1.7B | not reported | CPU backend (per paper) | 7.8 | – | 1653 | source ↗ published 2026 |
| M5Stack LLM8850 M5Stack LLM8850 M.2 card (AX8850) | Qwen3-VL 2B Instruct | W8A16 | StackFlow | 7.8 | – | – | source ↗ accessed 2026-10-17 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | Gemma 3n 2B | w4a16 | RKLLM v1.3.1 | 7.78 | – | 3260.05 | source ↗ commit 2026-09-29 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | Qwen3-VL 2B | w8a8 | RKLLM v1.3.1 | 7.62 | – | 785.79 | source ↗ commit 2026-09-29 |
| Rockchip RK3588 Rockchip RK3588 (vendor reference board) | Phi-3 3.8B | w8a8 | RKLLM v1.3.1 | 7.45 | – | 1017.28 | source ↗ commit 2026-09-29 |
| M5Stack LLM8850 M5Stack LLM8850 M.2 card (AX8850) | Qwen3 1.7B | W8A16 | StackFlow | 7.38 | – | 796.38 | source ↗ accessed 2026-10-17 |
| Jetson Orin Nano Jetson Orin Nano 8GB (original mode) | Gemma 2 9B | INT4 | MLC | 7.2 | – | – | source ↗ 2025-01-16 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | RWKV7 1.5B | w8a8 | RKLLM v1.3.1 | 7.05 | – | 1534.47 | source ↗ commit 2026-09-29 |
| Raspberry Pi 5 + AI HAT+ 2 Hailo-10H (host not stated) | DeepSeek-R1-Distill-Qwen 1.5B | W4A8 | per M5Stack page | 7.05 | – | 660 | source ↗ accessed 2026-10-17 |
| Rockchip RK3588 Indiedroid Nova (RK3588S, 16GB) | Qwen2.5 3B Instruct | RKLLM conversion | RKLLM runtime 1.2.1 | 7 | – | – | source ↗ repo 2026-01-12 |
| Jetson Orin Nano Super Jetson Orin Nano Super Dev Kit (CPU only) | Qwen2.5 1.5B Instruct | not reported | Ollama | 6.9 | – | – | source ↗ 2026-04-24 |
| Raspberry Pi 5 + AI HAT+ 2 Raspberry Pi 5 8GB + AI HAT+ 2 | DeepSeek-R1-Distill-Qwen 1.5B | Hailo-compiled | hailo-ollama | 6.83 | – | – | source ↗ tested 2026-01-25 |
| Raspberry Pi 5 + AI HAT+ 2 Hailo-10H (host not stated) | Qwen2.5 1.5B Instruct | W4A8 | per M5Stack page | 6.82 | – | 370 | source ↗ accessed 2026-10-17 |
| Jetson Orin Nano Super Jetson Orin Nano Super Dev Kit (CPU only) | Qwen2.5-Coder 1.5B | not reported | Ollama | 6.76 | – | – | source ↗ 2026-04-24 |
| Raspberry Pi 5 + AI HAT+ 2 Raspberry Pi 5 8GB + AI HAT+ 2 | Qwen2.5 1.5B Instruct | Hailo-compiled | hailo-ollama | 6.76 | – | – | source ↗ tested 2026-01-25 |
| Raspberry Pi 5 + AI HAT+ 2 Raspberry Pi 5 + AI HAT+ 2 | Qwen2.5 1.5B Instruct | Hailo-compiled | hailo-ollama | 6.74 | – | – | source ↗ 2026-01-20 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | Qwen3.5 2B | w8a8 | RKLLM v1.3.1 | 6.73 | – | 1678.11 | source ↗ commit 2026-09-29 |
| Raspberry Pi 5 + AI HAT+ 2 Raspberry Pi 5 + AI HAT+ 2 | DeepSeek-R1-Distill-Qwen 1.5B | Hailo-compiled | hailo-ollama | 6.72 | – | – | source ↗ 2026-01-20 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | Phi-3 3.8B | w4a16 | RKLLM v1.3.1 | 6.58 | – | 1829.12 | source ↗ commit 2026-09-29 |
| Raspberry Pi 5 + AI HAT+ 2 Raspberry Pi 5 + AI HAT+ 2 | Qwen2.5 1.5B Instruct | not reported | hailo-ollama | 6.34 | – | – | source ↗ 2026-04-24 |
| Jetson Orin Nano Super Jetson Orin Nano Super Dev Kit | Llama 3.2 3B | not reported | Ollama | 6.31 | – | – | source ↗ 2026-04-24 |
| Rockchip RK3588 Rockchip RK3588 (vendor reference board) | Qwen3.5 4B | w8a8 | RKLLM v1.3.1 | 6.22 | – | 2068.88 | source ↗ commit 2026-09-29 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | Phi-3 3.8B | w4a16_g128 | RKLLM v1.3.1 | 6.06 | – | 2253.14 | source ↗ commit 2026-09-29 |
| Jetson Orin Nano Super Jetson Orin Nano Super Dev Kit (CPU only) | DeepSeek-R1-Distill-Qwen 1.5B | not reported | Ollama | 6.01 | – | – | source ↗ 2026-04-24 |
| Raspberry Pi 5 1x Raspberry Pi 5 8GB | Llama 3.2 3B Instruct | Q40 | distributed-llama v0.12.3 | 5.95 | 14.3 | – | source ↗ 2025-02-15 |
| Rockchip RK3588 Rockchip RK3588 (vendor reference board) | MiniCPM3 4B | w8a8 | RKLLM v1.3.1 | 5.94 | – | 1408.49 | source ↗ commit 2026-09-29 |
| Raspberry Pi 5 + AI HAT+ 2 Raspberry Pi 5 + AI HAT+ 2 | Qwen2 1.5B | Hailo-compiled | hailo-ollama | 5.89 | – | – | source ↗ 2026-01-20 |
| Raspberry Pi 5 Raspberry Pi 5 | Granite 3.1 Dense 2B | Q4_K_M | Ollama | 5.81 | – | – | source ↗ accessed 2026-10-17 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | Gemma 4 E2B | w8a8 | RKLLM v1.3.1 | 5.56 | – | 1166.94 | source ↗ commit 2026-09-29 |
| Arduino UNO Q Arduino UNO Q (4GB) | Gemma 3 1B | not reported | llama.cpp (App Lab) | 5.5 | 9.7 | – | source ↗ 2026-08-21 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | Gemma 2 2B | w8a8 | RKLLM v1.3.1 | 5.24 | – | 956.77 | source ↗ commit 2026-09-29 |
| Raspberry Pi 5 Raspberry Pi 5 | Qwen2.5 3B | Q4_K_M | Ollama | 5.2 | – | – | source ↗ accessed 2026-10-17 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | TeleChat2 3B | w8a8 | RKLLM v1.3.1 | 5.12 | – | 1029.04 | source ↗ commit 2026-09-29 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | Qwen3.5 4B | w4a16 | RKLLM v1.3.1 | 5.02 | – | 3976.41 | source ↗ commit 2026-09-29 |
| Rockchip RK3588 Rockchip RK3588 (vendor reference board) | ChatGLM3 6B | w8a8 | RKLLM v1.3.1 | 4.98 | – | 1352.94 | source ↗ commit 2026-09-29 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | Gemma 3n 2B | w8a8 | RKLLM v1.3.1 | 4.9 | – | 2995.26 | source ↗ commit 2026-09-29 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | MiniCPM3 4B | w4a16 | RKLLM v1.3.1 | 4.87 | – | 2536.68 | source ↗ commit 2026-09-29 |
| Raspberry Pi 5 Raspberry Pi 5 / CM5 | Llama 3.2 3B | Ollama default | Ollama | 4.78 | – | – | source ↗ 2026-01-20 |
| Raspberry Pi 5 Raspberry Pi 5 | Llama 3.2 3B | Q4_K_M | Ollama | 4.69 | – | – | source ↗ accessed 2026-10-17 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | ChatGLM3 6B | w4a16 | RKLLM v1.3.1 | 4.63 | – | 2166.69 | source ↗ commit 2026-09-29 |
| M5Stack Module LLM M5Stack Module LLM / LLM630 (AX630C) | Qwen2.5 1.5B Instruct | W4A16 | StackFlow | 4.63 | – | 1219.54 | source ↗ accessed 2026-10-17 |
| Raspberry Pi 5 Raspberry Pi 5 8GB | Llama 3.2 3B | Ollama default | Ollama | 4.61 | – | – | source ↗ 2025-01-09 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | Qwen3.5 4B | w4a16_g128 | RKLLM v1.3.1 | 4.6 | – | 4476.37 | source ↗ commit 2026-09-29 |
| Raspberry Pi 5 Raspberry Pi 5 16GB | Llama 3.2 3B | Ollama default | Ollama | 4.51 | – | – | source ↗ 2025-01-09 |
| M5Stack Module LLM M5Stack Module LLM / LLM630 (AX630C) | Llama 3.2 1B Instruct | W8A16 | StackFlow | 4.48 | – | 891 | source ↗ accessed 2026-10-17 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | MiniCPM3 4B | w4a16_g128 | RKLLM v1.3.1 | 4.46 | – | 3117.53 | source ↗ commit 2026-09-29 |
| Raspberry Pi 5 + AI HAT+ 2 Raspberry Pi 5 + AI HAT+ 2 | Qwen2.5 1.5B | not reported | hailo-ollama | 4.37 | – | – | source ↗ 2026-04-24 |
| Jetson Orin Nano Super Jetson Orin Nano Super Dev Kit (CPU only) | Llama 3.2 3B | not reported | Ollama | 4.3 | – | – | source ↗ 2026-04-24 |
| Jetson Orin Nano Super Jetson Orin Nano Super Dev Kit (CPU only) | Qwen2.5 1.5B | not reported | Ollama | 4.21 | – | – | source ↗ 2026-04-24 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | ChatGLM3 6B | w4a16_g128 | RKLLM v1.3.1 | 4.14 | – | 2966.85 | source ↗ commit 2026-09-29 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | Phi-3 3.8B | w8a8 | RKLLM v1.3.1 | 3.74 | – | 1615.97 | source ↗ commit 2026-09-29 |
| Rockchip RK3588 Indiedroid Nova (RK3588S, 16GB) | Llama 3.1 8B Instruct | w8a8 (RKLLM conversion) | RKLLM runtime 1.2.1 | 3.72 | – | – | source ↗ repo 2026-01-12 |
| M5Stack Module LLM M5Stack Module LLM / LLM630 (AX630C) | DeepSeek-R1-Distill-Qwen 1.5B | W8A16 | StackFlow | 3.57 | – | 1075.04 | source ↗ accessed 2026-10-17 |
| M5Stack Module LLM M5Stack Module LLM / LLM630 (AX630C) | Qwen2.5 1.5B Instruct | W8A16 | StackFlow | 3.57 | – | 3056.54 | source ↗ accessed 2026-10-17 |
| M5Stack Module LLM M5Stack Module LLM (AX630C) | Llama 3.2 1B | not reported | StackFlow | 3.44 | – | – | source ↗ 2026-04-24 |
| Raspberry Pi 5 Raspberry Pi 5 (~15 GiB usable) | Vinci Piccolo 1.0 (Qwen3.5-4B based) | Q4_K_M | llama.cpp | 3.21 | – | – | source ↗ 2026-10-05 |
| Raspberry Pi 5 Raspberry Pi 5 (~15 GiB usable) | Vinci Piccolo 1.0 (Qwen3.5-4B based) | Q4_K_M | llama.cpp | 3.19 | – | – | source ↗ 2026-10-05 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | Qwen3.5 4B | w8a8 | RKLLM v1.3.1 | 3.03 | – | 3906.19 | source ↗ commit 2026-09-29 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | MiniCPM3 4B | w8a8 | RKLLM v1.3.1 | 3.01 | – | 2539.92 | source ↗ commit 2026-09-29 |
| Raspberry Pi 5 Raspberry Pi 5 (~15 GiB usable) | Vinci Piccolo 1.0 (Qwen3.5-4B based) | Q4_K_M | llama.cpp | 3 | – | – | source ↗ 2026-10-05 |
| Raspberry Pi 5 Raspberry Pi 5 (~15 GiB usable) | Vinci Piccolo 1.0 (Qwen3.5-4B based) | Q4_K_M | llama.cpp | 2.95 | – | – | source ↗ 2026-10-05 |
| Raspberry Pi 5 + AI HAT+ 2 Raspberry Pi 5 8GB + AI HAT+ 2 | Llama 3.2 3B | Hailo-compiled | hailo-ollama | 2.65 | – | – | source ↗ tested 2026-01-25 |
| Raspberry Pi 5 + AI HAT+ 2 Raspberry Pi 5 + AI HAT+ 2 | Llama 3.2 3B | Hailo-compiled | hailo-ollama | 2.6 | – | – | source ↗ 2026-01-20 |
| M5Stack Module LLM M5Stack Module LLM (AX630C) | Qwen2.5 1.5B Instruct | not reported | StackFlow | 2.55 | – | – | source ↗ 2026-04-24 |
| Rockchip RK3576 Rockchip RK3576 (vendor reference board) | ChatGLM3 6B | w8a8 | RKLLM v1.3.1 | 2.48 | – | 1948.12 | source ↗ commit 2026-09-29 |
| M5Stack Module LLM M5Stack Module LLM (AX630C) | DeepSeek-R1-Distill-Qwen 1.5B | not reported | StackFlow | 2.42 | – | – | source ↗ 2026-04-24 |
| Raspberry Pi 5 + AI HAT+ 2 Raspberry Pi 5 + AI HAT+ 2 | Qwen2.5-Coder 1.5B | not reported | hailo-ollama | 2.07 | – | – | source ↗ 2026-04-24 |
| Raspberry Pi 5 Raspberry Pi 5 16GB | Llama 3.1 8B | Ollama default | Ollama | 2.05 | – | – | source ↗ 2025-01-09 |
| Raspberry Pi 5 Raspberry Pi 5 8GB | Llama 3.1 8B | Ollama default | Ollama | 1.99 | – | – | source ↗ 2025-01-09 |
| Raspberry Pi 5 Raspberry Pi 5 | Qwen2.5 0.5B Instruct | not reported | Ollama | 1.54 | – | 8210 | source ↗ accessed 2026-10-17 |
| Raspberry Pi 5 + AI HAT+ 2 Raspberry Pi 5 + AI HAT+ 2 | DeepSeek-R1-Distill-Qwen 1.5B | not reported | hailo-ollama | 1.53 | – | – | source ↗ 2026-04-24 |
| Raspberry Pi 5 Raspberry Pi 5 16GB | Llama 2 13B | Ollama default | Ollama | 1.35 | – | – | source ↗ 2025-01-09 |
| Raspberry Pi 5 + AI HAT+ 2 Raspberry Pi 5 + AI HAT+ 2 | Llama 3.2 3B | not reported | hailo-ollama | 1.01 | – | – | source ↗ 2026-04-24 |
| Raspberry Pi 5 Raspberry Pi 5 8GB | Qwen2.5 0.5B | not reported | Ollama | 0.86 | – | – | source ↗ 2026-04-24 |
| Raspberry Pi 5 Raspberry Pi 5 | Qwen3-VL 2B Instruct | not reported | Ollama | 0.42 | – | 24909 | source ↗ accessed 2026-10-17 |
| Raspberry Pi 5 Raspberry Pi 5 8GB | Llama 3.2 1B | not reported | Ollama | 0.39 | – | – | source ↗ 2026-04-24 |
| Raspberry Pi 5 Raspberry Pi 5 8GB | DeepSeek-R1-Distill-Qwen 1.5B | not reported | Ollama | 0.32 | – | – | source ↗ 2026-04-24 |
| Raspberry Pi 5 Raspberry Pi 5 8GB | Qwen2.5 1.5B Instruct | not reported | Ollama | 0.3 | – | – | source ↗ 2026-04-24 |
| Raspberry Pi 5 Raspberry Pi 5 8GB | Qwen2.5-Coder 1.5B | not reported | Ollama | 0.3 | – | – | source ↗ 2026-04-24 |
| Raspberry Pi 5 Raspberry Pi 5 8GB | Qwen2.5 1.5B | not reported | Ollama | 0.27 | – | – | source ↗ 2026-04-24 |
| Raspberry Pi 5 Raspberry Pi 5 8GB | Llama 3.2 3B | not reported | Ollama | 0.14 | – | – | source ↗ 2026-04-24 |