M5Stack AI Pyramid / Qwen2.5 3B
Can a M5Stack AI Pyramid run Qwen2.5 3B?
Yes, usable but slower than reading speed. Measured generation speed: 9.46 tok/s across 1 public run.
Rule of thumb: 10+ tok/s feels like a chat; 4–10 is usable for assistants and automations; under 4 is batch-job territory. Speeds depend on quantization, runtime, context length and cooling. Check each source.
| Board | Quant | Runtime | Gen tok/s | Prompt tok/s | TTFT ms | Source |
|---|---|---|---|---|---|---|
| M5Stack AI Pyramid M5Stack AI Pyramid (AX8850) | W4A16 | StackFlow | 9.46 | – | 550.3 | source ↗ accessed 2026-10-17 |
Qwen2.5 3B on other boards
- Rockchip RK3588 8.45 tok/s best
- Raspberry Pi 5 5.2 tok/s best
Buy a M5Stack AI Pyramid
- M5Stack AI Pyramid (AX8850): price not verified yet Check price (affiliate slot)
Ran Qwen2.5 3B on a M5Stack AI Pyramid? Submit your numbers →