Community Benchmarks

Download oMLX →

Real performance numbers from oMLX users around the world. Submit yours from the app (v0.2.6+).

# Chip RAM Model Quant Ctx PP tok/s TG tok/s Date ↓
67471 M2 Ultra (76c) 192 GB Qwen3.5-0.8B 8bit 64k 3,908 84.5 26-03-09
67472 M4 (10c) 16 GB Qwen3.5-0.8B 4bit 1k 2,085 159.1 26-03-09
67473 M4 (10c) 32 GB Qwen3.5-9B 4bit 1k 223.0 21.0 26-03-09
67474 M4 (10c) 32 GB Qwen3.5-9B 4bit 4k 224.7 20.4 26-03-09
67475 M4 (10c) 16 GB Qwen3.5-4B 4bit 4k 405.0 36.5 26-03-09
67476 M2 Max (30c) 32 GB Qwen3.5-4B-OptiQ 4bit 4k 606.1 56.5 26-03-09
67477 M4 (10c) 16 GB Qwen3.5-4B 4bit 1k 406.6 38.7 26-03-09
67478 M2 Max (30c) 32 GB Qwen3.5-4B-OptiQ 4bit 1k 649.3 70.5 26-03-09
67479 M2 Ultra (76c) 192 GB Qwen3.5-0.8B 4bit 64k 3,882 87.8 26-03-09
67480 M4 (10c) 24 GB Qwen3.5-4B 4bit 64k 247.3 14.5 26-03-09
68,141 results · Page 6748 of 6815