Community Benchmarks

Download oMLX →

Real performance numbers from oMLX users around the world. Submit yours from the app (v0.2.6+).

# Chip RAM Model Quant Ctx PP tok/s TG tok/s Date ↓
42011 M4 (10c) 16 GB Qwen3.5-4B 4bit 4k 405.0 36.5 26-03-09
42012 M2 Max (30c) 32 GB Qwen3.5-4B-OptiQ 4bit 4k 606.1 56.5 26-03-09
42013 M4 (10c) 16 GB Qwen3.5-4B 4bit 1k 406.6 38.7 26-03-09
42014 M2 Max (30c) 32 GB Qwen3.5-4B-OptiQ 4bit 1k 649.3 70.5 26-03-09
42015 M2 Ultra (76c) 192 GB Qwen3.5-0.8B 4bit 64k 3,882 87.8 26-03-09
42016 M4 (10c) 24 GB Qwen3.5-4B 4bit 64k 247.3 14.5 26-03-09
42017 M4 (10c) 24 GB Qwen3.5-4B 4bit 1k 382.7 36.6 26-03-09
42018 M4 (10c) 24 GB Qwen3.5-4B 4bit 16k 340.3 27.7 26-03-09
42019 M4 (10c) 32 GB Qwen3.5-2B 8bit 4k 1,043 45.4 26-03-09
42020 M4 (10c) 32 GB Qwen3.5-2B 8bit 1k 1,014 46.9 26-03-09
42,677 results · Page 4202 of 4268