Community Benchmarks

Download oMLX →

Real performance numbers from oMLX users around the world. Submit yours from the app (v0.2.6+).

# Chip RAM Model Quant Ctx PP tok/s TG tok/s Date ↓
5971 M4 (10c) 16 GB Qwen3.5-4B 4bit 4k 405.0 36.5 26-03-09
5972 M2 Max (30c) 32 GB Qwen3.5-4B-OptiQ 4bit 4k 606.1 56.5 26-03-09
5973 M4 (10c) 16 GB Qwen3.5-4B 4bit 1k 406.6 38.7 26-03-09
5974 M2 Max (30c) 32 GB Qwen3.5-4B-OptiQ 4bit 1k 649.3 70.5 26-03-09
5975 M2 Ultra (76c) 192 GB Qwen3.5-0.8B 4bit 64k 3,882 87.8 26-03-09
5976 M4 (10c) 24 GB Qwen3.5-4B 4bit 64k 247.3 14.5 26-03-09
5977 M4 (10c) 24 GB Qwen3.5-4B 4bit 1k 382.7 36.6 26-03-09
5978 M4 (10c) 24 GB Qwen3.5-4B 4bit 16k 340.3 27.7 26-03-09
5979 M4 (10c) 32 GB Qwen3.5-2B 8bit 4k 1,043 45.4 26-03-09
5980 M4 (10c) 32 GB Qwen3.5-2B 8bit 1k 1,014 46.9 26-03-09
6,652 results · Page 598 of 666