Community Benchmarks

Download oMLX →

Real performance numbers from oMLX users around the world. Submit yours from the app (v0.2.6+).

# Chip RAM Model Quant Ctx PP tok/s TG tok/s Date ↓
1701 M2 Ultra (60c) 64 GB Qwen3.5-35B-A3B 8bit 16k 1,068 54.5 26-03-09
1702 M2 Ultra (60c) 64 GB Qwen3.5-35B-A3B 8bit 8k 1,120 60.2 26-03-09
1703 M2 Ultra (60c) 64 GB Qwen3.5-35B-A3B 8bit 4k 1,123 64.8 26-03-09
1704 M2 Ultra (60c) 64 GB Qwen3.5-35B-A3B 8bit 1k 1,025 67.3 26-03-09
1705 M4 (10c) 24 GB Qwen3.5-9B 4bit 1k 223.3 21.1 26-03-09
1706 M4 (10c) 16 GB Qwen3.5-9B 4bit 4k 225.0 20.1 26-03-09
1707 M4 (10c) 16 GB Qwen3.5-9B 4bit 1k 224.5 21.1 26-03-09
1708 M4 (10c) 16 GB Qwen3.5-4B 4bit 1k 357.9 34.5 26-03-09
1709 M4 (10c) 16 GB Qwen3.5-0.8B 8bit 1k 1,855 87.0 26-03-09
1710 M3 Ultra (80c) 512 GB Huihui-Qwen3.5-35B-A3B-ab... 4bit 64k 1,136 38.1 26-03-09
2,234 results · Page 171 of 224