Community Benchmarks

Download oMLX →

Real performance numbers from oMLX users around the world. Submit yours from the app (v0.2.6+).

# Chip RAM Model Quant Ctx PP tok/s TG tok/s Date ↓
88051 M2 Ultra (60c) 64 GB Qwen3.5-35B-A3B 8bit 8k 1,120 60.2 26-03-09
88052 M2 Ultra (60c) 64 GB Qwen3.5-35B-A3B 8bit 4k 1,123 64.8 26-03-09
88053 M2 Ultra (60c) 64 GB Qwen3.5-35B-A3B 8bit 1k 1,025 67.3 26-03-09
88054 M4 (10c) 16 GB Qwen3.5-9B 4bit 4k 225.0 20.1 26-03-09
88055 M4 (10c) 16 GB Qwen3.5-9B 4bit 1k 224.5 21.1 26-03-09
88056 M4 (10c) 16 GB Qwen3.5-4B 4bit 1k 357.9 34.5 26-03-09
88057 M4 (10c) 16 GB Qwen3.5-0.8B 8bit 1k 1,855 87.0 26-03-09
88058 M3 Ultra (80c) 512 GB Huihui-Qwen3.5-35B-A3B-ab... 4bit 64k 1,136 38.1 26-03-09
88059 M3 Ultra (80c) 512 GB Huihui-Qwen3.5-35B-A3B-ab... 4bit 32k 1,650 53.0 26-03-09
88060 M3 Ultra (80c) 512 GB Huihui-Qwen3.5-35B-A3B-ab... 4bit 16k 1,961 64.3 26-03-09
88,568 results · Page 8806 of 8857