Community Benchmarks
Download oMLX →Real performance numbers from oMLX users around the world. Submit yours from the app (v0.2.6+).
| # | Chip | RAM | Model | Quant | Ctx | PP tok/s | TG tok/s | Date ↓ |
|---|---|---|---|---|---|---|---|---|
| 161201 | M3 Max (30c) | 36 GB | Qwen3.5-9B | 4bit | 64k | 310.3 | 14.6 | 26-04-24 |
| 161202 | M3 Max (30c) | 36 GB | Qwen3.5-9B | 4bit | 32k | 467.7 | 37.0 | 26-04-24 |
| 161203 | M3 Max (30c) | 36 GB | Qwen3.5-9B | 4bit | 16k | 499.6 | 45.4 | 26-04-24 |
| 161204 | M3 Max (30c) | 36 GB | Qwen3.5-9B | 4bit | 8k | 563.5 | 49.5 | 26-04-24 |
| 161205 | M3 Max (30c) | 36 GB | Qwen3.5-9B | 4bit | 1k | 523.7 | 54.1 | 26-04-24 |
| 161206 | M3 Ultra (60c) | 96 GB | Qwen3.6-27B-oQ4 | 4bit | 4k | 321.2 | 34.7 | 26-04-24 |
| 161207 | M3 Ultra (60c) | 96 GB | Qwen3.6-27B-oQ4 | 4bit | 1k | 303.9 | 36.3 | 26-04-24 |
| 161208 | M1 Ultra (64c) | 64 GB | Qwen3.6-35B-A3BVLM-oQ4 | 4bit | 128k | 512.3 | 16.4 | 26-04-24 |
| 161209 | M1 Ultra (64c) | 64 GB | Qwen3.6-35B-A3BVLM-oQ4 | 4bit | 195k | 350.5 | 11.7 | 26-04-24 |
| 161210 | M1 Ultra (64c) | 64 GB | Qwen3.6-35B-A3BVLM-oQ4 | 4bit | 64k | 946.8 | 27.8 | 26-04-24 |