Community Benchmarks
Download oMLX →Real performance numbers from oMLX users around the world. Submit yours from the app (v0.2.6+).
| # | Chip | RAM | Model | Quant | Ctx | PP tok/s | TG tok/s | Date ↓ |
|---|---|---|---|---|---|---|---|---|
| 154541 | M4 Max (40c) | 128 GB | Qwen3.6-27B | bf16 | 1k | 261.6 | 9.2 | 26-04-24 |
| 154542 | M1 Max (32c) | 64 GB | Qwen3.5-9B | 4bit | 4k | 187.2 | 52.7 | 26-04-24 |
| 154543 | M1 Max (32c) | 64 GB | Qwen3.5-9B | 4bit | 1k | 246.8 | 82.5 | 26-04-24 |
| 154544 | M3 (10c) | 24 GB | Qwen3-8B | 4bit | 4k | 177.6 | 15.1 | 26-04-24 |
| 154545 | M3 (10c) | 24 GB | Qwen3-8B | 4bit | 1k | 183.9 | 18.2 | 26-04-24 |
| 154546 | M4 Pro (16c) | 48 GB | Qwen3.5-9B | 4bit | 4k | 353.2 | 47.1 | 26-04-24 |
| 154547 | M4 Pro (16c) | 48 GB | Qwen3.5-9B | 4bit | 1k | 339.0 | 48.8 | 26-04-24 |
| 154548 | M3 Ultra (80c) | 256 GB | Qwen3.6-35B-A3B | bf16 | 32k | 2,230 | 55.4 | 26-04-24 |
| 154549 | M3 Ultra (80c) | 256 GB | Qwen3.6-35B-A3B | bf16 | 64k | 1,677 | 45.4 | 26-04-24 |
| 154550 | M5 (10c) | 32 GB | Qwen3.6-35B-A3B-UD-Q4_K_X... | 4bit | 4k | 981.2 | 39.0 | 26-04-24 |