Community Benchmarks
Download oMLX →Real performance numbers from oMLX users around the world. Submit yours from the app (v0.2.6+).
| # | Chip | RAM | Model | Quant | Ctx | PP tok/s | TG tok/s | Date ↓ |
|---|---|---|---|---|---|---|---|---|
| 5501 | M2 Ultra (76c) | 192 GB | Qwen3.5-0.8B | 8bit | 64k | 3,911 | 81.3 | 26-03-09 |
| 5502 | M1 Pro (16c) | 32 GB | Qwen3.5-4B9bit | 8bit | 4k | 283.0 | 31.5 | 26-03-09 |
| 5503 | M1 Pro (16c) | 32 GB | Qwen3.5-4B9bit | 8bit | 1k | 261.1 | 32.6 | 26-03-09 |
| 5504 | M4 (10c) | 32 GB | Qwen3.5-4B | 8bit | 4k | 388.5 | 18.4 | 26-03-09 |
| 5505 | M4 (10c) | 32 GB | Qwen3.5-4B | 8bit | 1k | 386.9 | 20.0 | 26-03-09 |
| 5506 | M2 Max (30c) | 64 GB | Qwen3.5-35B-A3B | 4bit | 1k | 561.5 | 74.4 | 26-03-09 |
| 5507 | M2 Max (30c) | 64 GB | Qwen3.5-35B-A3B | 4bit | 4k | 544.3 | 72.9 | 26-03-09 |
| 5508 | M4 (8c) | 16 GB | Qwen3.5-9B | 4bit | 4k | 168.1 | 19.7 | 26-03-09 |
| 5509 | M4 (8c) | 16 GB | Qwen3.5-9B | 4bit | 1k | 168.7 | 19.8 | 26-03-09 |
| 5510 | M4 (10c) | 32 GB | Qwen3-VL-4B-Instruct | 4bit | 4k | 371.4 | 28.9 | 26-03-09 |