Community Benchmarks
Download oMLX →Real performance numbers from oMLX users around the world. Submit yours from the app (v0.2.6+).
| # | Chip | RAM | Model | Quant | Ctx | PP tok/s | TG tok/s | Date ↓ |
|---|---|---|---|---|---|---|---|---|
| 294441 | M2 Max (38c) | 96 GB | Qwen3.5-27B-mxfp8 | 8bit | 4k | 119.1 | 11.7 | 26-03-11 |
| 294442 | M2 Max (38c) | 96 GB | Qwen3.5-27B-mxfp8 | 8bit | 1k | 118.1 | 11.9 | 26-03-11 |
| 294443 | M4 (10c) | 16 GB | Qwen3.5-9B | 4bit | 4k | 225.9 | 20.9 | 26-03-11 |
| 294444 | M4 (10c) | 16 GB | Qwen3.5-9B | 4bit | 1k | 225.6 | 21.6 | 26-03-11 |
| 294445 | M3 Pro (18c) | 36 GB | Qwen2.5-0.5B-Instruct | 4bit | 4k | 4,303 | 204.8 | 26-03-11 |
| 294446 | M3 Pro (18c) | 36 GB | Qwen2.5-0.5B-Instruct | 4bit | 1k | 3,106 | 251.0 | 26-03-11 |
| 294447 | M2 Pro (19c) | 32 GB | Qwen3.5-35B-A3B-5bit | 5bit | 1k | 357.0 | 51.3 | 26-03-11 |
| 294448 | M2 Pro (19c) | 32 GB | Qwen3.5-35B-A3B-5bit | 5bit | 4k | 368.4 | 44.1 | 26-03-11 |
| 294449 | M4 (10c) | 32 GB | LFM2-24B-A2B | 4bit | 4k | 607.8 | 61.1 | 26-03-11 |
| 294450 | M4 (10c) | 32 GB | LFM2-24B-A2B | 4bit | 1k | 592.7 | 63.7 | 26-03-11 |