Community Benchmarks
Download oMLX →Real performance numbers from oMLX users around the world. Submit yours from the app (v0.2.6+).
| # | Chip | RAM | Model | Quant | Ctx | PP tok/s | TG tok/s | Date ↓ |
|---|---|---|---|---|---|---|---|---|
| 280341 | M4 Pro (20c) | 48 GB | Qwen3.5-9B | 4bit | 1k | 280.8 | 34.6 | 26-03-10 |
| 280342 | M3 Ultra (80c) | 512 GB | Qwen3.5-397B-A17B | 6bit | 64k | 356.8 | 13.0 | 26-03-10 |
| 280343 | M3 Ultra (80c) | 512 GB | Qwen3.5-397B-A17B | 6bit | 32k | 431.7 | 21.2 | 26-03-10 |
| 280344 | M3 Ultra (80c) | 512 GB | Qwen3.5-397B-A17B | 6bit | 16k | 471.0 | 24.5 | 26-03-10 |
| 280345 | M3 Ultra (80c) | 512 GB | Qwen3.5-397B-A17B | 6bit | 8k | 491.1 | 27.0 | 26-03-10 |
| 280346 | M3 Ultra (80c) | 512 GB | Qwen3.5-397B-A17B | 6bit | 4k | 492.2 | 28.3 | 26-03-10 |
| 280347 | M3 Ultra (80c) | 512 GB | Qwen3.5-397B-A17B | 6bit | 1k | 443.4 | 29.2 | 26-03-10 |
| 280348 | M4 (10c) | 16 GB | Qwen3.5-4B-OptiQ | 4bit | 4k | 209.0 | 19.4 | 26-03-10 |
| 280349 | M4 (10c) | 16 GB | Qwen3.5-4B-OptiQ | 4bit | 8k | 201.8 | 17.7 | 26-03-10 |
| 280350 | M4 (10c) | 16 GB | Qwen3.5-4B-OptiQ | 4bit | 16k | 191.7 | 13.5 | 26-03-10 |