Community Benchmarks
Download oMLX →Real performance numbers from oMLX users around the world. Submit yours from the app (v0.2.6+).
| # | Chip | RAM | Model | Quant | Ctx | PP tok/s | TG tok/s | Date ↓ |
|---|---|---|---|---|---|---|---|---|
| 161251 | M5 Max (40c) | 128 GB | Qwen3.6-35B-A3B-oQ6 | 6bit | 4k | 2,239 | 97.5 | 26-04-24 |
| 161252 | M5 Max (40c) | 128 GB | Qwen3.6-35B-A3B-oQ6 | 6bit | 8k | 2,696 | 98.0 | 26-04-24 |
| 161253 | M5 Max (40c) | 128 GB | Qwen3.6-35B-A3B-oQ6 | 6bit | 1k | 1,960 | 98.1 | 26-04-24 |
| 161254 | M2 (10c) | 16 GB | Llama-3.1-8B-Instruct | 4bit | 4k | 184.5 | 17.9 | 26-04-24 |
| 161255 | M3 Ultra (80c) | 256 GB | Qwen3.6-27B | 8bit | 4k | 419.2 | 20.2 | 26-04-24 |
| 161256 | M3 Ultra (80c) | 256 GB | Qwen3.6-27B | 8bit | 1k | 383.6 | 20.6 | 26-04-24 |
| 161257 | M2 (10c) | 16 GB | Llama-3.1-8B-Instruct | 4bit | 1k | 188.3 | 20.0 | 26-04-24 |
| 161258 | M5 Max (40c) | 128 GB | Qwen3.6-35B-A3B | 8bit | 1k | 1,641 | 96.0 | 26-04-24 |
| 161259 | M5 Max (40c) | 128 GB | Qwen3.6-35B-A3B | 8bit | 4k | 3,273 | 93.6 | 26-04-24 |
| 161260 | M5 Max (40c) | 128 GB | Qwen3.6-35B-A3B-oQ6 | 6bit | 64k | 1,752 | 56.6 | 26-04-24 |