Community Benchmarks
Download oMLX →Real performance numbers from oMLX users around the world. Submit yours from the app (v0.2.6+).
| # | Chip | RAM | Model | Quant | Ctx | PP tok/s | TG tok/s | Date ↓ |
|---|---|---|---|---|---|---|---|---|
| 161241 | M1 Ultra (64c) | 64 GB | Qwen3.6-35B-A3BVLM-oQ8 | 8bit | 1k | 1,516 | 267.8 | 26-04-24 |
| 161242 | M4 Pro (16c) | 48 GB | Qwen3.6-27B | 8bit | 1k | 99.0 | 8.6 | 26-04-24 |
| 161243 | M1 Max (24c) | 32 GB | Qwen3.6-27BoQ4 | 4bit | 32k | 104.6 | 9.5 | 26-04-24 |
| 161244 | M1 Max (24c) | 32 GB | Qwen3.6-27BoQ4 | 4bit | 8k | 112.6 | 17.1 | 26-04-24 |
| 161245 | M1 Max (24c) | 32 GB | Qwen3.6-27BoQ4 | 4bit | 1k | 110.7 | 18.8 | 26-04-24 |
| 161246 | M4 Pro (20c) | 48 GB | Qwen3.6-35B-A3B | 4bit | 128k | 329.3 | 17.6 | 26-04-24 |
| 161247 | M3 Max (40c) | 128 GB | Qwen3.6-27B | bf16 | 1k | 210.3 | 41.4 | 26-04-24 |
| 161248 | M3 Max (40c) | 128 GB | Qwen3.6-27B | bf16 | 4k | 194.7 | 7.1 | 26-04-24 |
| 161249 | M5 Pro (20c) | 64 GB | Qwen3.6-27B-UD | 6bit | 4k | 438.4 | 9.6 | 26-04-24 |
| 161250 | M5 Pro (20c) | 64 GB | Qwen3.6-27B-UD | 6bit | 1k | 402.0 | 9.8 | 26-04-24 |