Community Benchmarks
Download oMLX →Real performance numbers from oMLX users around the world. Submit yours from the app (v0.2.6+).
| # | Chip | RAM | Model | Quant | Ctx | PP tok/s | TG tok/s | Date ↓ |
|---|---|---|---|---|---|---|---|---|
| 274511 | M1 Pro (14c) | 16 GB | Qwen3.5-9B | 4bit | 4k | 140.3 | 22.7 | 26-03-16 |
| 274512 | M1 Pro (14c) | 16 GB | Qwen3.5-9B | 4bit | 1k | 138.6 | 29.0 | 26-03-16 |
| 274513 | M1 Pro (14c) | 16 GB | Qwen3.5-9B | 4bit | 4k | 141.1 | 28.8 | 26-03-16 |
| 274514 | M4 Pro (20c) | 48 GB | qwen3.5-35b | 4bit | 8k | 691.2 | 70.3 | 26-03-16 |
| 274515 | M1 Pro (14c) | 16 GB | Qwen3.5-9B | 4bit | 1k | 140.4 | 30.0 | 26-03-16 |
| 274516 | M1 Max (24c) | 32 GB | Llama-3.2-1B-Instruct | 4bit | 4k | 2,052 | 152.2 | 26-03-16 |
| 274517 | M1 Max (24c) | 32 GB | Llama-3.2-1B-Instruct | 4bit | 1k | 1,771 | 217.1 | 26-03-16 |
| 274518 | M4 (10c) | 24 GB | Qwen3.5-27B | 4bit | 1k | 61.2 | 6.7 | 26-03-16 |
| 274519 | M4 Pro (20c) | 48 GB | qwen3.5-35b | 4bit | 8k | 635.7 | 69.1 | 26-03-16 |
| 274520 | M4 Pro (16c) | 64 GB | Qwen3-VL-30B-A3B-Instruct | 4bit | 1k | 667.2 | 68.6 | 26-03-16 |