Community Benchmarks
Download oMLX →Real performance numbers from oMLX users around the world. Submit yours from the app (v0.2.6+).
| # | Chip | RAM | Model | Quant | Ctx | PP tok/s | TG tok/s | Date ↓ |
|---|---|---|---|---|---|---|---|---|
| 63841 | M4 (10c) | 32 GB | Qwen2.5-VL-7B-Instruct | 8bit | 4k | 217.1 | 11.7 | 26-03-09 |
| 63842 | M4 (10c) | 32 GB | Qwen2.5-VL-7B-Instruct | 8bit | 1k | 236.8 | 12.2 | 26-03-09 |
| 63843 | M4 Pro (20c) | 24 GB | Qwen3.5-9B | 4bit | 4k | 451.1 | 48.2 | 26-03-09 |
| 63844 | M4 Pro (20c) | 24 GB | Qwen3.5-9B | 4bit | 1k | 445.8 | 50.2 | 26-03-09 |
| 63845 | M4 (8c) | 16 GB | Qwen3.5-9B | 4bit | 4k | 168.7 | 20.5 | 26-03-09 |
| 63846 | M4 (8c) | 16 GB | Qwen3.5-9B | 4bit | 1k | 170.4 | 21.6 | 26-03-09 |
| 63847 | M3 Ultra (60c) | 256 GB | Qwen3.5-35B-A3B | 4bit | 32k | 1,678 | 68.5 | 26-03-09 |
| 63848 | M3 Ultra (60c) | 256 GB | Qwen3.5-35B-A3B | 4bit | 64k | 1,294 | 52.3 | 26-03-09 |
| 63849 | M3 Ultra (60c) | 256 GB | Qwen3.5-35B-A3B | 4bit | 8k | 2,101 | 87.3 | 26-03-09 |
| 63850 | M3 Ultra (60c) | 256 GB | Qwen3.5-35B-A3B | 4bit | 16k | 1,941 | 79.8 | 26-03-09 |