Community Benchmarks
Download oMLX →Real performance numbers from oMLX users around the world. Submit yours from the app (v0.2.6+).
| # | Chip | RAM | Model | Quant | Ctx | PP tok/s | TG tok/s | Date ↓ |
|---|---|---|---|---|---|---|---|---|
| 40441 | M3 (10c) | 24 GB | Qwen3.5-9B | 4bit | 1k | 93.8 | 6.8 | 26-03-12 |
| 40442 | M3 Ultra (80c) | 256 GB | Qwen2.5-7B-Instruct | unknown | 1k | 1,148 | 47.6 | 26-03-12 |
| 40443 | M3 Ultra (80c) | 256 GB | Qwen2.5-7B-Instruct | unknown | 4k | 1,512 | 46.0 | 26-03-12 |
| 40444 | M4 (10c) | 16 GB | Qwen3.5-9B-OptiQ | 4bit | 4k | 193.2 | 12.2 | 26-03-12 |
| 40445 | M4 (10c) | 16 GB | Qwen3.5-9B-OptiQ | 4bit | 1k | 181.9 | 12.4 | 26-03-12 |
| 40446 | M4 (10c) | 16 GB | Qwen3.5-2B | 6bit | 1k | 678.8 | 50.3 | 26-03-12 |
| 40447 | M4 (10c) | 16 GB | Qwen3.5-2B | 6bit | 4k | 698.9 | 48.6 | 26-03-12 |
| 40448 | M4 Pro (20c) | 64 GB | HY-MT1.5-1.8B | 8bit | 64k | 521.4 | 1.7 | 26-03-12 |
| 40449 | M4 Pro (20c) | 64 GB | HY-MT1.5-1.8B | 8bit | 32k | 844.2 | 42.3 | 26-03-12 |
| 40450 | M4 Pro (20c) | 64 GB | HY-MT1.5-1.8B | 8bit | 16k | 1,179 | 60.9 | 26-03-12 |