Community Benchmarks
Download oMLX →Real performance numbers from oMLX users around the world. Submit yours from the app (v0.2.6+).
| # | Chip | RAM | Model | Quant | Ctx | PP tok/s | TG tok/s | Date ↓ |
|---|---|---|---|---|---|---|---|---|
| 328601 | M3 Max (30c) | 96 GB | Qwen3.5-35B-A3B | 4bit | 1k | 889.1 | 69.1 | 26-03-10 |
| 328602 | M3 Max (30c) | 96 GB | Qwen3.5-35B-A3B | 4bit | 4k | 918.6 | 72.8 | 26-03-10 |
| 328603 | M3 (10c) | 24 GB | Qwen3.5-9B | 8bit | 4k | 182.4 | 9.9 | 26-03-10 |
| 328604 | M3 (10c) | 24 GB | Qwen3.5-9B | 8bit | 1k | 180.4 | 10.0 | 26-03-10 |
| 328605 | M4 (10c) | 24 GB | Llama-3.2-1B-Instruct | 4bit | 64k | 193.9 | 9.5 | 26-03-10 |
| 328606 | M4 (10c) | 24 GB | Llama-3.2-1B-Instruct | 4bit | 32k | 476.1 | 19.8 | 26-03-10 |
| 328607 | M4 (10c) | 24 GB | Llama-3.2-1B-Instruct | 4bit | 16k | 811.1 | 53.3 | 26-03-10 |
| 328608 | M4 (10c) | 24 GB | Llama-3.2-1B-Instruct | 4bit | 8k | 1,013 | 55.5 | 26-03-10 |
| 328609 | M4 (10c) | 24 GB | Llama-3.2-1B-Instruct | 4bit | 4k | 1,090 | 70.5 | 26-03-10 |
| 328610 | M4 (10c) | 24 GB | Llama-3.2-1B-Instruct | 4bit | 1k | 1,135 | 97.6 | 26-03-10 |