Community Benchmarks
Download oMLX →Real performance numbers from oMLX users around the world. Submit yours from the app (v0.2.6+).
| # | Chip | RAM | Model | Quant | Ctx | PP tok/s | TG tok/s | Date ↓ |
|---|---|---|---|---|---|---|---|---|
| 336631 | M4 (10c) | 16 GB | LFM2-8B-A1B-6bit | 6bit | 4k | 796.6 | 61.1 | 26-03-12 |
| 336632 | M4 (10c) | 16 GB | LFM2-8B-A1B-6bit | 6bit | 1k | 806.5 | 64.0 | 26-03-12 |
| 336633 | M2 Ultra (60c) | 64 GB | Qwen3.5-35B-A3B | 4bit | 4k | 1,142 | 73.4 | 26-03-12 |
| 336634 | M2 Ultra (60c) | 64 GB | Qwen3.5-35B-A3B | 4bit | 1k | 1,025 | 77.4 | 26-03-12 |
| 336635 | M4 (10c) | 16 GB | Meta-Llama-3.1-8B-Instruc... | 4bit | 1k | 238.2 | 22.4 | 26-03-12 |
| 336636 | M4 (10c) | 16 GB | Meta-Llama-3.1-8B-Instruc... | 4bit | 4k | 226.8 | 20.0 | 26-03-12 |
| 336637 | M2 Ultra (60c) | 64 GB | Qwen3.5-35B-A3B | 8bit | 4k | 1,049 | 61.5 | 26-03-12 |
| 336638 | M2 Ultra (60c) | 64 GB | Qwen3.5-35B-A3B | 8bit | 1k | 958.5 | 63.0 | 26-03-12 |
| 336639 | M4 (10c) | 16 GB | Qwen3.5-4B | 4bit | 1k | 388.4 | 36.6 | 26-03-12 |
| 336640 | M4 (10c) | 32 GB | Qwen3.5-35B-A3B-5bit | 5bit | 4k | 431.2 | 34.6 | 26-03-12 |