Community Benchmarks
Download oMLX →Real performance numbers from oMLX users around the world. Submit yours from the app (v0.2.6+).
Reset filters| # | Chip | RAM | Model | Quant | Ctx | PP tok/s | TG tok/s | Date ↓ |
|---|---|---|---|---|---|---|---|---|
| 31 | M2 Max (38c) | 96 GB | North-Mini-Code-1.0 | 4bit | 4k | 694.4 | 55.3 | 26-06-29 |
| 32 | M2 Max (38c) | 96 GB | North-Mini-Code-1.0 | 4bit | 1k | 646.4 | 63.5 | 26-06-29 |
| 33 | M2 Max (38c) | 64 GB | North-Mini-Code-1.0 | 6bit | 4k | 644.2 | 51.3 | 26-06-29 |
| 34 | M2 Max (38c) | 64 GB | North-Mini-Code-1.0 | 6bit | 16k | 502.3 | 44.7 | 26-06-29 |
| 35 | M4 Max (40c) | 128 GB | North-Mini-Code-1.0 | bf16 | 8k | 1,277 | 55.9 | 26-06-28 |
| 36 | M4 Max (40c) | 128 GB | North-Mini-Code-1.0 | bf16 | 16k | 1,108 | 53.0 | 26-06-28 |
| 37 | M4 Max (40c) | 128 GB | North-Mini-Code-1.0 | bf16 | 1k | 1,224 | 61.4 | 26-06-28 |
| 38 | M4 Max (40c) | 128 GB | North-Mini-Code-1.0 | bf16 | 4k | 1,535 | 56.7 | 26-06-28 |
| 39 | M5 Max (40c) | 128 GB | North-Mini-Code-1.0 | unknown | 195k | 887.7 | 26.4 | 26-06-27 |
| 40 | M5 Max (40c) | 128 GB | North-Mini-Code-1.0 | unknown | 16k | 3,013 | 62.7 | 26-06-27 |