Community Benchmarks
Download oMLX →Real performance numbers from oMLX users around the world. Submit yours from the app (v0.2.6+).
| # | Chip | RAM | Model | Quant | Ctx | PP tok/s | TG tok/s | Date ↓ |
|---|---|---|---|---|---|---|---|---|
| 1 | M4 Pro (20c) | 48 GB | Bonsai-27B1bit | unknown | 16k | 107.4 | 23.2 | 26-07-21 |
| 2 | M4 Pro (20c) | 48 GB | Bonsai-27B1bit | unknown | 4k | 112.8 | 26.3 | 26-07-21 |
| 3 | M5 Pro (20c) | 64 GB | gemma-4-26b-a4b-it | 4bit | 128k | 884.1 | 23.0 | 26-07-21 |
| 4 | M5 Pro (20c) | 64 GB | gemma-4-26b-a4b-it | 4bit | 195k | 619.2 | 17.2 | 26-07-21 |
| 5 | M5 Pro (20c) | 64 GB | gemma-4-26b-a4b-it | 4bit | 64k | 1,339 | 37.5 | 26-07-21 |
| 6 | M5 Pro (20c) | 64 GB | gemma-4-26b-a4b-it | 4bit | 32k | 1,806 | 51.2 | 26-07-21 |
| 7 | M5 Pro (20c) | 64 GB | gemma-4-26b-a4b-it | 4bit | 8k | 2,149 | 69.8 | 26-07-21 |
| 8 | M5 Pro (20c) | 64 GB | gemma-4-26b-a4b-it | 4bit | 16k | 2,044 | 62.3 | 26-07-21 |
| 9 | M5 Pro (20c) | 64 GB | gemma-4-26b-a4b-it | 4bit | 4k | 2,218 | 74.9 | 26-07-21 |
| 10 | M5 Pro (20c) | 64 GB | gemma-4-26b-a4b-it | 4bit | 1k | 2,276 | 78.4 | 26-07-21 |