Community Benchmarks
Download oMLX →Real performance numbers from oMLX users around the world. Submit yours from the app (v0.2.6+).
| # | Chip | RAM | Model | Quant | Ctx | PP tok/s | TG tok/s | Date ↓ |
|---|---|---|---|---|---|---|---|---|
| 41 | M3 Ultra (60c) | 256 GB | Ornith-1.0-35BoQ8 | 8bit | 32k | 1,629 | 71.2 | 26-07-22 |
| 42 | M3 Ultra (60c) | 256 GB | Ornith-1.0-35BoQ8 | 8bit | 64k | 1,227 | 60.5 | 26-07-22 |
| 43 | M3 Ultra (60c) | 256 GB | Ornith-1.0-35BoQ8 | 8bit | 1k | 2,144 | 83.9 | 26-07-22 |
| 44 | M3 Ultra (60c) | 256 GB | Ornith-1.0-35BoQ8 | 8bit | 4k | 2,113 | 82.3 | 26-07-22 |
| 45 | M3 Ultra (60c) | 256 GB | Ornith-1.0-35BoQ8 | 8bit | 8k | 2,167 | 80.6 | 26-07-22 |
| 46 | M5 Max (40c) | 128 GB | local--Laguna-S-2.1oQ4e-g... | 4bit | 64k | 722.4 | 39.8 | 26-07-22 |
| 47 | M5 Max (40c) | 128 GB | local--Laguna-S-2.1oQ4e-g... | 4bit | 32k | 812.1 | 48.0 | 26-07-22 |
| 48 | M5 Max (40c) | 128 GB | local--Laguna-S-2.1oQ4e-g... | 4bit | 16k | 865.4 | 53.5 | 26-07-22 |
| 49 | M5 Max (40c) | 128 GB | local--Laguna-S-2.1oQ4e-g... | 4bit | 8k | 946.9 | 55.7 | 26-07-22 |
| 50 | M5 Max (40c) | 128 GB | local--Laguna-S-2.1oQ4e-g... | 4bit | 4k | 1,076 | 56.6 | 26-07-22 |