Hermes
2 MLX aliases · Nous Research's instruct line — Hermes 3 8B + Hermes 4 70B.
Pick one
One command per line of this family, smallest download first. Your Mac needs the download size in free memory plus room for macOS and the context window; the hardware tiers page has the engine's picks for every RAM size. The first run downloads the weights and starts an OpenAI-compatible server on http://localhost:8000/v1.
rapid-mlx serve hermes3-8b-4bit
Nous Research's Hermes line — heavily-tuned instruct models built for tool-calling and agent workflows. The hermes tool envelope is named after this family; Hermes 4 70B is the largest Apache-2 dense model in the registry.
- family
- Hermes
- aliases
- 2
- lines
- 1
- install
- rapid-mlx serve <alias>
- OpenAI base URL
- http://localhost:8000/v1
Download
Every alias on this page downloads with one command — the pull buttons in the tables below copy it. All 2 aliases on this page are mirrored on the rapid-mlx CDN — with automatic mid-pull fallback to Hugging Face if a mirror file slows down. Weights land in the standard Hugging Face cache, and rapid-mlx serve pulls automatically on first use. Live mirror status →
Hermes 3 / Hermes 4 · 2 aliases
Hermes 3 8B for 16 GB Macs; Hermes 4 70B for 128 GB+ Mac Studio. The hermes tool envelope is named after this family.
parser: hermes
| alias | hf repo | tool parser | reasoning | flags | context | AA index | get it |
|---|---|---|---|---|---|---|---|
| hermes3-8b-4bit | mlx-community/Hermes-3-Llama-3.1-8B-4bit | hermes | — | spec | 128K | — | CDN |
| hermes4-70b-4bit | lmstudio-community/Hermes-4-70B-MLX-4bit | hermes | glm4 | spec | 128K | 9.9 | CDN |
Notes & caveats
- Hermes 4 70B is the recommended pick for a 128 GB+ Mac Studio.
- Hermes 3 8B is a strong, agent-friendly small model on 16 GB Macs.
Context is read from the config.json of the exact build each alias pulls. AA index is the Artificial Analysis Intelligence Index for the base model at full precision with reasoning on — a property of the model, not a score for our quantised build.