Prerequisites
Install Hermes
- Linux / macOS / WSL2
- Windows (PowerShell)
One-liner:Reload your shell:
Configure FortAPI
Launch the provider wizard:Pick 'Custom endpoint'
The wizard lists every built-in provider (Nous Portal / OpenRouter / Anthropic / OpenAI / …). Scroll to the bottom and select Custom endpoint (self-hosted / VLLM / etc.).
Choose a model
Common picks:
gpt-5(OpenAI-family)claude-sonnet(callable via the OpenAI-compatible protocol on FortAPI)deepseek-chat,kimi-k2.5,glm-5, etc.
~/.hermes/config.yaml:
First call
Start the CLI:Switch models
Inside a session, run/model with any model name from the pricing page on the main site:
hermes model to change the default.
Wire up Telegram / Discord / etc.
Once the model is configured, set up the gateway:Troubleshooting
404 / model not found
404 / model not found
- That model ID isn’t on FortAPI — check the Pricing page.
base_urlmust end in/v1.
Why not use Hermes's built-in 'Anthropic' provider?
Why not use Hermes's built-in 'Anthropic' provider?
Hermes’s built-in Anthropic flow is built around Claude Max OAuth — overriding the base URL for third-party gateways isn’t reliable. Custom endpoint (OpenAI-compatible) is the cleanest path on FortAPI, and Claude models work over it too.
Run Nous Portal + FortAPI side by side
Run Nous Portal + FortAPI side by side
Hermes supports multiple providers. Run
hermes model again to add another, and use /model mid-session to switch.Tool / function calling not working
Tool / function calling not working
Function calling passes through the OpenAI-compatible protocol unchanged. If a tool call fails, first verify the model supports tool use (
gpt-5, claude-sonnet all do).Advanced
- Auxiliary models: Hermes uses an auxiliary model for vision / web summarization / MoA, defaulting to your main model. To save money, override it to a cheaper one — see Auxiliary Models.
- Credential pools: round-robin keys and auto-failover — see Credential Pools.
