Skip to main content
Hermes Agent is Nous Research’s open-source terminal agent with persistent memory and learned skills. It works with any endpoint that implements /v1/chat/completions, so it can run entirely with local Bonsai.

Step 1: Serve Bonsai

Any OpenAI-compatible Bonsai endpoint works. Pick one:
Agent work leans hard on tool calling and multi-step instructions; prefer Ternary 27B, which is trained for native tool calling..

Step 2: Install and configure Hermes

1

Install

Windows has a native PowerShell installer; see the Hermes docs.
2

Run the setup wizard

When asked for an inference provider, choose Custom OpenAI-compatible endpoint and enter:Settings land in ~/.hermes/config.yaml (secrets in ~/.hermes/.env). To change just the model later, run hermes setup model, or edit the config directly with hermes config edit.
3

Launch

Give it a task. Requests appear in your Bonsai server log, confirming the agent is running fully locally.