Hugging Face

Open models through Hugging Face Inference Providers. Bring your own key; nothing is billed by us.

What the harness already knows

Provider idhuggingface
Base URLhttps://router.huggingface.co/v1
ProtocolOpenAI-compatible chat completions
API keyHF_TOKEN
Model discoveryYes — the model list is asked of the endpoint rather than shipped.

Connecting it

The endpoint above is built in, so there is nothing to configure. Put the key in the environment and the provider appears in the model picker:

export HF_TOKEN="..."

Keys are issued by Hugging Face — where to get one.

Models on Hugging Face

The newest models Hugging Face serves that can call tools, from the models.dev snapshot OHarness ships. The harness also asks the endpoint for its live list, so a model released after this snapshot still appears in the picker.

Model idContext / output$/M in / cached / outReasoning
deepseek-ai/DeepSeek-V4.1-Flash1.05M / 384K0.3 / — / 1.2Yes
zai-org/GLM-5.3-Flash1.05M / 131K0.15 / — / 0.5Yes
deepseek-ai/DeepSeek-V4-Flash-Vision-Exp1.05M / 384K0.44 / — / 1.32Yes
Qwen/Qwen3.8-27B262K / 33K0.4 / — / 3Yes
zai-org/GLM-5.31.05M / 131K1.4 / — / 4.4Yes
Qwen/Qwen3.8-2.4T-A95B262K / 131K2.5 / — / 6.25Yes
deepseek-ai/DeepSeek-V4-Pro-08131M / 384K1.32 / — / 3.96Yes
deepseek-ai/DeepSeek-V4-Flash-07311.05M / 384K0.14 / — / 0.28Yes
thinkingmachines/Inkling-Small524K / 1.05M0.5 / — / 1.2Yes
moonshotai/Kimi-K31M / 131K3 / — / 15Yes

List prices in USD per million tokens, read from models.dev on 2026-09-19. Hugging Face changes its prices and models; its own pricing page is the authority. Start a session on the newest:

oharness -m huggingface/deepseek-ai/DeepSeek-V4.1-Flash

Pointing it somewhere else

A regional host, a gateway, or a server of your own. Overrides in ~/.oharness/config.json are field level, so changing the endpoint does not mean restating the rest of the provider — this is the whole block, shown holding the default so the shape is clear:

{
  "providers": {
    "huggingface": {
      "baseUrl": "https://router.huggingface.co/v1"
    }
  }
}

What you get either way

The same agent loop, the same tools, the same MCP servers and the same permission rules, whichever provider is underneath — and switching between them mid-session converts nothing, because history is never stored in a vendor’s shape. What an agent harness is covers why that is the hard part, and the providers reference covers the catalogue itself.

All 34 providers · Install OHarness