@Teknium: Tip of the day: You can use Hermes Agent's Credential Pools to login or add multiple API keys for the same LLM Provider…

X AI KOLs Following Tools

Summary

This article explains the Credential Pools feature in Hermes Agent, a tool that allows users to manage multiple API keys or OAuth tokens for a single LLM provider to ensure stability through automatic rotation and failover.

Tip of the day: You can use Hermes Agent's Credential Pools to login or add multiple API keys for the same LLM Provider and it will rotate across them to ensure stability of your operations. Learn more on the credential pool doc: https://t.co/NbVXcKQlZN
Original Article
View Cached Full Text

Cached at: 05/09/26, 06:16 PM

Tip of the day:

You can use Hermes Agent’s Credential Pools to login or add multiple API keys for the same LLM Provider and it will rotate across them to ensure stability of your operations.

Learn more on the credential pool doc: https://t.co/NbVXcKQlZN


Credential Pools | Hermes Agent

Source: https://hermes-agent.nousresearch.com/docs/user-guide/features/credential-pools Credential pools let you register multiple API keys or OAuth tokens for the same provider. When one key hits a rate limit or billing quota, Hermes automatically rotates to the next healthy key — keeping your session alive without switching providers.

This is different fromfallback providers, which switch to adifferentprovider entirely. Credential pools are same-provider rotation; fallback providers are cross-provider failover. Pools are tried first — if all pool keys are exhausted,thenthe fallback provider activates.

How It Works

Your request  → Pick key from pool (round_robin / least_used / fill_first / random)  → Send to provider  → 429 rate limit?      → Retry same key once (transient blip)      → Second 429 → rotate to next pool key      → All keys exhausted → fallback_model (different provider)  → 402 billing error?      → Immediately rotate to next pool key (24h cooldown)  → 401 auth expired?      → Try refreshing the token (OAuth)      → Refresh failed → rotate to next pool key  → Success → continue normally

Quick Start

If you already have an API key set in\.env, Hermes auto-discovers it as a 1-key pool. To benefit from pooling, add more keys:

# Add a second OpenRouter keyhermes auth add openrouter --api-key sk-or-v1-your-second-key# Add a second Anthropic keyhermes auth add anthropic --type api-key --api-key sk-ant-api03-your-second-key# Add an Anthropic OAuth credential (requires Claude Max plan + extra usage credits)hermes auth add anthropic --type oauth# Opens browser for OAuth login

Check your pools:

Output:

openrouter (2 credentials):  #1  OPENROUTER_API_KEY   api_key env:OPENROUTER_API_KEY ←  #2  backup-key           api_key manualanthropic (3 credentials):  #1  hermes_pkce          oauth   hermes_pkce ←  #2  claude_code          oauth   claude_code  #3  ANTHROPIC_API_KEY    api_key env:ANTHROPIC_API_KEY

Themarks the currently selected credential.

Interactive Management

Runhermes authwith no subcommand for an interactive wizard:

This shows your full pool status and offers a menu:

What would you like to do?  1. Add a credential  2. Remove a credential  3. Reset cooldowns for a provider  4. Set rotation strategy for a provider  5. Exit

For providers that support both API keys and OAuth (Anthropic, Nous, Codex), the add flow asks which type:

anthropic supports both API keys and OAuth login.  1. API key (paste a key from the provider dashboard)  2. OAuth login (authenticate via browser)Type [1/2]:

CLI Commands

CommandDescriptionhermes authInteractive pool management wizardhermes auth listShow all pools and credentialshermes auth list <provider\>Show a specific provider’s poolhermes auth add <provider\>Add a credential (prompts for type and key)hermes auth add <provider\> \-\-type api\-key \-\-api\-key <key\>Add an API key non-interactivelyhermes auth add <provider\> \-\-type oauthAdd an OAuth credential via browser loginhermes auth remove <provider\> <index\>Remove credential by 1-based indexhermes auth reset <provider\>Clear all cooldowns/exhaustion status## Rotation Strategies

Configure viahermes auth→ “Set rotation strategy” or inconfig\.yaml:

credential_pool_strategies:  openrouter: round_robin  anthropic: least_used

StrategyBehaviorfill\_first(default)Use the first healthy key until it’s exhausted, then move to the nextround\_robinCycle through keys evenly, rotating after each selectionleast\_usedAlways pick the key with the lowest request countrandomRandom selection among healthy keys## Error Recovery

The pool handles different errors differently:

ErrorBehaviorCooldown429 Rate LimitRetry same key once (transient). Second consecutive 429 rotates to next key1 hour402 Billing/QuotaImmediately rotate to next key24 hours401 Auth ExpiredTry refreshing the OAuth token first. Rotate only if refresh fails—All keys exhaustedFall through tofallback\_modelif configured—Thehas\_retried\_429flag resets on every successful API call, so a single transient 429 doesn’t trigger rotation.

Custom Endpoint Pools

Custom OpenAI-compatible endpoints (Together.ai, RunPod, local servers) get their own pools, keyed by the endpoint name fromcustom\_providersin config.yaml.

When you set up a custom endpoint viahermes model, it auto-generates a name like “Together.ai” or “Local (localhost:8080)”. This name becomes the pool key.

# After setting up a custom endpoint via hermes model:hermes auth list# Shows:#   Together.ai (1 credential):#     #1  config key    api_key config:Together.ai ←# Add a second key for the same endpoint:hermes auth add Together.ai --api-key sk-together-second-key

Custom endpoint pools are stored inauth\.jsonundercredential\_poolwith acustom:prefix:

{  "credential_pool": {    "openrouter": [...],    "custom:together.ai": [...]  }}

Auto-Discovery

Hermes automatically discovers credentials from multiple sources and seeds the pool on startup:

SourceExampleAuto-seeded?Environment variablesOPENROUTER\_API\_KEY,ANTHROPIC\_API\_KEYYesOAuth tokens (auth.json)Codex device code, Nous device codeYesClaude Code credentials~/\.claude/\.credentials\.jsonYes (Anthropic)Hermes PKCE OAuth~/\.hermes/auth\.jsonYes (Anthropic)Custom endpoint configmodel\.api\_keyin config.yamlYes (custom endpoints)Manual entriesAdded viahermes auth addPersisted in auth.jsonAuto-seeded entries are updated on each pool load — if you remove an env var, its pool entry is automatically pruned. Manual entries (added viahermes auth add) are never auto-pruned.

Delegation & Subagent Sharing

When the agent spawns subagents viadelegate\_task, the parent’s credential pool is automatically shared with children:

  • Same provider— the child receives the parent’s full pool, enabling key rotation on rate limits
  • Different provider— the child loads that provider’s own pool (if configured)
  • No pool configured— the child falls back to the inherited single API key

This means subagents benefit from the same rate-limit resilience as the parent, with no extra configuration needed. Per-task credential leasing ensures children don’t conflict with each other when rotating keys concurrently.

Thread Safety

The credential pool uses a threading lock for all state mutations (select\(\),mark\_exhausted\_and\_rotate\(\),try\_refresh\_current\(\),mark\_used\(\)). This ensures safe concurrent access when the gateway handles multiple chat sessions simultaneously.

Architecture

For the full data flow diagram, seedocs/credential\-pool\-flow\.excalidrawin the repository.

The credential pool integrates at the provider resolution layer:

  1. agent/credential\_pool\.py— Pool manager: storage, selection, rotation, cooldowns
  2. hermes\_cli/auth\_commands\.py— CLI commands and interactive wizard
  3. hermes\_cli/runtime\_provider\.py— Pool-aware credential resolution
  4. run\_agent\.py— Error recovery: 429/402/401 → pool rotation → fallback

Storage

Pool state is stored in~/\.hermes/auth\.jsonunder thecredential\_poolkey:

{  "version": 1,  "credential_pool": {    "openrouter": [      {        "id": "abc123",        "label": "OPENROUTER_API_KEY",        "auth_type": "api_key",        "priority": 0,        "source": "env:OPENROUTER_API_KEY",        "access_token": "sk-or-v1-...",        "last_status": "ok",        "request_count": 142      }    ]  },}

Strategies are stored inconfig\.yaml(notauth\.json):

credential_pool_strategies:  openrouter: round_robin  anthropic: least_used

Similar Articles

Never waste a token (15 minute read)

TLDR AI

A technical blog post explaining how to avoid wasting LLM tokens by placing a durable buffer between the agent and the provider, enabling recovery from process crashes without re-fetching already-generated tokens.