Files
clawdbot/docs/gateway/cli-backends.md
2026-01-11 00:55:22 +00:00

5.3 KiB
Raw Blame History

summary, read_when
summary read_when
CLI backends: text-only fallback via local AI CLIs
You want a reliable fallback when API providers fail
You are running Claude CLI or other local AI CLIs and want to reuse them
You need a text-only, tool-free path that still supports sessions and images

CLI backends (fallback runtime)

Clawdbot can run local AI CLIs as a text-only fallback when API providers are down, rate-limited, or temporarily misbehaving. This is intentionally conservative:

  • Tools are disabled (no tool calls).
  • Text in → text out (reliable).
  • Sessions are supported (so follow-up turns stay coherent).
  • Images can be passed through if the CLI accepts image paths.

This is designed as a safety net rather than a primary path. Use it when you want “always works” text responses without relying on external APIs.

Beginner-friendly quick start

You can use Claude CLI without any config (Clawdbot ships a built-in default):

clawdbot agent --message "hi" --model claude-cli/opus-4.5

If your gateway runs under launchd/systemd and PATH is minimal, add just the command path:

{
  agents: {
    defaults: {
      cliBackends: {
        "claude-cli": {
          command: "/opt/homebrew/bin/claude"
        }
      }
    }
  }
}

Thats it. No keys, no extra auth config needed beyond the CLI itself.

Using it as a fallback

Add a CLI backend to your fallback list so it only runs when primary models fail:

{
  agents: {
    defaults: {
      model: {
        primary: "anthropic/claude-opus-4-5",
        fallbacks: [
          "claude-cli/opus-4.5"
        ]
      },
      models: {
        "anthropic/claude-opus-4-5": { alias: "Opus" },
        "claude-cli/opus-4.5": {}
      }
    }
  }
}

Notes:

  • If you use agents.defaults.models (allowlist), you must include claude-cli/....
  • If the primary provider fails (auth, rate limits, timeouts), Clawdbot will try the CLI backend next.

Configuration overview

All CLI backends live under:

agents.defaults.cliBackends

Each entry is keyed by a provider id (e.g. claude-cli, my-cli). The provider id becomes the left side of your model ref:

<provider>/<model>

Example configuration

{
  agents: {
    defaults: {
      cliBackends: {
        "claude-cli": {
          command: "/opt/homebrew/bin/claude"
        },
        "my-cli": {
          command: "my-cli",
          args: ["--json"],
          output: "json",
          input: "arg",
          modelArg: "--model",
          modelAliases: {
            "claude-opus-4-5": "opus",
            "claude-sonnet-4-5": "sonnet"
          },
          sessionArg: "--session",
          sessionMode: "existing",
          sessionIdFields: ["session_id", "conversation_id"],
          systemPromptArg: "--system",
          systemPromptWhen: "first",
          imageArg: "--image",
          imageMode: "repeat",
          serialize: true
        }
      }
    }
  }
}

How it works

  1. Selects a backend based on the provider prefix (claude-cli/...).
  2. Builds a system prompt using the same Clawdbot prompt + workspace context.
  3. Executes the CLI with a session id (if supported) so history stays consistent.
  4. Parses output (JSON or plain text) and returns the final text.
  5. Persists session ids per backend, so follow-ups reuse the same CLI session.

Sessions

  • If the CLI supports sessions, set sessionArg (e.g. --session-id).
  • sessionMode:
    • always: always send a session id (new UUID if none stored).
    • existing: only send a session id if one was stored before.
    • none: never send a session id.

Images (pass-through)

If your CLI accepts image paths, set imageArg:

imageArg: "--image",
imageMode: "repeat"

Clawdbot will write base64 images to temp files and pass their paths. If imageArg is missing and images are present, the CLI backend will fail fast (so fallback continues to the next provider). If your CLI does not expose an image flag (the current Claude CLI does not), leave imageArg unset and stick to text-only runs.

Inputs / outputs

  • output: "json" (default) tries to parse JSON and extract text + session id.
  • output: "text" treats stdout as the final response.

Input modes:

  • input: "arg" (default) passes the prompt as the last CLI arg.
  • input: "stdin" sends the prompt via stdin.
  • If the prompt is very long and maxPromptArgChars is set, stdin is used.

Defaults (built-in)

Clawdbot ships a default for claude-cli:

  • command: "claude"
  • args: ["-p", "--output-format", "json", "--dangerously-skip-permissions"]
  • modelArg: "--model"
  • systemPromptArg: "--append-system-prompt"
  • sessionArg: "--session-id"
  • systemPromptWhen: "first"
  • sessionMode: "always"

Override only if needed (common: absolute command path).

Limitations

  • No tools (tool calls are disabled by design).
  • No streaming (CLI output is collected then returned).
  • Structured outputs depend on the CLIs JSON format.

Troubleshooting

  • CLI not found: set command to a full path.
  • Wrong model name: use modelAliases to map provider/model → CLI model.
  • No session continuity: ensure sessionArg is set and sessionMode is not none.
  • Images ignored: set imageArg (and verify CLI supports file paths).