Skip to content

ai-provider-openai-compat

Enterprise Part of the commercial Kumiko Enterprise offering — not in the open framework.

Registers an OpenAI Chat-Completions-compatible backend as the "openai-compat" LLM provider in ai-foundation. A single adapter covers OpenAI, Ollama, vLLM, llama.cpp, OpenRouter, and other Chat-Completions-speaking endpoints — point the per-tenant endpoint config-key at the server you want and set the model name; the API key is optional for local backends. No OpenAI SDK dependency; direct fetch.

Per-tenant config keys, set via the tenant-admin UI or a seed. 🔒 = encrypted at rest.

| Key | Type | Default | Scope | Who can write | Who can read | |---|---|---|---|---|---| | model | text | "" | tenant | TenantAdmin, SystemAdmin | all | | endpoint | text | "" | tenant | TenantAdmin, SystemAdmin | TenantAdmin, SystemAdmin | | max-tokens | number (1024–128000) | 16000 | tenant | TenantAdmin, SystemAdmin | all |

| Secret | Scope | Hint | |---|---|---| | ai-provider-openai-compat:secret:openai-compat-api-key | tenant | Optional. Required for OpenAI/OpenRouter, leave empty for local Ollama/vLLM. |

  • Registers extension: llmProvideropenai-compat