Skip to content

Configure the LLM provider

Read this if you want to change which model OMem uses, switch from a subscription to an API key, or point OMem at a local model. OMem doesn’t ship a model — you bring your own — and the curator (text → wiki page) and VLM (image → description) are configured independently.

anthropic-oauth (the default) — your Claude Pro / Max subscription. No API key. Set it up through the wizard:

Terminal window
omem setup --llm

You can use a strong text model for curation and a cheaper (or different-vendor) vision model for images — they’re independent under llm.curator.* and llm.vlm.*:

Terminal window
omem config set llm.vlm.provider openai-compat
omem config set llm.vlm.model qwen-vl-max

The major Chinese model platforms all expose OpenAI-compatible endpoints — point openai-compat at the right base_url and use the platform’s model ID:

Platformbase_urlCurator modelVision model
Alibaba Bailian (Qwen)https://dashscope.aliyuncs.com/compatible-mode/v1qwen-max / qwen-plusqwen-vl-max
ByteDance Volcengine Ark (Doubao)https://ark.cn-beijing.volces.com/api/v3doubao-1-5-pro-32kdoubao-1-5-vision-pro
Kimi (Moonshot)https://api.moonshot.cn/v1kimi-k2-0905-previewmoonshot-v1-32k-vision-preview
Zhipu GLMhttps://open.bigmodel.cn/api/paas/v4glm-4-plusglm-4v-plus
MiniMaxhttps://api.minimax.chat/v1MiniMax-Text-01(check official vision model)
DeepSeekhttps://api.deepseek.com/v1deepseek-chat(no first-party vision yet; use another provider for VLM)

Example — Bailian for both curator (qwen-max) and VLM (qwen-vl-max):

Terminal window
# Curator
omem config set llm.curator.provider openai-compat
omem config set llm.curator.base_url https://dashscope.aliyuncs.com/compatible-mode/v1
omem config set llm.curator.model qwen-max
omem config set llm.curator.api_key_env DASHSCOPE_API_KEY
# Vision model (can be a different provider; here we keep it on Bailian)
omem config set llm.vlm.provider openai-compat
omem config set llm.vlm.base_url https://dashscope.aliyuncs.com/compatible-mode/v1
omem config set llm.vlm.model qwen-vl-max
omem config set llm.vlm.api_key_env DASHSCOPE_API_KEY
# Set the key in your shell (or via Keychain — see above)
export DASHSCOPE_API_KEY=sk-xxx

Always check the platform’s official docs for the latest base_url and model IDs — they ship new models and deprecate old ones often.

Set openai-compat and point base_url at your local server (Ollama, vLLM, LM Studio, …). It works today, with one honest caveat: quality depends on the model. OMem’s “good by default” promise is calibrated to capable cloud models; a small local model will curate, but with lower fidelity. Fully-offline, work-grade quality is a v1.5 goal.

Terminal window
omem doctor

The llm endpoint check confirms your provider is reachable and configured. See the full field list in the config schema.