AnythingLLM + Luma Cloud

Before you start

• Create a named key in Dashboard → API. Use API Wallet credit, or an eligible Builder subscription key.
• Copy an exact model ID from the catalog returned for this key. Replace MODEL_ID_FROM_CATALOG wherever it appears below.
• Use a separate named key for this app. Paste it only into the app's credential field; keep it out of chat prompts, screenshots, shared configuration and workflow exports.
• AnythingLLM Desktop, or administrator access to your AnythingLLM installation. Have the selected model's context and output limits available.

Get an API key and a model ID →

Set up AnythingLLM

1. Open the language-model settings

   Open Settings → AI Providers → LLM and choose Generic OpenAI. During first-time setup, this selection appears under LLM Preference. These settings establish the system default for workspaces without an override.

2. Enter your connection

   Set Base URL to https://api.lumaos.cloud/v1 and paste your Luma key into API Key. In Selected Model, choose the catalog ID you copied. If discovery is unavailable and the field permits manual input, enter that ID directly.

3. Set the token limits

   Model context window is the total space available to the conversation. Max Tokens is the output budget for a reply. Use the selected model's published limits and keep Max Tokens within its output limit; do not reuse another model's values.

4. Save and check the workspace

   Click Save changes. Open the intended workspace's settings → Chat Settings and check Workspace LLM Provider and Workspace Chat model. An existing workspace override takes precedence over the system default.

5. Try a plain conversation

   Use Chat mode for the first test, open a fresh conversation in that workspace, and send “Reply with hello.” Agent Configuration is separate; configure it later if you need agent tools.

LLM Provider

Generic OpenAI

Base URL

https://api.lumaos.cloud/v1

API Key

Your Luma Cloud API key

Selected Model

MODEL_ID_FROM_CATALOG

Model context window

The selected model's published context limit

Max Tokens

An output budget within that model's limit

Check the connection

1. Wait for the workspace to show a completed text answer. Query mode can require document context, so use Chat for this test.
2. After the reply, open Dashboard → Usage. Check API Wallet for a wallet key, or subscription usage for a Builder subscription key.
3. If the selected model is wrong, inspect Workspace Chat model and the separate Agent Configuration before changing your Luma key.

For errors or a request that stops, see troubleshooting. A visible model list alone does not confirm that a chat or editing task can complete.

What to expect

• Configure document embeddings separately. Selecting this chat provider does not make Luma Cloud an embedding service.
• Agent tools depend on the model and your AnythingLLM version. Check a simple tool action before relying on an unattended workflow.
• A shared installation's system model may serve several workspaces. Use a key intended for that installation and check workspace access before adding personal credentials.

Troubleshooting AnythingLLM