Search docs...

Start typing to search documentation

AnythingLLM

AnythingLLM Integration Guide

Connect UnoRouter to AnythingLLM as a Generic OpenAI provider.

Overview

AnythingLLM treats UnoRouter as a Generic OpenAI provider. Type the model, set the context window, save.

Quick Config

Paste these into the client. Your key auto-fills when signed in.

text
Base URL: https://api.unorouter.com/v1
API Key: YOUR_API_KEY

Sign in to auto-fill your API key

Compatibility

Chat CompletionsStreamingTool calling

Step-by-step setup

  1. 1
    Open LLM Preference

    Open Settings in the sidebar, then LLM Preference.

  2. 2
    Pick Generic OpenAI

    Set LLM Provider to Generic OpenAI and fill the form.

    text
    Base URL: https://api.unorouter.com/v1
    API Key: YOUR_API_KEY
    Chat Model Name: YOUR_MODEL_ID
    Token context window: 50000

    Sign in to auto-fill your API key

  3. 3
    Save

    Save. AnythingLLM uses UnoRouter for chat workspaces.

Recommended models

Free models that work here. Paste any model id into the client.

ox-alpha:freeglm-5.3-search:freeglm-5.3-think-search:freeglm-5.3-thinking:freeglm-5.3:free

Gotchas

  • Generic OpenAI does not fetch the catalog. Type the model name and context window manually.
  • Embedding Preference is a separate tab. Leave it on a working embedding provider unless UnoRouter exposes embeddings on your plan.
Generate API KeyModels