AnythingLLM
AnythingLLM Integration Guide
Connect UnoRouter to AnythingLLM as a Generic OpenAI provider.
Overview
AnythingLLM treats UnoRouter as a Generic OpenAI provider. Type the model, set the context window, and save.
Quick Config
Drop these values into the client. Your key auto-fills when you are signed in.
text
Base URL: https://api.unorouter.com/v1
API Key: YOUR_API_KEYCompatibility
Chat CompletionsStreamingTool calling
Step-by-step setup
- 1Open LLM Preference
Click Settings in the sidebar, then LLM Preference.
- 2Pick Generic OpenAI
Set LLM Provider to Generic OpenAI and fill in the form.
textBase URL: https://api.unorouter.com/v1 API Key: YOUR_API_KEY Chat Model Name: YOUR_MODEL_ID Token context window: 50000 - 3Save
Hit save. AnythingLLM uses UnoRouter for chat workspaces.
Recommended models
Free models that work well here. Paste any model id into the client.
intern-s1-pro:freeqwen-turbo:freeqwen3-vl-plus-2025-12-19:freecydonia-24b-v4.3:freeqwen3guard-gen-0.6b:free
Gotchas
- AnythingLLM does not auto-fetch the catalog for Generic OpenAI. Type the model name and context window manually.
- The Embedding Preference tab is separate. Leave it on a working embedding provider unless UnoRouter exposes embeddings on your plan.