Local when possible, cloud by choice
AI Setup & Privacy
Configure a local provider or OpenRouter, use AI with notes and flashcards, and understand exactly what each path sends.
Guide updated: November 2, 2026
Choose local or cloud AI
| Option | How it works | Internet and cost |
|---|---|---|
| Local server | An OpenAI-compatible LM Studio or Ollama endpoint running on your computer | Can work offline after setup; provider and model requirements are yours to manage |
| OpenRouter | Your selected cloud model processes the content needed for each request | Requires internet and your own OpenRouter configuration; provider charges may apply |
| On-device models | Supported OCR, transcription, embeddings, title generation, and other local features | Internet may be needed once to download a model; subsequent inference is local |
Set up a local AI server
- Install and start your preferred OpenAI-compatible LM Studio or Ollama server and make a model available.
- In RelicNotes, open Settings → AI & Search → AI Chat.
- Choose Local server, then enter the endpoint and model information used by your local provider.
- Test the connection and save a working configuration. AI Chat remains in its setup state until a model is configured.
Local AI can work offline when the configured provider and model are available on your computer. Your local server software may have its own logs, resource requirements, and privacy behavior.
Set up OpenRouter
- Create or use your own OpenRouter account and API key, then review the provider’s model prices and data policies.
- Open Settings → AI & Search → AI Chat and choose OpenRouter (cloud).
- Enter your API key, choose a model, and test the connection. Review the cloud privacy warning and one-time consent.
- Keep auto-apply AI write operations off if you want to confirm every proposed note change.
Chat with your notes
- Run Pet: Chat with Pet (AI Chat) from a command palette. The pet branding is an optional persona, not a separate AI feature.
- Choose Add note to pin exact notes as context, or enable auto-find relevant notes for semantic retrieval with fuzzy fallback.
- Ask a question. With OpenRouter, the prompt can include your message, relevant chat history, and selected or automatically retrieved note content.
- To change content, explicitly ask for an edit. Review the resulting Confirm/Reject card before applying a write operation.
AI conversations are stored in the local SQLite database. Graph Mode lets you branch a conversation, and a branch can be exported to a note as a transcript or AI summary.
Generate and judge flashcards with AI
- Open a note and run Note: Convert to Flashcards with AI, or use the relevant note/block generation action. Selected source content is sent through the configured OpenRouter service; preview and edit cards before accepting them.
- Optional AI judging for typed answers sends the question, expected answer, and your answer to OpenRouter for evaluation.
- Disable AI judging if you prefer local/simple validation. Existing cards and ordinary review work offline; AI generation and judging require the relevant online service.
Manage on-device models and memory
Open Settings → AI Models to download and manage supported models, inspect loaded state, open or change the model folder, and unload models.
- Model downloads require internet; supported on-device inference remains local afterward.
- Changing the model folder moves existing model subfolders so they do not need to be downloaded again just because the location changed.
- Enable Unload AI models when idle or choose Unload now to free RAM. Unloading does not delete model files, but the next operation may need to reload the model.
Understand what can leave your device
- Local notes and on-device processing stay on your local path unless you explicitly share content or choose a cloud operation.
- OpenRouter sends the content required for the requested AI operation to OpenRouter and the selected model provider.
- YouTube embeds and title lookups, external link previews, model downloads, account/community features, and update checks can contact external services.
- A masked password block can still be included if you deliberately send its containing note to a cloud provider or publish it. Remove secrets first.
See the Privacy Policy for the full explanation of local data, online services, and third-party processing.
If AI stops working
- For local AI, confirm that the server is running, the model is available, and the endpoint and model settings still match.
- For OpenRouter, check internet access, API-key validity, model availability, and your provider balance or limits.
- For on-device models, confirm that the download completed, the model folder is accessible, and enough free RAM is available.
- Use Stop to end an active request and keep any partial reply. Requests can time out after 120 seconds without an initial response or 60 seconds when streaming stalls.
- If raw edit-note or note-op text appears instead of a valid change, the model may have formatted the operation incorrectly. Retry with a clearer request or a more capable model.
Continue with Shortcuts & Troubleshooting or contact Support if the problem persists.
Still stuck? Visit Support or return to the documentation home.