Local LLM Hub

Local LLM Hub for Obsidian

Your company's security policy blocks cloud APIs. But you refuse to give up AI-powered note automation.

Local LLM Hub brings the full power of Gemini Helper's workflow automation, RAG, MCP integration, and agent skills to a completely local environment. Ollama, LM Studio, vLLM, or AnythingLLM — your data never leaves your machine.

Why Local?

Every byte stays on your machine. No API keys sent to the cloud. No vault contents uploaded anywhere. This isn't a privacy "option" — it's the architecture.

If you use Gemini Helper at home but need something for work — this is it. Same workflow engine, same UX, zero cloud dependency.

Workflow Automation — The Core Feature

Describe what you want in plain language. The AI builds the workflow. No YAML knowledge required.

Create Workflows & Skills with AI

1. Open the Workflow / skill tab
2. Click Create workflow with AI (or Create skill with AI for an agent skill)
3. Describe: "Convert the current page into an infographic and save it"
4. Click Generate
5. The AI produces a plain-language plan first — review it and click OK to proceed, Re-plan to give feedback and regenerate the plan, or Cancel to abort
6. After generation, the AI runs a review over the result. If issues are found you can OK (with a confirmation prompt), Refine (regenerate using the review feedback), or Cancel. Clean reviews proceed automatically
7. If the LLM produces invalid YAML, the plugin automatically re-prompts it with the parse error (up to 2 retries) before surfacing a recoverable failure view with the raw output
8. The workflow is saved once you accept the final preview

Don't have a powerful local model? Click Copy Prompt, paste into Claude/GPT/Gemini, paste the response back, and click Apply.

Create workflow / skill from any file:

When opening the Workflow / skill tab with a file that has no workflow code block, separate Create workflow with AI and Create skill with AI buttons are displayed. The header of an active SKILL.md also exposes Create skill with AI alongside Modify skill with AI so you can spin up a new skill without leaving the panel.

Modify with AI

Load any workflow, click AI Modify, describe the change. The same plan → generate → review flow runs. You can Refine the review result as many times as you want; each Refine triggers a new generation pass and a fresh review so the review always matches the final YAML. Reference execution history to debug failures.

Modify Skill with AI: When the active file is a SKILL.md, the Workflow / skill tab shows a Modify skill with AI button. It updates the SKILL.md instructions body and the referenced workflow file in a single pass, preserving the skill's frontmatter (name, description, workflow entries).

Visual Node Editor

23 node types across 12 categories:

Event Triggers & Hotkeys

• Event triggers — auto-run workflows on file create / modify / delete / rename / open
• Hotkey support — assign keyboard shortcuts to any named workflow
• Execution history — review past runs with step-by-step details

See the OKF workflow node reference at docs/okf/local-llm-hub-help/features/workflow-nodes.md.

Dashboard Hub Integration

Dashboard functionality is provided by the separate Dashboard Hub plugin. When both plugins are enabled, Local LLM Hub supplies its configured models, Chat handoff, Base generation, text rewriting, and Workflow generation/execution. Dashboard Hub also contributes its dashboard Agent Skill to Local LLM Hub at runtime.

Existing .dashboard files remain compatible. See the Dashboard Hub documentation for dashboard features, widgets, storage, and schema.

Discussion Hub Integration

Discussion Hub brings multiple AI providers into a shared conversation. When both plugins are enabled, Local LLM Hub automatically registers its configured text models with Discussion Hub. Responses are streamed into the discussion, and message attachments and the discussion system prompt are passed through to the selected model.

Configure your LLM server and models in Local LLM Hub, then select a Local LLM Hub model when creating or editing a Discussion Hub discussion. No additional integration settings are required.

AI Chat

Streaming chat with your local LLM. Thinking display, file attachments, @ mentions for vault notes, multiple sessions.

Vault Tools (Function Calling)

Models with function calling support (Qwen, Llama 3.1+, Mistral) can directly interact with your vault:

read_timeline · read_note · create_note · update_note · rename_note · create_folder · search_notes · list_notes · list_folders · get_active_note · propose_edit · execute_javascript

Three modes — All, No Search, Off — selectable from the input area.

In Settings -> Workspace -> LLM vault tool folders, you can restrict LLM vault tools and LLM-triggered skill workflows to selected vault-relative folders. Leave it empty to allow the whole vault. This setting is separate from the RAG index folders setting and does not restrict RAG, manual attachments, @note mentions, MCP tools, or scripts.

MCP Servers

Connect local MCP servers to extend the AI with external tools. MCP tools are merged with vault tools and routed via function calling — all running as local child processes.

Agent Plugins can contribute stdio MCP servers alongside namespaced skills. A tested plugin-managed server stays disabled normally and is started only for a chat turn where a skill from the same enabled package is active.

RAG (Local Embeddings)

Index your vault with a local embedding model (e.g. nomic-embed-text). Relevant notes and PDFs are automatically included as context. PDF text is extracted via PDF.js and chunked alongside Markdown files. Everything computed and stored locally.

RAG Search

A dedicated search interface for semantic vector search with keyword filtering, chunk editing, and AI-powered refinement.

• Keyword filter — Narrow semantic search results by text or file path
• Chunk editor — Edit result text, load adjacent chunks with automatic overlap removal
• AI refine — Automatically expand context and clean up text using your local LLM

See the OKF RAG Search reference at docs/okf/local-llm-hub-help/features/rag-search.md.

Agent Skills

Inject reusable instructions into the system prompt via SKILL.md files. Activate per conversation. Skills can also expose workflows that the AI can invoke as tools during chat.

Create skills the same way as workflows — click Create skill with AI in the Workflow / skill tab and describe what you want. The AI generates both the SKILL.md instructions and the workflow. To edit an existing skill, open its SKILL.md and click Modify skill with AI in the Workflow / skill tab — the AI updates both the instructions body and the referenced workflow together.

Clickable skill chips: Active skill chips in the chat input area and on assistant messages are clickable and jump to the matching SKILL.md (built-in skills are shown as static labels).

Workflow error recovery: If a skill workflow fails during a chat, the failing tool call shows an Open workflow button. Clicking it opens the workflow file and switches to the Workflow / skill tab so you can immediately edit and re-run. Use Modify workflow with AI together with Reference execution history to let the AI fix the failing step.

Agent Plugins: Open Settings → Agent plugins, enter owner/repository or a public GitHub URL, and preview the Agent Plugin v1.0.0 package before installation. Packages are pinned to the reviewed commit and stored under .local-llm-hub/agent-plugins/; persistent package data is stored separately under .local-llm-hub/agent-plugin-data/. Installed skills appear as <plugin>.<skill>.

Plugin stdio MCP entries support ${PLUGIN_ROOT} and ${PLUGIN_DATA}. Local LLM Hub validates commands, arguments, environment variables, working directories, symlinks, paths, and package sizes before use. Successfully tested servers are activated only while a skill from the same enabled plugin is active.

See the OKF agent skills reference at docs/okf/local-llm-hub-help/features/agent-skills.md.

Slash Commands & Compact History

• Custom prompt templates triggered by /
• /compact to compress long conversations while preserving context

File Encryption

Password-protect sensitive notes. Encrypted files are invisible to AI chat tools but accessible to workflows with password prompt — ideal for storing API keys or credentials.

Edit History

Automatic tracking of AI-made changes with diff view and one-click restore.

Setup

Requirements

• Ollama, LM Studio, vLLM, or AnythingLLM
• A chat model (e.g. ollama pull qwen3.5:4b)
• For RAG: an embedding model (e.g. ollama pull nomic-embed-text)

Quick Start

1. Install and start your LLM server
2. Open plugin settings → select framework (Ollama / LM Studio / vLLM / AnythingLLM)
3. Set the server URL (defaults pre-filled)
4. Fetch and select your chat model
5. Click Verify connection

The plugin data folder (chat history, RAG indexes, and workflow history) and the agent skills folder can both be changed under Settings → Workspace. Paths are relative to the vault; changing an existing folder moves its contents to the new location.

RAG Setup

1. Enable RAG in settings
2. Fetch and select the embedding model
3. Configure RAG index folders (optional — defaults to entire vault; this does not restrict Vault tools)
4. Click Sync to build the index

For large vaults, create multiple RAG settings for separate folders, sync each one, then create another RAG setting and enable Combine internal RAG settings. Select the synced source settings to search them together from one chat/search selector. Combined settings use the embedding server and model from the first selected source setting.

During sync, changed files are processed and saved in small file batches so large first-time indexes can recover from an Obsidian crash without starting over. This is separate from the RAG chunk size setting. If a PDF cannot be extracted, it is listed after sync, its checksum is saved, and it appears in the indexed file list with 0 chunks. It will not be retried on later syncs unless the PDF file changes. To force re-import, rename the PDF, modify the file, or clear/rebuild the RAG index.

You can also enable Use external index and enter one external index directory per line. Each directory must contain rag-index.json and rag-vectors.bin.

MCP Server Setup

1. Settings → MCP servers → Add server
2. Configure: name, command (e.g. npx), arguments, optional env vars
3. Toggle on — connects automatically via stdio

Portable Agent Plugin MCP servers are managed from Settings → Agent plugins instead of being added manually. Package updates are reviewed and installed as a new commit-pinned version.

Workspace Settings

Use LLM vault tool folders to control which folders automatic LLM vault operations can access. An empty value allows the whole vault.

Supported Frameworks

Using Cloud LLMs (OpenAI, Gemini, etc.)

The "LM Studio (OpenAI compatible)" framework works with any OpenAI-compatible API endpoint, including cloud services:

RAG with cloud LLMs: Cloud LLMs cannot use local embedding models directly. To use RAG, configure the Embedding server URL in RAG settings to point to a local Ollama instance (e.g. http://localhost:11434) and select an embedding model like nomic-embed-text.

Installation

BRAT (Recommended)

1. Install BRAT plugin
2. Open BRAT settings → "Add Beta plugin"
3. Enter: https://github.com/takeshy/obsidian-local-llm-hub
4. Enable the plugin in Community plugins settings

Manual

1. Download main.js, manifest.json, styles.css from releases
2. Create local-llm-hub folder in .obsidian/plugins/
3. Copy files and enable in Obsidian settings

From Source

git clone https://github.com/takeshy/obsidian-local-llm-hub
cd obsidian-local-llm-hub
npm install
npm run build

Gemini Helper との関係 / Relationship to Gemini Helper

This plugin is the local-only sibling of obsidian-gemini-helper. Same workflow engine, same UX patterns, but designed for environments where cloud APIs are not an option.

Choose Gemini Helper when you want cutting-edge cloud models. Choose Local LLM Hub when privacy is non-negotiable.