Top 100 Local LLM Repositories
Ranking
| Ranking | Project Name | Stars | Forks | Language | Open Issues | Description | Last Commit |
|---|---|---|---|---|---|---|---|
| 1 | graphify | 114,453 | 11,119 | Python | 593 | Turn any codebase, with its docs, SQL schemas, configs, and PDFs, into a queryable knowledge graph. A /graphify skill for Claude Code, Cursor, Codex, and Gemini CLI: local deterministic AST parsing, e... | 2026-08-30 |
| 2 | gpt4all | 77,385 | 8,292 | C++ | 730 | GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use. | 2025-05-27 |
| 3 | unsloth | 75,573 | 6,863 | Python | 971 | Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more. | 2026-09-04 |
| 4 | anything-llm | 65,583 | 7,245 | JavaScript | 300 | Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience | 2026-09-04 |
| 5 | LocalAI | 48,848 | 4,413 | Go | 90 | LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required. | 2026-09-04 |
| 6 | textgen | 47,618 | 5,983 | Python | 804 | Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private. | 2026-08-17 |
| 7 | openhuman | 39,395 | 3,883 | Rust | 208 | Your Personal AI super intelligence. A brain that builds a local-first memory of your life, a fantastic orchestrator of agent fleets and workflows, and a deep researcher. | 2026-09-03 |
| 8 | Langchain-Chatchat | 38,614 | 6,267 | Python | 7 | Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Ll... | 2025-11-10 |
| 9 | khoj | 37,053 | 2,451 | Python | 102 | Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI ... | 2026-08-02 |
| 10 | code-review-graph | 31,158 | 2,837 | Python | 86 | Local-first code intelligence graph for MCP and CLI. Builds a persistent map of your codebase so AI coding tools read only what matters, with benchmarked context reductions on reviews and large-repo w... | 2026-08-27 |
| 11 | meetily | 30,300 | 3,273 | Rust | 225 | Privacy first, AI meeting assistant with 4x faster Parakeet/Whisper live transcription, speaker diarization, and Ollama summarization built on Rust. 100% local processing. no cloud required. Meetily (... | 2026-09-03 |
| 12 | Chat2DB | 28,071 | 3,028 | Java | 122 | Chat2DB is a free, cross-platform, local-first database client and SQL workspace for developers, DBAs, analysts, and data teams. Connect to 40+ databases, manage data, edit and run SQL, and use your o... | 2026-09-03 |
| 13 | agenticSeek | 27,135 | 3,036 | Python | 26 | Fully Local Manus AI. No APIs, No $200 monthly bills. Enjoy an autonomous agent that thinks, browses the web, and code for the sole cost of electricity. | 2026-08-11 |
| 14 | dyad | 21,378 | 2,609 | TypeScript | 283 | Local, open-source AI app builder for power users ✨ v0 / Lovable / Replit / Bolt alternative 🌟 Star if you like it! | 2026-09-04 |
| 15 | cc-haha | 14,280 | 8,542 | TypeScript | 131 | Local-first cross-platform desktop workspace for Claude Code / agents: multi-agent, Git worktrees, code diffs, skill marketplace, multi-model, Computer Use, task-aware desktop pets, with WeChat, Feish... | 2026-09-02 |
| 16 | dalai | 12,897 | 1,324 | CSS | 291 | The simplest way to run LLaMA on your local machine | 2024-06-18 |
| 17 | note-gen | 12,729 | 965 | TypeScript | 103 | Capture first. Organize later. A local-first Markdown app that turns scattered records into clear notes with AI. | 2026-08-27 |
| 18 | EverOS | 12,686 | 913 | Python | 49 | One portable memory layer for every AI agent: local-first, Markdown-native, user-owned, and self-evolving across apps, tools, and workflows. | 2026-09-04 |
| 19 | h2ogpt | 11,969 | 1,302 | Python | 292 | Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://gpt-docs.h2o.ai/ | 2025-10-09 |
| 20 | holaOS | 11,137 | 721 | TypeScript | 3 | Open-source agentic workspace enterprises can make their own. Connect the systems you already run — 100+ integrations, MCP, chat tools, apps, browser, local files — with shared memory. Any agent (Clau... | 2026-08-21 |
| 21 | PowerInfer | 9,767 | 597 | C++ | 124 | High-speed Large Language Model Serving for Local Deployment | 2026-05-11 |
| 22 | local-deep-research | 9,035 | 801 | Python | 581 | ~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encry... | 2026-09-04 |
| 23 | ipex-llm | 8,860 | 1,432 | Python | 1213 | Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete... | 2026-01-28 |
| 24 | opencommit | 7,531 | 442 | JavaScript | 133 | top #1 and most feature rich GPT wrapper for git — generate commit messages with an LLM in 1 sec — works with Claude, GPT and every other provider, supports local Ollama models too | 2026-08-25 |
| 25 | Dayflow | 7,009 | 424 | Swift | 48 | The automatic work journal/time tracker. Privately turns your screen into a timeline of what you actually accomplished. Open-source and local-first. | 2026-09-04 |
| 26 | open-multi-agent | 6,871 | 2,433 | TypeScript | 10 | TypeScript AI agent orchestration framework with dynamic workflows. Describe the goal, not the graph: a coordinator plans the task DAG at runtime and runs it on any LLM (Claude, ChatGPT, Gemini, DeepS... | 2026-09-03 |
| 27 | ClawRouter | 6,579 | 648 | TypeScript | 6 | The agent-native LLM router for autonomous agents. Every frontier model behind one wallet, <1ms local routing, USDC payments on Base & Solana via x402. | 2026-09-04 |
| 28 | whichllm | 6,565 | 358 | Python | 13 | Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly. | 2026-08-14 |
| 29 | Kun | 6,275 | 595 | TypeScript | 13 | Local-first AI agent workspace for coding, writing, design, research, and automation — one runtime for desktop GUI and TUI. | 2026-09-04 |
| 30 | FunClip | 6,212 | 742 | Python | 5 | FunASR-powered video transcription, subtitle generation, and LLM-assisted clipping tool with a local Gradio UI. | 2026-09-01 |
| 31 | lemonade | 5,607 | 484 | C++ | 400 | Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk | 2026-09-03 |
| 32 | openmed | 5,201 | 654 | Python | 420 | Local-first healthcare AI: clinical NER & HIPAA PII de-identification that runs 100% on-device. 2,200+ medical models, 21 languages, Apple MLX + Python, no cloud, no patient data leaving your network.... | 2026-09-03 |
| 33 | maka | 4,657 | 438 | TypeScript | 234 | Apache Maka (Incubating) is a local-first AI agent workspace. Model messages, tool calls, tool results, permission decisions, and termination events are recorded as an append-only log. | 2026-09-04 |
| 34 | ai-agents-from-scratch | 4,573 | 675 | JavaScript | 11 | Demystify AI agents by building them yourself. Local LLMs, no black boxes, real understanding of function calling, memory, and ReAct patterns. | 2026-07-24 |
| 35 | LongMemory | 4,482 | 503 | TypeScript | 13 | Local persistent memory store for LLM applications including claude desktop, github copilot, codex, antigravity, etc. | 2026-08-31 |
| 36 | gptme | 4,409 | 420 | Python | 10 | Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top! | 2026-09-03 |
| 37 | METATRON | 3,840 | 764 | Python | 10 | AI-powered penetration testing assistant using local LLM on linux (Parrot OS) | 2026-04-11 |
| 38 | LLamaSharp | 3,790 | 506 | C# | 16 | A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently. | 2026-09-01 |
| 39 | lean-ctx | 3,706 | 339 | Rust | 10 | Control what your AI can see. LeanCTX (Lean Context) is the context intelligence layer for AI agents — one local Rust binary that decides what they read, remembers what they learn, guards what they to... | 2026-09-03 |
| 40 | Rapid-MLX | 3,649 | 413 | Python | 45 | The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separation, cloud routing. Drop-in OpenAI replace... | 2026-09-04 |
| 41 | torchchat | 3,612 | 248 | Python | 79 | Run PyTorch LLMs locally on servers, desktop and mobile | 2025-09-10 |
| 42 | surf | 3,558 | 254 | TypeScript | 22 | Personal AI Notebooks. Organize files & webpages and generate notes from them. Open source, local & open data, open model choice (incl. local). | 2026-08-24 |
| 43 | farfalle | 3,542 | 319 | TypeScript | 44 | 🔍 AI search engine - self-host with local or cloud LLMs | 2024-09-27 |
| 44 | Local-File-Organizer | 3,335 | 332 | Python | 26 | An AI-powered file management tool that ensures privacy by organizing local texts, images. Using Llama3.2 3B and Llava v1.6 models with the Nexa SDK, it intuitively scans, restructures, and organizes ... | 2024-10-21 |
| 45 | Sidekick | 3,313 | 148 | Swift | 34 | A native macOS app that allows users to chat with a local LLM that can respond with information from files, folders and websites on your Mac without installing any other software. Powered by llama.cpp... | 2026-05-24 |
| 46 | nexu | 3,264 | 265 | TypeScript | 191 | The simplest desktop client for OpenClaw 🦞 — bridge your Agent to WeChat, Feishu, Slack & Discord in one click. Works with Claude Code, Codex & any LLM. BYOK, Oauth, local-first, chat from your phone... | 2026-04-26 |
| 47 | harbor | 3,204 | 224 | Python | 57 | Stop configuring your AI stack. Start using it. One command brings a complete pre-wired LLM stack with hundreds of services to explore. | 2026-08-29 |
| 48 | OpenBiliClaw | 3,195 | 157 | Python | 21 | 本地私有、开源的自进化跨平台 AI 内容发现 Agent：先理解你，再主动从 B站、小红书、抖音、YouTube、X、知乎、Reddit、微博等平台与开放 Web 寻找内容。（支持 deepseek harness 插件） | Local-first open-source cross-platform AI content discovery agent: understands you, th... | 2026-09-04 |
| 49 | claude-tap | 3,168 | 273 | Python | 18 | Intercept and inspect Coding Agent API traffic from Claude Code, Codex CLI, Gemini CLI, Cursor CLI, OpenCode, Kimi/Kimi Code, Pi, and Hermes in a local trace viewer. | 2026-08-26 |
| 50 | arxiv-mcp-server | 3,105 | 251 | Python | 2 | A local MCP server for agent literature work. Original-LaTeX section reads, BibTeX from arXiv metadata, and topic watches. Papers stay on disk. Search is optional. | 2026-08-26 |
| 51 | OGAM | 3,045 | 291 | TypeScript | 135 | The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. R... | 2026-09-02 |
| 52 | DeepCamera | 3,039 | 478 | JavaScript | 9 | Open-Source AI Camera Skills Platform, AI NVR & CCTV Surveillance. Local VLM video analysis with Qwen, DeepSeek, SmolVLM, LLaVA, YOLO26. LLM-powered agentic security camera agent — watches, understand... | 2026-06-18 |
| 53 | ramalama | 3,031 | 361 | Python | 75 | RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of con... | 2026-09-02 |
| 54 | llm_aided_ocr | 2,997 | 214 | Python | 0 | Enhances Tesseract OCR output using LLMs (local or API) for error correction, smart chunking, and markdown formatting of scanned PDFs | 2026-08-03 |
| 55 | awesome-local-llm | 2,828 | 369 | - | 11 | A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally | 2026-08-04 |
| 56 | atomic-agent | 2,471 | 237 | TypeScript | 8 | Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp. | 2026-09-03 |
| 57 | WritingTools | 2,436 | 157 | Swift | 66 | The world's smartest system-wide grammar assistant; a better version of the Apple Intelligence Writing Tools. Works on Windows, Linux, & macOS, with the free Gemini API, local LLMs, & more. | 2026-08-19 |
| 58 | natively-cluely-ai-assistant | 2,423 | 560 | TypeScript | 54 | Natively — Free open-source AI meeting assistant, interview copilot, and note taker. The best alternative to Cluely, Otter, Granola, Final Round AI, Fireflies, and Interview Coder. Real-time transcrip... | 2026-09-01 |
| 59 | comfyui_LLM_party | 2,348 | 205 | Python | 79 | LLM Agent Framework in ComfyUI includes MCP sever, Omost,GPT-sovits, ChatTTS,GOT-OCR2.0, and FLUX prompt nodes,access to Feishu,discord,and adapts to all llms with similar openai / aisuite interfaces,... | 2026-07-29 |
| 60 | GraphRAG-Local-UI | 2,322 | 293 | Python | 54 | GraphRAG using Local LLMs - Features robust API and multiple apps for Indexing/Prompt Tuning/Query/Chat/Visualizing/Etc. This is meant to be the ultimate GraphRAG/KG local LLM app. | 2024-11-09 |
| 61 | webclaw | 2,319 | 232 | Rust | 3 | Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server. | 2026-08-30 |
| 62 | ReadAny | 2,311 | 180 | TypeScript | 296 | AI-powered cross-platform e-book reader with semantic search, RAG chat, local vector store, notes, TTS, and WebDAV sync. | 2026-09-02 |
| 63 | kalosm | 2,228 | 133 | Rust | 43 | Instant, controllable, local pre-trained AI models in Rust | 2026-08-22 |
| 64 | WhisperJAV | 2,200 | 186 | Python | 129 | ASR/STT subtitle generator. Uses Qwen3-ASR, local LLM, Whisper, TEN-VAD. Noise-robust for JAV | 2026-09-02 |
| 65 | wechat-cli | 2,166 | 1,782 | Python | 0 | A CLI tool to query your local WeChat data — chat history, contacts, sessions, favorites, and more. Designed for LLM integration. | 2026-04-06 |
| 66 | claude-real-video | 2,116 | 186 | Python | 0 | Let Claude (or any LLM) actually watch a video — scene-aware, deduplicated frames + transcript, from a URL or local file. Runs locally, MIT. | 2026-08-31 |
| 67 | agent-safehouse | 2,050 | 90 | Shell | 22 | Sandbox your local AI agents so they can read/write only what they need | 2026-08-30 |
| 68 | onefilellm | 2,015 | 177 | Python | 3 | Specify a github or local repo, github pull request, arXiv or Sci-Hub paper, Youtube transcript or documentation URL on the web and scrape into a text file and clipboard for easier LLM ingestion | 2026-06-12 |
| 69 | USB-Uncensored-LLM | 1,998 | 465 | HTML | 33 | The ultimate zero-install, portable local AI environment. Run high-quality, uncensored LLMs (Gemma, Qwen, NemoMix) directly from any USB drive or SSD. Fully air-gapped, cross-platform (Win/Mac/Linux),... | 2026-07-04 |
| 70 | obsidian-textgenerator-plugin | 1,980 | 168 | TypeScript | 25 | Text Generator is a versatile plugin for Obsidian that allows you to generate text content using various AI providers, including OpenAI, Anthropic, Google and local models. | 2026-08-06 |
| 71 | llama2-webui | 1,936 | 199 | Jupyter Notebook | 24 | Run any Llama 2 locally with gradio UI on GPU or CPU from anywhere (Linux/Windows/Mac). Use llama2-wrapper as your local llama2 backend for Generative Agents/Apps. | 2024-03-22 |
| 72 | token-monitor | 1,926 | 188 | JavaScript | 53 | Local-first desktop widget for tracking token usage, costs, and limits across 33+ AI coding tools—including Claude Code, Codex, Cursor, OpenCode, and OpenClaw—with multi-device sync. | 2026-09-03 |
| 73 | Dot | 1,912 | 109 | JavaScript | 13 | Text-To-Speech, RAG, and LLMs. All local! | 2024-12-09 |
| 74 | failproofai | 1,843 | 436 | MDX | 20 | Observability and enforcement for AI agent harnesses. Capture every run and runtime reliability with policy enforcement. 40 built-in policies, a local dashboard, no account required with a generous f... | 2026-09-03 |
| 75 | AIaW | 1,834 | 161 | TypeScript | 56 | AI as Workspace - An elegant AI chat client. Full-featured, lightweight. Support multiple workspaces, plugin system, cross-platform, local first + real-time cloud sync, Artifacts, MCP | 更好的 AI 客户端 | 2026-05-18 |
| 76 | local-llm | 1,824 | 105 | Shell | 2 | Everything I know about running LLMs locally | 2026-07-10 |
| 77 | OpenMonoAgent.ai | 1,816 | 214 | C# | 17 | (BETA) AI shouldn't have a meter. Unlimited tokens. Forever. Your machine. Your agent. Use it from anywhere. Terminal-native coding agent powered by local LLMs — 100% open source, free forever, and in... | 2026-09-03 |
| 78 | llm-space | 1,785 | 193 | TypeScript | 5 | A desktop app to prototype agent ideas, inspect every harness step, replay failures, and evaluate performance, all in one place. Local-first, cloud-ready for managed agents. | 2026-09-03 |
| 79 | Klee | 1,761 | 136 | Swift | 21 | A native macOS AI chat app powered by MLX. 100% local inference on Apple Silicon, no cloud required. Built with ShipSwift. | 2026-03-20 |
| 80 | Orkas | 1,690 | 74 | TypeScript | 2 | Open-source multi-agent AI desktop client — build and command your AI agent team through conversation. A commander LLM dispatches sub-agents in parallel or in series; agents self-evolve via reflection... | 2026-09-04 |
| 81 | waku-agent | 1,665 | 320 | Python | 10 | Waku Waku! Waku Agent is a local-first AI agent harness you actually own, including loop, memory, eval, all in code built to stay legible as it grows. | 2026-08-29 |
| 82 | ai-file-sorter | 1,620 | 167 | C++ | 8 | Cross-platform desktop application for content-aware file organization and renaming. Supports local and remote LLMs, preview-based workflows, and fully user-controlled changes. | 2026-09-02 |
| 83 | rag-from-scratch | 1,618 | 193 | JavaScript | 0 | Demystify RAG by building it from scratch. Local LLMs, no black boxes - real understanding of embeddings, vector search, retrieval, and context-augmented generation. | 2026-03-11 |
| 84 | lemonai | 1,562 | 315 | JavaScript | 13 | Lemon AI is the first Full-stack Open-source Self-Evolving General AI Agent, offering a fully local alternative to Agentic platforms like Manus & Genspark AI.🔔 Official updates X(twitter) @LemonAI_... | 2026-02-03 |
| 85 | OpenOSINT | 1,522 | 244 | Python | 10 | AI-powered OSINT agent with interactive REPL, MCP server, and CLI. 19 tools. Works with Claude, GPT-4, or local models. For authorized security research only. | 2026-09-02 |
| 86 | Lumos | 1,515 | 112 | TypeScript | 23 | A RAG LLM co-pilot for browsing the web, powered by local LLMs | 2025-01-26 |
| 87 | rocketnotes | 1,493 | 80 | TypeScript | 15 | ✨ AI-powered markdown editor - leverage LLMs with your documents - 100% local or in the cloud | 2026-04-23 |
| 88 | tlm | 1,489 | 53 | Go | 6 | Local CLI Copilot, powered by Ollama. 💻🦙 | 2026-02-22 |
| 89 | BrowserAI | 1,447 | 136 | TypeScript | 19 | Run local LLMs like llama, deepseek-distill, kokoro and more inside your browser | 2026-07-21 |
| 90 | home-llm | 1,427 | 147 | Python | 38 | A Home Assistant integration & Model to control your smart home using a Local LLM | 2026-07-07 |
| 91 | Atomic-Chat | 1,424 | 161 | TypeScript | 33 | Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V | 2026-09-03 |
| 92 | nextjs-ollama-llm-ui | 1,423 | 330 | TypeScript | 18 | Fully-featured web interface for Ollama LLMs | 2025-06-05 |
| 93 | hyperDB | 1,405 | 88 | Python | 7 | A hyper-fast local vector database for use with LLM Agents. Now accepting SAFEs at $135M cap. | 2025-02-07 |
| 94 | locally-uncensored | 1,371 | 212 | TypeScript | 6 | Plug-and-play local AI studio: uncensored chat, image & video generation, coding agent. Runs abliterated LLMs + ComfyUI 100% offline. One installer, no Docker, no cloud. | 2026-09-03 |
| 95 | SeaGOAT | 1,303 | 92 | Python | 35 | local-first semantic code search engine | 2026-08-28 |
| 96 | alpaca-electron | 1,302 | 138 | JavaScript | 34 | The simplest way to run Alpaca (and other LLaMA-based local LLMs) on your own computer | 2024-04-04 |
| 97 | sre | 1,289 | 202 | TypeScript | 7 | The SmythOS Runtime Environment (SRE) is an open-source, cloud-native runtime for agentic AI. Secure, modular, and production-ready, it lets developers build, run, and manage intelligent agents across... | 2026-04-03 |
| 98 | Soul-of-Waifu | 1,286 | 64 | Python | 9 | 🌌 Give a soul to your favorite characters. Soul of Waifu is a desktop roleplay & AI companion app featuring Live2D/VRM avatars, voice chat & local LLM. Evolve together across immersive chat, RPG adve... | 2026-08-28 |
| 99 | sage | 1,268 | 116 | Python | 23 | Chat with any codebase in under two minutes | Fully local or via third-party APIs | 2024-11-11 |
| 100 | ollama-gui | 1,255 | 159 | Vue | 7 | A Web Interface for chatting with your local LLMs via the ollama API | 2026-08-06 |