ABCDEFGHIJKLM
1
OwnerRepository NameAboutStarsForksIssuesContributorsReleasesWatchersTime Since Last CommitLicenseLanguagesURL
2
huggingfacetransformers🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.138,05827,6741,5384361751,1300 days, 9 hrs, 5 minsApache License 2.0Python, Cuda, Dockerfile, Shell, C++, C, Makefile, Cython, Jsonnethttps://github.com/huggingface/transformers
3
ollamaollamaGet up and running with Llama 3.3, Phi 4, Gemma 2, and other large language models.110,7058,8291,3643891106481 days, 5 hrs, 29 minsMIT LicenseGo, C, Shell, TypeScript, Makefile, Dockerfile, PowerShell, Inno Setup, Objective-C, CSS, JavaScript, Assembly, HTMLhttps://github.com/ollama/ollama
4
ChatGPTNextWebChatGPT-Next-Web✨ Local and Fast AI Assistant. Support: Web | iOS | MacOS | Android | Linux | Windows78,97460,174577240754204 days, 18 hrs, 52 minsMIT LicenseTypeScript, SCSS, JavaScript, Rust, Shell, Dockerfilehttps://github.com/ChatGPTNextWeb/ChatGPT-Next-Web
5
nomic-aigpt4allGPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.71,9307,813704114356522 days, 13 hrs, 15 minsMIT LicenseC++, QML, Python, CMake, JavaScript, C, Qt Script, Shell, Makefile, Batchfile, PowerShell, Objective-C++, CSShttps://github.com/nomic-ai/gpt4all
6
ggerganovllama.cppLLM inference in C/C++71,45810,3376244622,8415630 days, 10 hrs, 44 minsMIT LicenseC++, C, Python, Cuda, Objective-C, Metal, CMake, Shell, Makefile, Nix, Dockerfile, Batchfile, JavaScript, Swifthttps://github.com/ggerganov/llama.cpp
7
binary-huskygpt_academic为GPT/GLM等LLM大语言模型提供实用化交互接口，特别优化论文阅读/润色/写作体验，模块化设计，支持自定义快捷按钮&函数插件，支持Python和C++等项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持chatglm3等本地模型。接入通义千问, deepseekcoder, 讯飞星火, 文心一言, llama2, rwkv, claude2, moss等。67,1168,24341998322835 days, 14 hrs, 43 minsGNU General Public License v3.0Python, JavaScript, HTML, CSS, Dockerfilehttps://github.com/binary-husky/gpt_academic
8
xtekkygpt4freeThe official gpt4free repository | various collection of powerful language models63,21613,517272272264870 days, 15 hrs, 41 minsGNU General Public License v3.0Python, JavaScript, HTML, CSS, Dockerfile, Shellhttps://github.com/xtekky/gpt4free
9
open-webuiopen-webuiUser-friendly AI Interface (Supports Ollama, OpenAI API, ...)60,0417,315170311832982 days, 15 hrs, 49 minsBSD 3-Clause "New" or "Revised" LicenseJavaScript, Svelte, Python, TypeScript, CSS, Shell, Dockerfile, HTML, Batchfile, Mako, Makefilehttps://github.com/open-webui/open-webui
10
imartinezprivateGPTInteract with your documents using the power of GPT, 100% privately, no data leaks54,9857,397255901046374 days, 13 hrs, 0 minsApache License 2.0Python, MDX, Makefilehttps://github.com/imartinez/privateGPT
11
lobehublobe-chat🤯 Lobe Chat - an open-source, modern-design AI chat framework. Supports Multi AI Providers( OpenAI / Claude 3 / Gemini / Ollama / Qwen / DeepSeek), Knowledge Base (file upload / knowledge management / RAG ), Multi-Modals (Vision/TTS/Plugins/Artifacts). One-click FREE deployment of your private ChatGPT/ Claude application.52,22511,3075491811,2272370 days, 8 hrs, 3 minsOtherTypeScript, MDX, JavaScript, Shell, Dockerfile, CSS, TeXhttps://github.com/lobehub/lobe-chat
12
oobaboogatext-generation-webuiA Gradio web UI for Large Language Models with support for multiple inference backends.41,8145,441239336563331 days, 5 hrs, 5 minsGNU Affero General Public License v3.0Python, CSS, JavaScript, Shell, Batchfile, Dockerfile, Jupyter Notebookhttps://github.com/oobabooga/text-generation-webui
13
vllm-projectvllmA high-throughput and memory-efficient inference and serving engine for LLMs34,8715,3221,642458462820 days, 8 hrs, 28 minsApache License 2.0Python, Cuda, C++, C, Shell, CMake, Dockerfilehttps://github.com/vllm-project/vllm
14
Mintplex-Labsanything-llmThe all-in-one Desktop & Docker AI application with built-in RAG, AI agents, and more.30,9783,1092179192312 days, 7 hrs, 38 minsMIT LicenseJavaScript, CSS, Dockerfile, HTML, Shell, HCLhttps://github.com/Mintplex-Labs/anything-llm
15
mudlerLocalAI:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference29,7642,240410120682050 days, 10 hrs, 46 minsMIT LicenseGo, Python, JavaScript, C++, HTML, Makefile, Shell, Dockerfile, CSS, CMake, C, Earthlyhttps://github.com/mudler/LocalAI
16
mckaywrigleychatbot-uiAI chat for any model.29,4108,217196470255177 days, 7 hrs, 54 minsMIT LicenseTypeScript, PLpgSQL, JavaScript, CSS, Shellhttps://github.com/mckaywrigley/chatbot-ui
17
janhqjanJan is an open source alternative to ChatGPT that runs 100% offline on your computer26,7851,54513560611490 days, 16 hrs, 28 minsGNU Affero General Public License v3.0TypeScript, JavaScript, SCSS, Makefile, Shell, Batchfile, Dockerfile, NSIShttps://github.com/janhq/jan
18
Bin-HuangchatboxUser-friendly Desktop Client App for AI Models/LLMs (GPT, Claude, Gemini, Ollama...)25,5902,51839834471603 days, 6 hrs, 25 minsGNU General Public License v3.0TypeScript, JavaScript, CSS, EJS, Shell, Dockerfilehttps://github.com/Bin-Huang/chatbox
19
Mozilla-OchollamafileDistribute and run LLMs with a single file.21,3911,106171473317821 days, 9 hrs, 42 minsOtherC++, C, JavaScript, Metal, Objective-C, AGS Script, Roff, HTML, Makefile, Python, Shell, Cuda, CSS, Batchfilehttps://github.com/Mozilla-Ocho/llamafile
20
danny-avilaLibreChatEnhanced ChatGPT Clone: Features Agents, Anthropic, AWS, OpenAI, Assistants API, Azure, Groq, o1, GPT-4o, Mistral, OpenRouter, Vertex AI, Gemini, Artifacts, AI model switching, message search, Code Interpreter, langchain, DALL-E-3, OpenAPI Actions, Functions, Secure Multi-User Auth, Presets, open-source for self-hosting. Active project.20,8763,523219176491320 days, 8 hrs, 30 minsMIT LicenseTypeScript, JavaScript, CSS, Handlebars, Shell, Python, HTML, Smarty, Dockerfilehttps://github.com/danny-avila/LibreChat
21
PromtEngineerlocalGPTChat with your documents on your local device using GPT models. No data leaves your device and 100% private.20,2682,26047944017082 days, 18 hrs, 38 minsApache License 2.0Python, HTML, Dockerfile, Roffhttps://github.com/PromtEngineer/localGPT
22
exo-exploreexoRun your own AI cluster at home with everyday devices 📱💻 🖥️⌚20,0261,13528048111530 days, 12 hrs, 1 minsGNU General Public License v3.0Python, JavaScript, HTML, CSS, Shellhttps://github.com/exo-explore/exo
23
mlc-aimlc-llmUniversal LLM Deployment Engine with ML Compilation19,7311,62722913411822 days, 11 hrs, 43 minsApache License 2.0Python, C++, Kotlin, Swift, Shell, Groovy, CMake, SCSS, Objective-C++, Java, HTML, Makefile, Objective-C, C, Batchfile, Rubyhttps://github.com/mlc-ai/mlc-llm
24
GaiZhenbiaoChuanhuChatGPTGUI for ChatGPT API and many LLMs. Supports agents, file-based QA, GPT finetuning and query with web search. All with a neat UI.15,3512,29212651268645 days, 17 hrs, 32 minsGNU General Public License v3.0Python, JavaScript, CSS, HTML, Shell, Dockerfile, Batchfilehttps://github.com/GaiZhenbiao/ChuanhuChatGPT
25
mlc-aiweb-llmHigh-performance In-browser LLM Inference Engine14,397930844511316 days, 0 hrs, 15 minsApache License 2.0TypeScript, SCSS, Shell, HTML, JavaScripthttps://github.com/mlc-ai/web-llm
26
h2oaih2ogptPrivate chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://gpt-docs.h2o.ai/11,6061,27330469215710 days, 23 hrs, 53 minsApache License 2.0Python, Jupyter Notebook, TeX, HTML, Shell, Groovy, Makefile, Smarty, Dockerfilehttps://github.com/h2oai/h2ogpt
27
bentomlOpenLLMRun any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud.10,4366611731134566 days, 9 hrs, 56 minsApache License 2.0Python, Shellhttps://github.com/bentoml/OpenLLM
28
chathub-devchathubAll-in-one chatbot client10,1101,04420512071101 days, 2 hrs, 29 minsGNU General Public License v3.0TypeScript, JavaScript, SCSS, HTML, CSShttps://github.com/chathub-dev/chathub
29
huggingfacetext-generation-inferenceLarge Language Model Text Generation Inference9,6431,129201131531030 days, 18 hrs, 12 minsApache License 2.0Python, Rust, Cuda, C++, Nix, Dockerfile, CMake, JavaScript, Shell, Makefile, Chttps://github.com/huggingface/text-generation-inference
30
SillyTavernSillyTavernLLM Frontend for Power Users.9,6252,63022119188640 days, 10 hrs, 20 minsGNU Affero General Public License v3.0JavaScript, HTML, CSS, Less, Jupyter Notebook, Batchfile, Dockerfile, Shell, Nixhttps://github.com/SillyTavern/SillyTavern
31
FMInferenceFlexGenRunning large language models on a single GPU for throughput-oriented scenarios.9,2545575819011291 days, 5 hrs, 28 minsApache License 2.0Python, Shellhttps://github.com/FMInference/FlexGen
32
NVIDIATensorRT-LLMTensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.9,2301,0814412012972 days, 12 hrs, 16 minsApache License 2.0C++, Python, Cuda, CMake, Shell, Smarty, PowerShell, C, Makefile, Dockerfilehttps://github.com/NVIDIA/TensorRT-LLM
33
triton-inference-serverserverThe Triton Inference Server provides an optimized cloud and edge inferencing solution.8,6351,513681123741470 days, 8 hrs, 13 minsBSD 3-Clause "New" or "Revised" LicensePython, Shell, C++, CMake, Java, Roff, Smarty, Dockerfilehttps://github.com/triton-inference-server/server
34
abetlenllama-cpp-pythonPython bindings for llama.cpp8,4711,022563163284786 days, 11 hrs, 38 minsMIT LicensePython, CMake, Shell, Dockerfile, Makefilehttps://github.com/abetlen/llama-cpp-python
35
huggingfacechat-uiOpen source codebase powering the HuggingChat app7,9511,17429412015842 days, 21 hrs, 29 minsApache License 2.0TypeScript, Svelte, JavaScript, Dockerfile, HTML, Shell, CSS, Smartyhttps://github.com/huggingface/chat-ui
36
natopenplaygroundAn LLM playground you can run on your laptop6,314487901506010 days, 4 hrs, 4 minsMIT LicenseTypeScript, Python, CSS, JavaScript, HTMLhttps://github.com/nat/openplayground
37
LostRuinskoboldcppRun GGUF models easily with a KoboldAI UI. One File. Zero Install.6,17339528946194671 days, 23 hrs, 43 minsGNU Affero General Public License v3.0C++, C, Cuda, Python, Objective-C, Metal, Beef, C#, Lua, D, Makefile, CMake, Jupyter Notebook, Shell, Batchfile, Nixhttps://github.com/LostRuins/koboldcpp
38
xorbitsaiinferenceReplace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.6,0544981858995451 days, 3 hrs, 13 minsApache License 2.0Python, JavaScript, CSS, Dockerfile, HTMLhttps://github.com/xorbitsai/inference
39
enricorosbig-agiAI suite powered by state-of-the-art models and providing advanced AI/AGI functions. It features AI personas, AGI functions, multi-model chats, text-to-image, voice, response streaming, code highlighting and execution, PDF import, presets for developers, much more. Deploy on-prem or in the cloud.5,8911,3622184616711 days, 14 hrs, 18 minsMIT LicenseTypeScript, JavaScript, CSS, Dockerfilehttps://github.com/enricoros/big-agi
40
simonwllmAccess large language models from the command-line5,7103242803439472 days, 13 hrs, 38 minsApache License 2.0Python, Just, Shellhttps://github.com/simonw/llm
41
InternLMlmdeployLMDeploy is a toolkit for compressing, deploying, and serving LLMs.5,3054673898943420 days, 23 hrs, 57 minsApache License 2.0Python, C++, Cuda, CMake, Shell, PowerShell, Dockerfile, Chttps://github.com/InternLM/lmdeploy
42
ParisNeolollms-webuiLord of Large Language and Multi modal Systems Web User Interface4,4685581633924630 days, 9 hrs, 59 minsApache License 2.0CSS, Vue, Python, JavaScript, Shell, Batchfile, Inno Setup, HTML, Jupyter Notebook, Dockerfilehttps://github.com/ParisNeo/lollms-webui
43
turboderpexllamav2A fast inference library for running LLMs locally on modern consumer-class GPUs3,87729310851383417 days, 21 hrs, 55 minsMIT LicensePython, Cuda, C++, Chttps://github.com/turboderp/exllamav2
44
minimaxirsimpleaichatPython package for easily interfacing with chat apps, with robust features and minimal code complexity.3,4992315511635207 days, 15 hrs, 59 minsMIT LicensePythonhttps://github.com/minimaxir/simpleaichat
45
deep-diverLLM-As-ChatbotLLM as a Chatbot Service3,297380197051433 days, 17 hrs, 59 minsApache License 2.0Python, Jupyter Notebookhttps://github.com/deep-diver/LLM-As-Chatbot
46
SciSharpLLamaSharpA C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.2,8443711445924565 days, 15 hrs, 32 minsMIT LicenseC#, JavaScript, HTML, CSShttps://github.com/SciSharp/LLamaSharp
47
turboderpexllamaA more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.2,8032216515037484 days, 13 hrs, 26 minsMIT LicensePython, Cuda, JavaScript, C++, CSS, Shell, HTML, Dockerfile, Chttps://github.com/turboderp/exllama
48
janhqnitroLocal AI API Platform2,35414411536168243 days, 20 hrs, 25 minsApache License 2.0C++, C, Python, Shell, Inno Setup, CMake, Dockerfile, Makefile, Batchfilehttps://github.com/janhq/nitro
49
janhqcortex.cppLocal AI API Platform2,35414411536168243 days, 20 hrs, 26 minsApache License 2.0C++, C, Python, Shell, Inno Setup, CMake, Dockerfile, Makefile, Batchfilehttps://github.com/janhq/cortex.cpp
50
n4ze3mpage-assistUse your locally running AI models to assist you in your web browsing1,8591821121632170 days, 18 hrs, 20 minsMIT LicenseTypeScript, CSS, HTML, JavaScripthttps://github.com/n4ze3m/page-assist
51
marellactransformersPython bindings for the Transformer models implemented in C/C++ using GGML library.1,83014011263018365 days, 0 hrs, 55 minsMIT LicenseC, C++, Cuda, Metal, Objective-C, Python, CMake, Shellhttps://github.com/marella/ctransformers
52
a-ghorbanipocketpal-aiAn app that brings language models directly to your phone.1,7241363979193 days, 12 hrs, 25 minsMIT LicenseTypeScript, Ruby, Kotlin, JavaScript, Objective-C, Objective-C++https://github.com/a-ghorbani/pocketpal-ai
53
Mobile-Artificial-IntelligencemaidMaid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.1,6291821822313283 days, 8 hrs, 33 minsMIT LicenseDart, C++, CMake, Shell, Ruby, Swift, C, Batchfile, Kotlin, Objective-Chttps://github.com/Mobile-Artificial-Intelligence/maid
54
ivanfioravantichatbot-ollamaChatbot Ollama is an open source chat UI for Ollama.1,531262247117174 days, 14 hrs, 15 minsOtherTypeScript, JavaScript, Dockerfile, CSS, Makefilehttps://github.com/ivanfioravanti/chatbot-ollama
55
guinmoonLLMFarmllama and other large language models on iOS and MacOS offline using GGML library.1,521102321332140 days, 23 hrs, 0 minsMIT LicenseSwift, Shellhttps://github.com/guinmoon/LLMFarm
56
ggozadoterma text-based terminal client for Ollama1,2207471544125 days, 14 hrs, 6 minsMIT LicensePythonhttps://github.com/ggozad/oterm
57
srushllama2.rsA fast llama2 decoder in pure Rust.1,03056154011424 days, 8 hrs, 32 minsMIT LicenseRust, Pythonhttps://github.com/srush/llama2.rs
58
semperaiamicaAmica is an open source interface for interactive communication with 3D characters with voice synthesis and speech recognition.85213513194175 days, 12 hrs, 49 minsMIT LicenseTypeScript, JavaScript, Shell, Dockerfile, Rust, HTML, CSShttps://github.com/semperai/amica
59
Vali-98ChatterUISimple frontend for LLMs built in react-native.8134717454143 days, 18 hrs, 25 minsGNU Affero General Public License v3.0TypeScript, JavaScripthttps://github.com/Vali-98/ChatterUI
60
mlc-aiweb-llm-chatChat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.5828113181075 days, 13 hrs, 22 minsApache License 2.0TypeScript, SCSS, CSS, JavaScript, Shell, Dockerfilehttps://github.com/mlc-ai/web-llm-chat
61
KoljaBLocalAIVoiceChatLocal AI talk with a custom voice based on Zephyr 7B model. Uses RealtimeSTT with faster_whisper for transcription and RealtimeTTS with Coqui XTTS for synthesis.56363112113167 days, 23 hrs, 36 minsOtherPython, Batchfilehttps://github.com/KoljaB/LocalAIVoiceChat
62
turboderpexuiWeb UI for ExLlamaV246644329092 days, 13 hrs, 3 minsMIT LicenseJavaScript, Python, CSS, HTMLhttps://github.com/turboderp/exui
63
withcataicataiRun AI ✨ assistant locally! with simple API for Node.js 🚀46231142510219 days, 15 hrs, 9 minsMIT LicenseTypeScript, Svelte, JavaScript, CSS, HTMLhttps://github.com/withcatai/catai
64
psugiharaFreeChatllama.cpp based AI chat app for macOS4534124401262 days, 15 hrs, 11 minsMIT LicenseSwift, MDX, TypeScript, CSS, JavaScript, Shellhttps://github.com/psugihara/FreeChat
65
pythopstenere🤖 TUI interface for LLMs written in Rust4431571013819 days, 0 hrs, 19 minsGNU General Public License v3.0Rust, Justhttps://github.com/pythops/tenere
66
cztomsikavaAll-in-one desktop app for running LLMs locally.43716330986 days, 11 hrs, 40 minsOtherTypeScript, Zig, Shell, JavaScript, HTMLhttps://github.com/cztomsik/ava
67
lmg-anonmikupadLLM Frontend in a single html file30932271164511 days, 17 hrs, 29 minsCreative Commons Zero v1.0 UniversalHTML, JavaScript, Batchfile, Shellhttps://github.com/lmg-anon/mikupad
68
run-llamachat-uiChat UI components for LLM apps1671105075 days, 23 hrs, 59 minsMIT LicenseTypeScript, CSS, JavaScripthttps://github.com/run-llama/chat-ui
69
ptsochantarisemeltalLocal ML voice chat using high-end models.15611110419 days, 10 hrs, 16 minsMIT LicenseC++, C, Metal, Objective-C, Swift, Shell, HTML, CSShttps://github.com/ptsochantaris/emeltal
70
ortegaalfredoneurochatNative gui to serveral AI services plus llama.cpp local AIs.108112165378 days, 15 hrs, 12 minsBSD 2-Clause "Simplified" LicensePascal, Inno Setup, Shellhttps://github.com/ortegaalfredo/neurochat
71
LostRuinslite.koboldai.netA zero dependency web UI for any LLM backend, including KoboldCpp, OpenAI and AI Horde97471422081 days, 22 hrs, 32 minsGNU Affero General Public License v3.0HTML, JavaScripthttps://github.com/LostRuins/lite.koboldai.net
72
nathanlesagelocal-chatLocalChat is a ChatGPT-like chat that runs on your computer9035112622 days, 20 hrs, 11 minsGNU General Public License v3.0TypeScript, Vue, JavaScript, Shell, HTML, CSShttps://github.com/nathanlesage/local-chat
73
elgatopanzongatogptLocal LLM inference & management server with built-in OpenAI API3130103282 days, 5 hrs, 21 minsGNU Affero General Public License v3.0C#, Dockerfilehttps://github.com/elgatopanzon/gatogpt
74
dbddv01GPT-SequencerA chatbot for local gguf llm models with easy sequencing via csv file. A toy tool for everyone to build advanced prompt engineering sequences.800103204 days, 18 hrs, 8 minsMIT LicensePythonhttps://github.com/dbddv01/GPT-Sequencer