ABCDEFGHIJKLM
1
OwnerRepository NameAboutStarsForksIssuesContributorsReleasesWatchersTime Since Last CommitLicenseLanguagesURL
2
huggingfacetransformers🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.129,09225,6021,1704331551,1170 days, 8 hrs, 0 minsApache License 2.0Python, Cuda, Dockerfile, Shell, C++, C, Makefile, Cython, Jsonnethttps://github.com/huggingface/transformers
3
ollamaollamaGet up and running with Llama 3, Mistral, Gemma 2, and other large language models.77,9105,8961,141242724670 days, 10 hrs, 3 minsMIT LicenseGo, C, Shell, PowerShell, TypeScript, Dockerfile, Inno Setup, Python, Objective-C, CSS, JavaScript, HTMLhttps://github.com/ollama/ollama
4
ChatGPTNextWebChatGPT-Next-WebA cross-platform ChatGPT/Gemini UI (Web / PWA / Linux / Win / MacOS). 一键拥有你自己的跨平台 ChatGPT/Gemini 应用。72,82757,828345189614060 days, 11 hrs, 7 minsMIT LicenseTypeScript, SCSS, JavaScript, Shell, Dockerfile, Rusthttps://github.com/ChatGPTNextWeb/ChatGPT-Next-Web
5
nomic-aigpt4allGPT4All: Chat with Local LLMs on Any Device67,2207,399494107176380 days, 18 hrs, 49 minsMIT LicenseC++, QML, Python, CMake, JavaScript, C, Shell, Qt Script, Makefile, Batchfile, PowerShell, CSShttps://github.com/nomic-ai/gpt4all
6
binary-huskygpt_academic为GPT/GLM等LLM大语言模型提供实用化交互接口，特别优化论文阅读/润色/写作体验，模块化设计，支持自定义快捷按钮&函数插件，支持Python和C++等项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持chatglm3等本地模型。接入通义千问, deepseekcoder, 讯飞星火, 文心一言, llama2, rwkv, claude2, moss等。61,5597,66529085292561 days, 16 hrs, 5 minsGNU General Public License v3.0Python, JavaScript, HTML, CSS, Dockerfilehttps://github.com/binary-husky/gpt_academic
7
ggerganovllama.cppLLM inference in C/C++61,4948,7935464722,0835220 days, 8 hrs, 2 minsMIT LicenseC++, C, Cuda, Python, Metal, Objective-C, Shell, CMake, Makefile, Nix, Dockerfile, Swift, Batchfile, JavaScripthttps://github.com/ggerganov/llama.cpp
8
xtekkygpt4freeThe official gpt4free repository | various collection of powerful language models59,20413,174302081414610 days, 21 hrs, 36 minsGNU General Public License v3.0Python, JavaScript, CSS, HTML, Dockerfile, Shellhttps://github.com/xtekky/gpt4free
9
imartinezprivateGPTInteract with your documents using the power of GPT, 100% privately, no data leaks52,9357,1152308274532 days, 9 hrs, 56 minsApache License 2.0Python, MDX, Makefilehttps://github.com/imartinez/privateGPT
10
oobaboogatext-generation-webuiA Gradio web UI for Large Language Models.38,2925,076183317443261 days, 4 hrs, 52 minsGNU Affero General Public License v3.0Python, CSS, JavaScript, Shell, Batchfile, Jupyter Notebook, Dockerfilehttps://github.com/oobabooga/text-generation-webui
11
lobehublobe-chat🤯 Lobe Chat - an open-source, modern-design LLMs/AI chat framework. Supports Multi AI Providers( OpenAI / Claude 3 / Gemini / Ollama / Bedrock / Azure / Mistral / Perplexity ), Multi-Modals (Vision/TTS) and plugin system. One-click FREE deployment of your private ChatGPT chat application.35,1118,2533581237421760 days, 8 hrs, 37 minsOtherTypeScript, JavaScript, CSS, Dockerfilehttps://github.com/lobehub/lobe-chat
12
open-webuiopen-webuiUser-friendly WebUI for LLMs (Formerly Ollama WebUI)30,8893,375127171391700 days, 12 hrs, 54 minsMIT LicenseSvelte, Python, TypeScript, Shell, CSS, Dockerfile, JavaScript, HTML, Batchfile, Mako, Makefilehttps://github.com/open-webui/open-webui
13
mckaywrigleychatbot-uiAI chat for every model.27,3907,6041554702453 days, 6 hrs, 23 minsMIT LicenseTypeScript, PLpgSQL, JavaScript, CSS, Shellhttps://github.com/mckaywrigley/chatbot-ui
14
vllm-projectvllmA high-throughput and memory-efficient inference and serving engine for LLMs22,7353,2021,393397302060 days, 8 hrs, 22 minsApache License 2.0Python, Cuda, C++, Shell, CMake, Dockerfile, Chttps://github.com/vllm-project/vllm
15
mudlerLocalAI:robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.21,7861,66632999521580 days, 9 hrs, 2 minsMIT LicenseC++, Go, Python, JavaScript, HTML, Makefile, Shell, Dockerfile, CSS, CMake, Earthlyhttps://github.com/mudler/LocalAI
16
janhqjanJan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)20,8681,19717351251210 days, 9 hrs, 25 minsGNU Affero General Public License v3.0TypeScript, Python, JavaScript, SCSS, Makefile, Dockerfile, Batchfile, NSIS, Shellhttps://github.com/janhq/jan
17
Bin-HuangchatboxUser-friendly Desktop Client App for AI Models/LLMs (GPT, Claude, Gemini, Ollama...)19,8002,01630628621242 days, 5 hrs, 4 minsGNU General Public License v3.0TypeScript, JavaScript, CSS, EJS, Shell, Dockerfilehttps://github.com/Bin-Huang/chatbox
18
PromtEngineerlocalGPTChat with your documents on your local device using GPT models. No data leaves your device and 100% private.19,6132,19347242016413 days, 12 hrs, 18 minsApache License 2.0Python, HTML, Dockerfile, Roffhttps://github.com/PromtEngineer/localGPT
19
mlc-aimlc-llmUniversal LLM Deployment Engine with ML Compilation17,7561,41115211711690 days, 13 hrs, 9 minsApache License 2.0Python, C++, Swift, Kotlin, Shell, Groovy, CMake, SCSS, Objective-C++, Java, HTML, Makefile, Objective-C, C, Batchfile, Rubyhttps://github.com/mlc-ai/mlc-llm
20
Mintplex-Labsanything-llmThe all-in-one Desktop & Docker AI application with full RAG and AI Agent capabilities.17,2161,8481325301400 days, 16 hrs, 52 minsMIT LicenseJavaScript, CSS, Dockerfile, HTML, Shell, HCLhttps://github.com/Mintplex-Labs/anything-llm
21
Mozilla-OchollamafileDistribute and run LLMs with a single file.16,95984210243241555 days, 6 hrs, 34 minsOtherC++, C, Metal, Objective-C, AGS Script, Roff, HTML, Python, Makefile, Shell, JavaScript, Batchfile, Cudahttps://github.com/Mozilla-Ocho/llamafile
22
danny-avilaLibreChatEnhanced ChatGPT Clone: Features OpenAI, Assistants API, Azure, Groq, GPT-4 Vision, Mistral, Bing, Anthropic, OpenRouter, Vertex AI, Gemini, AI model switching, message search, langchain, DALL-E-3, ChatGPT Plugins, OpenAI Functions, Secure Multi-User System, Presets, completely open-source for self-hosting. More features in development15,3672,555106133431130 days, 9 hrs, 40 minsMIT LicenseTypeScript, JavaScript, CSS, Handlebars, Shell, Python, HTML, Dockerfilehttps://github.com/danny-avila/LibreChat
23
GaiZhenbiaoChuanhuChatGPTGUI for ChatGPT API and many LLMs. Supports agents, file-based QA, GPT finetuning and query with web search. All with a neat UI.15,0112,27711750228413 days, 3 hrs, 40 minsGNU General Public License v3.0Python, JavaScript, CSS, HTML, Shell, Dockerfile, Batchfilehttps://github.com/GaiZhenbiao/ChuanhuChatGPT
24
mlc-aiweb-llmHigh-performance In-browser LLM Inference Engine11,767734533511120 days, 15 hrs, 26 minsApache License 2.0TypeScript, SCSS, Shell, HTML, JavaScripthttps://github.com/mlc-ai/web-llm
25
h2oaih2ogptPrivate chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://codellama.h2o.ai/10,9681,1992596621560 days, 9 hrs, 57 minsApache License 2.0Python, Jupyter Notebook, TeX, HTML, Shell, Groovy, Makefile, Smarty, Dockerfilehttps://github.com/h2oai/h2ogpt
26
chathub-devchathubAll-in-one chatbot client9,772979306120698 days, 6 hrs, 11 minsGNU General Public License v3.0TypeScript, JavaScript, SCSS, HTML, CSShttps://github.com/chathub-dev/chathub
27
bentomlOpenLLMRun any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.9,2885926030121530 days, 10 hrs, 23 minsApache License 2.0Python, Shellhttps://github.com/bentoml/OpenLLM
28
FMInferenceFlexGenRunning large language models on a single GPU for throughput-oriented scenarios.9,0765285718010882 days, 22 hrs, 31 minsApache License 2.0Python, Shellhttps://github.com/FMInference/FlexGen
29
huggingfacetext-generation-inferenceLarge Language Model Text Generation Inference8,36794812910245960 days, 8 hrs, 8 minsApache License 2.0Python, Rust, Cuda, C++, Dockerfile, JavaScript, Makefile, C, Shellhttps://github.com/huggingface/text-generation-inference
30
triton-inference-serverserverThe Triton Inference Server provides an optimized cloud and edge inferencing solution.7,7511,423543113681390 days, 10 hrs, 9 minsBSD 3-Clause "New" or "Revised" LicensePython, Shell, C++, CMake, Java, Roff, Smarty, Dockerfilehttps://github.com/triton-inference-server/server
31
NVIDIATensorRT-LLMTensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.7,441803659136851 days, 8 hrs, 26 minsApache License 2.0C++, Python, Cuda, CMake, Shell, Smarty, PowerShell, C, Makefile, Dockerfilehttps://github.com/NVIDIA/TensorRT-LLM
32
abetlenllama-cpp-pythonPython bindings for llama.cpp7,175850419145227661 days, 21 hrs, 15 minsMIT LicensePython, CMake, Dockerfile, Shell, Makefilehttps://github.com/abetlen/llama-cpp-python
33
SillyTavernSillyTavernLLM Frontend for Power Users.6,8062,01331912782610 days, 10 hrs, 32 minsGNU Affero General Public License v3.0JavaScript, HTML, CSS, Less, Jupyter Notebook, Batchfile, Shell, Dockerfile, Nixhttps://github.com/SillyTavern/SillyTavern
34
huggingfacechat-uiOpen source codebase powering the HuggingChat app6,7879592438812780 days, 8 hrs, 31 minsApache License 2.0TypeScript, Svelte, Dockerfile, JavaScript, HTML, Shell, CSS, Smartyhttps://github.com/huggingface/chat-ui
35
natopenplaygroundAn LLM playground you can run on your laptop6,15647886160611 days, 8 hrs, 53 minsMIT LicenseTypeScript, Python, CSS, JavaScript, HTMLhttps://github.com/nat/openplayground
36
enricorosbig-agiGenerative AI suite powered by state-of-the-art models and providing advanced AI/AGI functions. It features AI personas, AGI functions, multi-model chats, text-to-image, voice, response streaming, code highlighting and execution, PDF import, presets for developers, much more. Deploy on-prem or in the cloud.4,8341,0941614116560 days, 8 hrs, 5 minsMIT LicenseTypeScript, JavaScript, CSS, Dockerfilehttps://github.com/enricoros/big-agi
37
LostRuinskoboldcppA simple one-file way to run various GGML and GGUF models with KoboldAI's UI4,38631822746981630 days, 9 hrs, 21 minsGNU Affero General Public License v3.0C++, C, Cuda, Python, Metal, Objective-C, Lua, Makefile, CMake, Shell, Batchfile, Jupyter Notebookhttps://github.com/LostRuins/koboldcpp
38
ParisNeolollms-webuiLord of Large Language Models Web User Interface4,0725151423821600 days, 18 hrs, 32 minsApache License 2.0Vue, Python, CSS, JavaScript, Shell, Batchfile, HTML, Inno Setup, Jupyter Notebook, Dockerfilehttps://github.com/ParisNeo/lollms-webui
39
xorbitsaiinferenceReplace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.3,6453043995769370 days, 9 hrs, 5 minsApache License 2.0Python, JavaScript, CSS, Dockerfile, HTMLhttps://github.com/xorbitsai/inference
40
simonwllmAccess large language models from the command-line3,4891812071925341 days, 20 hrs, 23 minsApache License 2.0Python, Just, Shellhttps://github.com/simonw/llm
41
minimaxirsimpleaichatPython package for easily interfacing with chat apps, with robust features and minimal code complexity.3,43022555116368 days, 1 hrs, 31 minsMIT LicensePythonhttps://github.com/minimaxir/simpleaichat
42
InternLMlmdeployLMDeploy is a toolkit for compressing, deploying, and serving LLMs.3,2872932225929310 days, 8 hrs, 11 minsApache License 2.0Python, C++, Cuda, CMake, Shell, Dockerfile, C, PowerShellhttps://github.com/InternLM/lmdeploy
43
deep-diverLLM-As-ChatbotLLM as a Chatbot Service3,258381197054234 days, 3 hrs, 31 minsApache License 2.0Python, Jupyter Notebookhttps://github.com/deep-diver/LLM-As-Chatbot
44
turboderpexllamav2A fast inference library for running LLMs locally on modern consumer-class GPUs3,240239734027330 days, 18 hrs, 53 minsMIT LicensePython, Cuda, C++, Chttps://github.com/turboderp/exllamav2
45
turboderpexllamaA more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.2,6692136615035284 days, 22 hrs, 55 minsMIT LicensePython, Cuda, JavaScript, C++, CSS, Shell, HTML, Dockerfile, Chttps://github.com/turboderp/exllama
46
SciSharpLLamaSharpA C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.2,2793031145018510 days, 18 hrs, 13 minsMIT LicenseC#, JavaScript, Metal, HTML, CSShttps://github.com/SciSharp/LLamaSharp
47
janhqnitroDrop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM, ONNX). Powers 👋 Jan1,77797563095140 days, 8 hrs, 37 minsApache License 2.0C++, TypeScript, C, CMake, Makefile, Shell, Python, Dockerfile, JavaScript, Batchfile, Inno Setuphttps://github.com/janhq/nitro
48
marellactransformersPython bindings for the Transformer models implemented in C/C++ using GGML library.1,75413710863019165 days, 10 hrs, 25 minsMIT LicenseC, C++, Cuda, Metal, Objective-C, Python, CMake, Shellhttps://github.com/marella/ctransformers
49
ivanfioravantichatbot-ollamaChatbot Ollama is an open source chat UI for Ollama.1,27821220611682 days, 7 hrs, 59 minsOtherTypeScript, JavaScript, Dockerfile, CSS, Makefilehttps://github.com/ivanfioravanti/chatbot-ollama
50
guinmoonLLMFarmllama and other large language models on iOS and MacOS offline using GGML library.1,0636412129151 days, 2 hrs, 2 minsMIT LicenseSwift, Shellhttps://github.com/guinmoon/LLMFarm
51
Mobile-Artificial-IntelligencemaidMaid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.1,0339831530231 days, 11 hrs, 41 minsMIT LicenseDart, C++, CMake, Shell, Ruby, Swift, C, Batchfile, Kotlin, Objective-Chttps://github.com/Mobile-Artificial-Intelligence/maid
52
srushllama2.rsA fast llama2 decoder in pure Rust.99654134010224 days, 18 hrs, 3 minsMIT LicenseRust, Pythonhttps://github.com/srush/llama2.rs
53
n4ze3mpage-assistUse your locally running AI models to assist you in your web browsing8779857911102 days, 23 hrs, 36 minsMIT LicenseTypeScript, CSS, HTML, JavaScripthttps://github.com/n4ze3m/page-assist
54
ggozadoterma text-based terminal client for Ollama85644109181150 days, 0 hrs, 14 minsMIT LicensePythonhttps://github.com/ggozad/oterm
55
semperaiamicaAmica is an open source interface for interactive communication with 3D characters with voice synthesis and speech recognition.5889244164150 days, 11 hrs, 16 minsMIT LicenseTypeScript, JavaScript, Shell, Dockerfile, Rust, HTML, CSShttps://github.com/semperai/amica
56
withcataicataiRun AI ✨ assistant locally! with simple API for Node.js 🚀4282714251020 days, 0 hrs, 37 minsMIT LicenseTypeScript, Svelte, JavaScript, CSS, HTMLhttps://github.com/withcatai/catai
57
psugiharaFreeChatllama.cpp based AI chat app for macOS4023421401014 days, 0 hrs, 49 minsMIT LicenseSwift, MDX, TypeScript, CSS, JavaScript, Shellhttps://github.com/psugihara/FreeChat
58
KoljaBLocalAIVoiceChatLocal AI talk with a custom voice based on Zephyr 7B model. Uses RealtimeSTT with faster_whisper for transcription and RealtimeTTS with Coqui XTTS for synthesis.39739921836 days, 4 hrs, 10 minsOtherPython, Batchfilehttps://github.com/KoljaB/LocalAIVoiceChat
59
turboderpexuiWeb UI for ExLlamaV2397322770831 days, 22 hrs, 5 minsMIT LicenseJavaScript, Python, CSS, HTMLhttps://github.com/turboderp/exui
60
cztomsikavaAll-in-one desktop app for running LLMs locally.37116930963 days, 21 hrs, 2 minsOtherTypeScript, Zig, HTML, Shell, Swift, JavaScript, C++, Chttps://github.com/cztomsik/ava
61
pythopstenere🔥 TUI interface for LLMs written in Rust26891712730 days, 8 hrs, 9 minsGNU General Public License v3.0Rust, Justhttps://github.com/pythops/tenere
62
Vali-98ChatterUISimple frontend for LLMs built in react-native.18813532427 days, 15 hrs, 3 minsGNU Affero General Public License v3.0TypeScript, JavaScripthttps://github.com/Vali-98/ChatterUI
63
lmg-anonmikupadLLM Frontend in a single html file1732420102241 days, 15 hrs, 59 minsCreative Commons Zero v1.0 UniversalHTML, JavaScript, Batchfile, Shellhttps://github.com/lmg-anon/mikupad
64
mlc-aiweb-llm-chatChat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.130237180033 days, 12 hrs, 10 minsApache License 2.0TypeScript, SCSS, CSS, JavaScript, Shell, Dockerfilehttps://github.com/mlc-ai/web-llm-chat
65
ptsochantarisemeltalLocal ML voice chat using high-end models.1256010215 days, 22 hrs, 57 minsMIT LicenseC, C++, Metal, Swift, Objective-C, HTML, CSS, Shellhttps://github.com/ptsochantaris/emeltal
66
ortegaalfredoneurochatNative gui to serveral AI services plus llama.cpp local AIs.9391165179 days, 0 hrs, 42 minsBSD 2-Clause "Simplified" LicensePascal, Inno Setup, Shellhttps://github.com/ortegaalfredo/neurochat
67
LostRuinslite.koboldai.netA zero dependency web UI for KoboldAI Horde6130916070 days, 9 hrs, 53 minsGNU Affero General Public License v3.0HTML, JavaScripthttps://github.com/LostRuins/lite.koboldai.net
68
nathanlesagelocal-chatLocalChat is a ChatGPT-like chat that runs on your computer5914112574 days, 3 hrs, 10 minsGNU General Public License v3.0TypeScript, Vue, JavaScript, Shell, HTML, CSShttps://github.com/nathanlesage/local-chat
69
elgatopanzongatogptLocal LLM inference & management server with built-in OpenAI API313010382 days, 14 hrs, 54 minsGNU Affero General Public License v3.0C#, Dockerfilehttps://github.com/elgatopanzon/gatogpt
70
dbddv01GPT-SequencerA chatbot for local gguf llm models with easy sequencing via csv file. A toy tool for everyone to build advanced prompt engineering sequences.7001035 days, 3 hrs, 41 minsMIT LicensePythonhttps://github.com/dbddv01/GPT-Sequencer