LLM package for Python

Command-line and python package to query Large Language Models

Your on-site private LLM tool

​

https://llm.datasette.io/en/stable/index.html#

Installation

Install this tool using pip: pip install llm

​

Plugin installation for 17 new models: llm install llm-gpt4all

Model list

OpenAI Chat: gpt-3.5-turbo (aliases: 3.5, chatgpt)

OpenAI Chat: gpt-3.5-turbo-16k (aliases: chatgpt-16k, 3.5-16k) OpenAI Chat: gpt-4 (aliases: 4, gpt4)

OpenAI Chat: gpt-4-32k (aliases: 4-32k)

OpenAI Chat: gpt-4-1106-preview OpenAI Chat: gpt-4-0125-preview

OpenAI Chat: gpt-4-turbo-preview (aliases: gpt-4-turbo, 4-turbo, 4t)

OpenAI Completion: gpt-3.5-turbo-instruct (aliases: 3.5-instruct, chatgpt-instruct) gpt4all: all-MiniLM-L6-v2-f16 - SBert, 43.76MB download, needs 1GB RAM (installed) gpt4all: orca-mini-3b-gguf2-q4_0 - Mini Orca (Small), 1.84GB download, needs 4GB RAM

(installed)

gpt4all: gpt4all-13b-snoozy-q4_0 - Snoozy, 6.86GB download, needs 16GB RAM (installed) gpt4all: replit-code-v1_5-3b-newbpe-q4_0 - Replit, 1.82GB download, needs 4GB RAM gpt4all: orca-2-7b - Orca 2 (Medium), 3.56GB download, needs 8GB RAM

gpt4all: rift-coder-v0-7b-q4_0 - Rift coder, 3.56GB download, needs 8GB RAM gpt4all: mpt-7b-chat-newbpe-q4_0 - MPT Chat, 3.64GB download, needs 8GB RAM

gpt4all: em_german_mistral_v01 - EM German Mistral, 3.83GB download, needs 8GB RAM gpt4all: mistral-7b-instruct-v0 - Mistral Instruct, 3.83GB download, needs 8GB RAM gpt4all: mistral-7b-openorca - Mistral OpenOrca, 3.83GB download,

needs 8GB RAM

gpt4all: gpt4all-falcon-newbpe-q4_0 - GPT4All Falcon, 3.92GB download, needs 8GB RAM gpt4all: wizardlm-13b-v1 - Wizard v1.2, 6.86GB download, needs 16GB RAM

gpt4all: orca-2-13b - Orca 2 (Full), 6.86GB download, needs 16GB RAM

gpt4all: nous-hermes-llama2-13b - Hermes, 6.86GB download, needs 16GB RAM gpt4all: starcoder-newbpe-q4_0 - Starcoder, 8.37GB download, needs 4GB RAM

Sample usages

>llm -m mistral-7b-openorca 'translate "tasty nudlles" to bulgarian ' -o max_tokens 9999999 "вкусни макарони"

​

llm -m mistral-7b-openorca 'explain innovation with exactly

24 words ' -o max_tokens 9999999

​

Innovation is the process of creating new ideas, products, or services that improve existing solutions and create value. It involves thinking creatively, taking risks, learning from failures, and adapting to change.

Sample usages

llm -m mistral-7b-openorca 'generate a novell where Witchers and Jedi

fight together against invaders from other dimension ' -o max_tokens 9999999

​

” In the distant future, two great forces of good were brought together by fate to save their worlds. The Witchers, skilled warriors trained in the

art of combat and magic, hailing from the realm of Rivia, joined forces with the Jedi Knights, masters of the Force and guardians of peace and justice across the galaxy.

​

Their mission was to protect their realms against an unknown threat that had breached both dimensions. The invaders were a mysterious force, originating from another dimension altogether….”

​

440 words

Model options

gpt4all: mistral-7b-openorca - Mistral OpenOrca, 3.83GB download, needs 8GB RAM (installed) max_tokens: int

temp: float top_k: int top_p: float

repeat_penalty: float repeat_last_n: int n_batch: int

DIMO MICHEV

THANK YOU!

E-mail: dimo.michev@siriusart.bg