GGUF models by RichardErkhov

14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
ihughes15234 llama 3 1 8bi tictactoe dpo5epoch v3
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
IN
InfinityKumon 2x7B
Infinitykumon · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
BL
Bloomz 7b1 Mt Sft Chat
Bloomz · RichardErkhov
Params8.1B
Context4K
Q4_K_M5.3 GB
GGUF
OP
OpenELM 1_1B DPO Full 1 5
Openelm · RichardErkhov
Params1.08B
Context2K
Q4_K_M0.7 GB
GGUF
SA
SauerkrautLM SOLAR Instruct
Sauerkrautlm · RichardErkhov
Params10.7B
Context8K
Q4_K_M6.5 GB
GGUF
SY
SyntheticMoist-11B-v2
Syntheticmoist · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
IN
InternLM2
InternLM · RichardErkhov
Params7.74B
Context8K
Q4_K_M4.7 GB
GGUF
LL
DevsDoCode LLama 3 8b Uncensored
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Youko 8b En Ja MT LoRA
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
VA
Value4AI ValueLlama 3 8B
Value · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Chinese 8b Instruct v2
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
mlfoundations dev hp ablations mistral scheduler cosine warmup0.10 minlr1e 7
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
muzammil eds Meta Llama 3.1 8B Instruct English to French v3
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MI
dolphin-2.1-mistral-7b-snr-laser
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
LL
nkpz llama2 22b chronos alpaca experiment1
Llama · RichardErkhov
Params21.8B
Context4K
Q4_K_M13.2 GB
GGUF
SM
Smollm2 135m Bootleg Instruct04
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
BL
Bloom 7b1
Bloom · RichardErkhov
Params8.1B
Context4K
Q4_K_M5.3 GB
GGUF
PU
pushpendrasingh21 gpt2 medical chatbot1
Pushpendrasingh · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
GE
Kitsunebi v1 Gemma2 8k 9B
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
TH
thanhtunguet gpt2 address standardizer prompted
Thanhtunguet · RichardErkhov
Params406M
Context1K
Q4_K_M0.3 GB
GGUF
SP
SparseLLM ReluLLaMA 13B
Sparsellm · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
OP
OpenLLM Ro RoMistral 7b Instruct
Openllm · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
sujithatz finbot phi 3.5 mini instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
BR
BroAlanTaps GPT2 large 128 12000steps
Broalantaps · RichardErkhov
Params838M
Context1K
Q4_K_M0.5 GB
GGUF
MI
Mistral 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AL
Alphacode-MALI-11B_slowtest
Alphacode · RichardErkhov
Params10.9B
Context32K
Q4_K_M6.6 GB
GGUF
IN
InnovationHacksAI tkgcore
Innovationhacksai · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CO
CodeV DS 6.7B
Codev · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
MI
CorticalStack mistral 7b openhermes 2.5 sft
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
GE
Gemma 2 9b
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF

Keep browsing