GGUF models by RichardErkhov

14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
DA
DataPilot ArrowPro 7B KUJIRA
Datapilot · RichardErkhov
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
LL
Llama3 8B Aifeifei 1.0
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SA
Saul 7B Base
Saul · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AH
Ahma 3B Instruct
Ahma · RichardErkhov
Params3.63B
Context2K
Q4_K_M2.8 GB
GGUF
SA
SakanaAI EvoLLM JP A v1 7B
Sakanaai · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HO
hooking dev sexyGPT Uncensored
Hooking · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
CA
cais Zephyr RMU
Cais · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
jointpreferences mistral 7b sft helpful
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
VanillaKD Pretrain Qwen 200M
Qwen · RichardErkhov
Params203M
Context32K
Q4_K_M0.2 GB
GGUF
IN
MD Judge V0_2 Internlm2_7B
InternLM · RichardErkhov
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
CH
chujiezheng tulu 2 dpo 13b ExPO
Chujiezheng · RichardErkhov
Params13B
Context8K
Q4_K_M7.9 GB
GGUF
SA
Salamandra 2b
Salamandra · RichardErkhov
Params2.25B
Context8K
Q4_K_M1.5 GB
GGUF
GE
Gargaz gemma 2b romanian better
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
NE
NexaAIDev Octopus v2
Nexaaidev · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
LL
Cendol Llama2 13b Merged
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CR
crackthejob codingLLM
Crackthejob · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
TI
TinyLlama-1.1B-step-50K-105b
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
Na0s Llama 3.1 8B Pruned 4 Layers LoRA PEFT 3.0
Llama · RichardErkhov
Params6.94B
Context128K
Q4_K_M4.3 GB
GGUF
LL
winglian llama 3 8b 256k PoSE
Llama · RichardErkhov
Params8.03B
Context512K
Q4_K_M4.9 GB
GGUF
BR
Breeze-7B-Base-v1_0
Breeze · RichardErkhov
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF
QW
Qwen2.5 Coder 7B
Qwen · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
QW
Josiefied Qwen2.5 7B Instruct Abliterated v2
Qwen · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
GE
GeM2 Llamion 14B Base
Gem · RichardErkhov
Params14.5B
Context4K
Q4_K_M8.8 GB
GGUF
YI
Yi-1.5-9B-Chat-16K
Yi · RichardErkhov
Params8.83B
Context16K
Q4_K_M5.3 GB
GGUF
AR
archangel_sft_pythia2-8b
Archangel · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
QW
Qwen2.5 14B Instruct Abliterated
Qwen · RichardErkhov
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
KA
kalisai Nusantara 2.7b Indo Chat
Kalisai · RichardErkhov
Params2.65B
Context8K
Q4_K_M1.7 GB
GGUF
LL
AIML GEEK advanced promptv2 finetuned CodeLlama7b Instruct
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
GE
google gemma 2b
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GP
gpt2-xl
Gpt · RichardErkhov
Params1.64B
Context1K
Q4_K_M1.2 GB
GGUF

Keep browsing