GGUF models by RichardErkhov
14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.
DA
DataPilot ArrowPro 7B KUJIRA
Datapilot · RichardErkhov
Params7.24B
Context4K
Q4_K_M4.4 GB
LL
Llama3 8B Aifeifei 1.0
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
SA
Saul 7B Base
Saul · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
AH
Ahma 3B Instruct
Ahma · RichardErkhov
Params3.63B
Context2K
Q4_K_M2.8 GB
SA
SakanaAI EvoLLM JP A v1 7B
Sakanaai · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
HO
hooking dev sexyGPT Uncensored
Hooking · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
CA
cais Zephyr RMU
Cais · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
jointpreferences mistral 7b sft helpful
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
VanillaKD Pretrain Qwen 200M
Qwen · RichardErkhov
Params203M
Context32K
Q4_K_M0.2 GB
IN
MD Judge V0_2 Internlm2_7B
InternLM · RichardErkhov
Params7.74B
Context32K
Q4_K_M4.7 GB
CH
chujiezheng tulu 2 dpo 13b ExPO
Chujiezheng · RichardErkhov
Params13B
Context8K
Q4_K_M7.9 GB
SA
Salamandra 2b
Salamandra · RichardErkhov
Params2.25B
Context8K
Q4_K_M1.5 GB
GE
Gargaz gemma 2b romanian better
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
NE
NexaAIDev Octopus v2
Nexaaidev · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
Cendol Llama2 13b Merged
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
CR
crackthejob codingLLM
Crackthejob · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
TI
TinyLlama-1.1B-step-50K-105b
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
Na0s Llama 3.1 8B Pruned 4 Layers LoRA PEFT 3.0
Llama · RichardErkhov
Params6.94B
Context128K
Q4_K_M4.3 GB
LL
winglian llama 3 8b 256k PoSE
Llama · RichardErkhov
Params8.03B
Context512K
Q4_K_M4.9 GB
BR
Breeze-7B-Base-v1_0
Breeze · RichardErkhov
Params7.49B
Context32K
Q4_K_M4.5 GB
QW
Qwen2.5 Coder 7B
Qwen · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Josiefied Qwen2.5 7B Instruct Abliterated v2
Qwen · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
GE
GeM2 Llamion 14B Base
Gem · RichardErkhov
Params14.5B
Context4K
Q4_K_M8.8 GB
YI
Yi-1.5-9B-Chat-16K
Yi · RichardErkhov
Params8.83B
Context16K
Q4_K_M5.3 GB
AR
archangel_sft_pythia2-8b
Archangel · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.8 GB
QW
Qwen2.5 14B Instruct Abliterated
Qwen · RichardErkhov
Params14.8B
Context32K
Q4_K_M9.0 GB
KA
kalisai Nusantara 2.7b Indo Chat
Kalisai · RichardErkhov
Params2.65B
Context8K
Q4_K_M1.7 GB
LL
AIML GEEK advanced promptv2 finetuned CodeLlama7b Instruct
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
GE
google gemma 2b
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GP
gpt2-xl
Gpt · RichardErkhov
Params1.64B
Context1K
Q4_K_M1.2 GB