GGUF models by RichardErkhov

14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
ZE
zephyr-7b-dpo-full-prompt-extend-chosen-delete_0.5
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BR
broalantap GPT2 large 4 44000steps
Broalantap · RichardErkhov
Params839M
Context1K
Q4_K_M0.5 GB
GGUF
PH
amod plnyr Phi 3.5 mini quote planName SFT PLNYR
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
TR
Tristan dclm fasttext oh eli5 410m
Tristan · RichardErkhov
Params405M
Context2K
Q4_K_M0.3 GB
GGUF
RR
rrajvoyxa tinyllama helpdesk lang it v4
Rrajvoyxa · RichardErkhov
Params1.1B
Context32K
Q4_K_M0.7 GB
GGUF
ML
mlfoundations dev oh v1.3 opengpt x.5
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
NotASI Qwen2 0.5B Math
Qwen · RichardErkhov
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
GO
google codegemma 2b
Google · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
LL
jan hq Llama3.1 s instruct 2024 09 09 cp 1000
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MI
Mistral 7B Base SFT DPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
bunnycore Phi 3.5 Mini Sonet RP V2
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
Roleplay
MI
mlfoundations dev hp ablations mistral adambeta2 0.98 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama-2-7b-dolphin-open_platypus-pruned_70
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GP
Gpt2Finetuned
Gpt · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
TI
TinyAlpaca-1.1B
Tinyalpaca · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
RJ1200 llama 31b question
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
ML
mlfoundations dev oh v1 2 only metamath
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
OpenPipe mistral ft optimized 1218
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TI
TinyLlama-1.1B-intermediate-step-480k-1T
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LG
lgaalves gpt2 platypus dolly guanaco
Lgaalves · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
OP
OpenELM 3B SFT D_chosen HuggingFaceH4 Ultrafeedback_Binarized Xlarge
Openelm · RichardErkhov
Params3.04B
Context2K
Q4_K_M1.9 GB
GGUF
LL
llama2-7b-hf-guanaco
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
HA
Hastagaras L3.2 JametMini 3B MK.III
Hastagaras · RichardErkhov
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
GE
nooynoos gemma2 2b M.O.M gemma sprint
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
AN
anthonymeo full train
Anthonymeo · RichardErkhov
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
KA
karthikeyan r calculation model 6k
Karthikeyan · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
RE
RedPajama-INCITE-Chat-3B-Instruction-Tuning-with-GPT-4
Redpajama · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
AE
aetherwiing MN 12B Starcannon v2
Aetherwiing · RichardErkhov
Params12.2B
Context1000K
Q4_K_M3.4 GB
GGUF
LL
omniquad del llama3.2 text sql fp16 merged v1.1
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
OpenRLHF Llama 2 7b sft model ocra 500k
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF

Keep browsing