GGUF models by RichardErkhov
14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.
ZE
zephyr-7b-dpo-full-prompt-extend-chosen-delete_0.5
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
BR
broalantap GPT2 large 4 44000steps
Broalantap · RichardErkhov
Params839M
Context1K
Q4_K_M0.5 GB
PH
amod plnyr Phi 3.5 mini quote planName SFT PLNYR
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
TR
Tristan dclm fasttext oh eli5 410m
Tristan · RichardErkhov
Params405M
Context2K
Q4_K_M0.3 GB
RR
rrajvoyxa tinyllama helpdesk lang it v4
Rrajvoyxa · RichardErkhov
Params1.1B
Context32K
Q4_K_M0.7 GB
ML
mlfoundations dev oh v1.3 opengpt x.5
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
NotASI Qwen2 0.5B Math
Qwen · RichardErkhov
Params494M
Context32K
Q4_K_M0.4 GB
GO
google codegemma 2b
Google · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
jan hq Llama3.1 s instruct 2024 09 09 cp 1000
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
Mistral 7B Base SFT DPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
bunnycore Phi 3.5 Mini Sonet RP V2
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
MI
mlfoundations dev hp ablations mistral adambeta2 0.98 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama-2-7b-dolphin-open_platypus-pruned_70
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GP
Gpt2Finetuned
Gpt · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
TI
TinyAlpaca-1.1B
Tinyalpaca · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
RJ1200 llama 31b question
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
ML
mlfoundations dev oh v1 2 only metamath
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
OpenPipe mistral ft optimized 1218
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
TI
TinyLlama-1.1B-intermediate-step-480k-1T
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
LG
lgaalves gpt2 platypus dolly guanaco
Lgaalves · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
OP
OpenELM 3B SFT D_chosen HuggingFaceH4 Ultrafeedback_Binarized Xlarge
Openelm · RichardErkhov
Params3.04B
Context2K
Q4_K_M1.9 GB
LL
llama2-7b-hf-guanaco
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
HA
Hastagaras L3.2 JametMini 3B MK.III
Hastagaras · RichardErkhov
Params3.21B
Context128K
Q4_K_M2.0 GB
GE
nooynoos gemma2 2b M.O.M gemma sprint
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
AN
anthonymeo full train
Anthonymeo · RichardErkhov
Params1.89B
Context32K
Q4_K_M1.2 GB
KA
karthikeyan r calculation model 6k
Karthikeyan · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
RE
RedPajama-INCITE-Chat-3B-Instruction-Tuning-with-GPT-4
Redpajama · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.8 GB
AE
aetherwiing MN 12B Starcannon v2
Aetherwiing · RichardErkhov
Params12.2B
Context1000K
Q4_K_M3.4 GB
LL
omniquad del llama3.2 text sql fp16 merged v1.1
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
OpenRLHF Llama 2 7b sft model ocra 500k
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB