GGUF models by RichardErkhov
14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.
DA
DavidAU M Metaphors Of Madness 19.4B
Davidau · RichardErkhov
Params19.5B
Context32K
Q4_K_M11.7 GB
LO
Ca lower_labels_r100_O2_f100_LT
Lower · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
MA
mamba-130m-hf
Mamba · RichardErkhov
Params129M
Context1024K
Q4_K_M0.1 GB
LL
Ichigo Llama3.2 Base 1B T2S 2048c Epoch 3
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
BR
BroAlanTaps GPT2 large 4 60000steps
Broalantaps · RichardErkhov
Params839M
Context1K
Q4_K_M0.5 GB
SO
Ko Solar 10.7b V0.2B
Solar · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.5 GB
SM
SmolLM 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
QW
ehristoforu Qwen2 1.5b it bioinstruct
Qwen · RichardErkhov
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
Lekhansh Llama 3.2 1B shallow
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
MI
CorticalStack mistral 7b openhermes sft
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
NotASI FineTome Llama3.2 1B 0929
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Llama 3.2 1B Instruct
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
ank028 Llama 3.2 1B Instruct gsm8k MGSM8K sft1 linear
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
GE
YuanZ77 gemma2b b
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
PY
Pythia 160m
Pythia · RichardErkhov
Params162M
Context2K
Q4_K_M0.1 GB
GE
Nidum Limitless Gemma 2B
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
mlabonne llama 2 7b miniguanaco
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
OP
Openchat3.5_Korean_V1.0_Sft
Openchat · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
LL
MELT Llama 2 7b Chat v0.1
Llama · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
IN
interview eval zephyr 7b stem case 1
Interview · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
ihughes15234 phi 3 mini 500 combined 4
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
JO
Josephgflowers TinyLlama v1.1 math code world test 1
Josephgflowers · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
OpenRLHF Llama 2 13b sft model ocra 500k
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama 3.2 1B Instruct
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
XU
XueyingJia pythia 1b stage1 online dpo SG sfairXC judge merge
Xueyingjia · RichardErkhov
Params1.01B
Context2K
Q4_K_M0.7 GB
MI
mlfoundations dev hp ablations mistral scheduler constant dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
pantelis ninja unsloth Qwen2.5 3B Instruct dtype bfloat16 r 8 lr 0.0006
Qwen · RichardErkhov
Params3.09B
Context32K
Q4_K_M1.9 GB
MI
Mistral-7B-Discord-0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 0.5B
Qwen · RichardErkhov
Params494M
Context32K
Q4_K_M0.4 GB