GGUF models by RichardErkhov

14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
DA
DavidAU M Metaphors Of Madness 19.4B
Davidau · RichardErkhov
Params19.5B
Context32K
Q4_K_M11.7 GB
GGUF
LO
Ca lower_labels_r100_O2_f100_LT
Lower · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
MA
mamba-130m-hf
Mamba · RichardErkhov
Params129M
Context1024K
Q4_K_M0.1 GB
GGUF
LL
Ichigo Llama3.2 Base 1B T2S 2048c Epoch 3
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
BR
BroAlanTaps GPT2 large 4 60000steps
Broalantaps · RichardErkhov
Params839M
Context1K
Q4_K_M0.5 GB
GGUF
SO
Ko Solar 10.7b V0.2B
Solar · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.5 GB
GGUF
SM
SmolLM 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
QW
ehristoforu Qwen2 1.5b it bioinstruct
Qwen · RichardErkhov
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
LL
Lekhansh Llama 3.2 1B shallow
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
MI
CorticalStack mistral 7b openhermes sft
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
LL
NotASI FineTome Llama3.2 1B 0929
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
Llama 3.2 1B Instruct
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
ank028 Llama 3.2 1B Instruct gsm8k MGSM8K sft1 linear
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
GE
YuanZ77 gemma2b b
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
PY
Pythia 160m
Pythia · RichardErkhov
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
GE
Nidum Limitless Gemma 2B
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
LL
mlabonne llama 2 7b miniguanaco
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
OP
Openchat3.5_Korean_V1.0_Sft
Openchat · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
LL
MELT Llama 2 7b Chat v0.1
Llama · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
IN
interview eval zephyr 7b stem case 1
Interview · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
ihughes15234 phi 3 mini 500 combined 4
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
JO
Josephgflowers TinyLlama v1.1 math code world test 1
Josephgflowers · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
LL
OpenRLHF Llama 2 13b sft model ocra 500k
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
XU
XueyingJia pythia 1b stage1 online dpo SG sfairXC judge merge
Xueyingjia · RichardErkhov
Params1.01B
Context2K
Q4_K_M0.7 GB
GGUF
MI
mlfoundations dev hp ablations mistral scheduler constant dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
pantelis ninja unsloth Qwen2.5 3B Instruct dtype bfloat16 r 8 lr 0.0006
Qwen · RichardErkhov
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
MI
Mistral-7B-Discord-0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2.5 0.5B
Qwen · RichardErkhov
Params494M
Context32K
Q4_K_M0.4 GB
Tool use

Keep browsing