GGUF models by RichardErkhov

14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
FR
frameai ChatFrame Instruct Persian Small
Frameai · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
SO
SOLAR 10.7B Merge Dpo
Solar · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SU
suehyunpark potpourri 8b inst fft induction bc trajectory max10 per task check answer
Suehyunpark · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MI
OpenMia Indo Mistral 7b v3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BR
Breeze 7B Base V0_1
Breeze · RichardErkhov
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF
BI
bikkibhagya93 gita text generation gpt2
Bikkibhagya · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
LL
meta llama Llama 2 13b chat hf
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MR
MrRobotoAI Hathor v3
Mrrobotoai · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PY
Pythia 410m Deduped v0
Pythia · RichardErkhov
Params405M
Context2K
Q4_K_M0.3 GB
GGUF
JA
Japanese Stablelm Instruct Gamma 7b
Japanese · RichardErkhov
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
MI
Mistral7B PairRM SPPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
hiaoxui Llama3.1 20M
Llama · RichardErkhov
Params20M
Context—
Q4_K_M0.0 GB
GGUF
GE
Gemma 2 2b
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
SI
siree921 gita text generation gpt2
Siree · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
LL
FrancescoBuda Llama ICD coder 3B merged 1ep
Llama · RichardErkhov
Params3.21B
Context128K
Q4_K_M2.0 GB
CodingTool use
MI
K2S3 Mistral 7b v1.47
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
QW
Qwen 2.5 3b Evol CoT
Qwen · RichardErkhov
Params3.4B
Context32K
Q4_K_M2.1 GB
Tool use
MI
Mistral Instruct DPO Y24 v2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PY
Pythia 1b Sft Hh
Pythia · RichardErkhov
Params1.01B
Context2K
Q4_K_M0.7 GB
GGUF
LL
Llama 3.2 1B
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
MI
Locutusque Hyperion 2.1 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mlfoundations dev hp ablations mistral scheduler cosine warmup0.05 minlr1e 7
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BL
Bloom 7b1
Bloom · RichardErkhov
Params8.1B
Context4K
Q4_K_M5.3 GB
GGUF
PH
Phi 3 Mini 4k Instruct Dpo
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
AL
AlphaMist7B Slr v4 Slow
Alphamist · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HO
Holarissun gpt2 sft tldr
Holarissun · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
MI
mlfoundations dev hp ablations mistral lr2e 6 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
microsoft Phi 3 medium 4k instruct
Phi · RichardErkhov
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
GI
Giraffe-v2-70b-32k
Giraffe · RichardErkhov
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
DE
Srijith rkr deepseek base 1e 3 NO cot all samples 300 ckpt
DeepSeek · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF

Keep browsing