GGUF models by RichardErkhov

14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Vbd Llama2 7B 50b Chat
Llama · RichardErkhov
Params6.88B
Context4K
Q4_K_M4.2 GB
GGUF
MI
mlfoundations dev hp ablations mistral epoch2 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mlfoundations dev hp ablations mistral bsz1024
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DA
Dans Archive Dans MysteryModel 13b
Dans · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen2.5 3B Instruct
Qwen · RichardErkhov
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
LL
jamesohe Llama3 CAS Audit8B GCNI V3
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Mistral Mcqa Circuit Broken
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ML
mlfoundations dev oh v1.3 camel chemistry x4
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
GE
Gemma 2b It SFT D1_chosen Orca
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
LL
Llama 3.2 1B Instruct De
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
NI
NIyengar doct qna finetune gpt2
Niyengar · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
RE
reflect_llm8B_Om2SftT2_Om2G8kOm2AgBlcIpsdpIter1T02_b0.1
Reflect · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
QW
Qwen2 0.5B Instruct
Qwen · RichardErkhov
Params630M
Context32K
Q4_K_M0.5 GB
GGUF
MI
DeepKarkhanis Mistral Passthrough 8L 10B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Neural-grok-dolphin-Mistral-7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
StarCoder
StarCoder · RichardErkhov
Params164M
Context8K
Q4_K_M0.1 GB
Coding
PH
Phi 3 Mini 128k Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
HA
harkov000 hermes dolphin 8B
Harkov · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MI
mlfoundations dev hp ablations mistral scheduler cosine warmup0.10 minlr5e 7 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mlfoundations dev hp ablations mistral bsz1024 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CH
ChaoticNeutrals Poppy Porpoise v0.6 L3 8B
Chaoticneutrals · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
sonthenguyen NeuralHermes 2.5 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
LL
Llama 3.2 3b It Ecommerce ChatBot
Llama · RichardErkhov
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
JO
JOSIEv4o 8b Stage1 Beta1
Josiev · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
IL
ilsp Meltemi 7B v1
Ilsp · RichardErkhov
Params7.48B
Context32K
Q4_K_M4.5 GB
GGUF
GE
Gemma 2 Baku 2b It
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
leniachat-qwen2-1.5B-v0
Qwen · RichardErkhov
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
LL
abhinand Llama 3 Galen 8B 32k v1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ON
Only Nvidia_12684
Only · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Qwen2.5 Math 7B Instruct
Qwen · RichardErkhov
Params7.62B
Context4K
Q4_K_M4.7 GB
Tool use

Keep browsing