GGUF models by RichardErkhov

14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
HE
Heejindo rationale model e10
Heejindo · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
mlfoundations dev llama3 1 8b oh dcft v1 wo camel chemistry gpt 4o mini
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MA
MathCoder L 7B
Mathcoder · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
Coding
LL
CodeLlama 7b Hf
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
MA
MarcusCosta Sumarizadors
Marcuscosta · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
QW
thirdeyeai qwen2.5 .5b uncensored
Qwen · RichardErkhov
Params630M
Context32K
Q4_K_M0.5 GB
GGUF
GE
General Persona Chatbot v1 09 09 24
General · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral_7Bx4_MOE_24B
Mistral · RichardErkhov
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
LG
lgaalves gpt2 guanaco dolly platypus
Lgaalves · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
CH
ChenWeiLi MedLlama 3 8B DARE
Chenweili · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
BR
BroAlanTaps GPT2 large 128 20000steps
Broalantaps · RichardErkhov
Params838M
Context1K
Q4_K_M0.5 GB
GGUF
LL
Llama-2-7b-sft-model-ocra-500k
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
LL
akshit Gupta llamaitnew merged FinetunedByAG
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
Llama 3.1 SauerkrautLM 8b Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-MAAL-8B-Instruct-v0.1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PH
amod plnyr Phi 3.5 mini quote planName SFT v2
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
KA
karthikeyan r slm custom model 20k pt
Karthikeyan · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
LL
Raj Maharajwala Open Insurance LLM Llama3 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PH
grounded ai phi3.5 hallucination judge merge
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
Llama3 8b It Prometheus Ko
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
CodeLlama 7b Instruct Hf
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
Llama 3.2 1B Instruct Gsm8K
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
MI
cloudyu Mixtral 7Bx2 MoE 13B
Mistral · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
LL
Llama 3.1 8B InitializedEmbeddings_with_Hermes 3
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
EmbeddingTool use
SA
SambaLingo Arabic Chat
Sambalingo · RichardErkhov
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
MI
arnavgrg mistral 7b nf4 fp16 upscaled
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AR
ArianAskari SOLID SFT DPO MixQV3 SOLIDChosen SFTRejected Zephyr 7b beta
Arianaskari · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
KSU HW SEC Deepseek SFT RL Text DFG
DeepSeek · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF

Keep browsing