GGUF models by RichardErkhov

14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
IN
InternLM2
InternLM · RichardErkhov
Params19.9B
Context8K
Q4_K_M12.0 GB
GGUF
MI
InnerI InnerILLM OpenPipe Nous Yarn Mistral optimized 1228 7B slerp
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BR
BroAlanTaps GPT2 large 128 46000steps
Broalantaps · RichardErkhov
Params838M
Context1K
Q4_K_M0.5 GB
GGUF
MI
Moriacrafter Mistral 7B v0.2 none DepressionDetection Reddit
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
JI
JiuZhang3.0 Synthesis 7B
Jiuzhang · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
MI
EleutherAI Mistral 7B v0.1 population first ft
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Yarn-Mistral-7b-128k-DPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Meta Llama 3 8B Instruct
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
Google Gemma 2 9b It
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MI
OpenHermes 2.5 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
RE
reflect_llm8B_Om2SftT1-Om2IpsdpG8kIpsdpIter1T1_b0.1
Reflect · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.2 Adr Full Model
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
mlfoundations dev llama2 oh teknium scaling down random 0.8
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
ME
mergekit community mergekit slerp janrfan
Mergekit · RichardErkhov
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 ELYZA JP 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
mlfoundations dev llama3 1 8b oh v3.1 wo unnatural instructions
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
JeloH qwen textgen model9
Qwen · RichardErkhov
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
LL
Llama 2 13b Hf
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
llama2-7b-chat-hf-guanaco
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama3.1 8B ShiningValiant2
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
EE
EEVE Korean 10.8B RAFT
Eeve · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
PH
Phi 3.5 Mini Instruct SFT D_chosen Orca Skywork Capybara Infinity Mid
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
LL
gajesh llama 3 2 1b instruct eigentuned
Llama · RichardErkhov
Params14M
Context—
Q4_K_M0.0 GB
GGUF
LL
ToolLlama Llama 3 8B
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh v3 1 only evol instruct 70k
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
GI
GitBag reasoning rebel iter 2 1731041913 eta 1e3 lr 3e 7 1731243878
Gitbag · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
Reasoning
MI
Nexus IKM Mistral Instruct v0.2 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
Gemma 2 2b
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
WE
Web Chunk Refining Lm
Web · RichardErkhov
Params354M
Context2K
Q4_K_M0.2 GB
GGUF
OM
omnineura omni OpenELM finetune llm1
Omnineura · RichardErkhov
Params3.04B
Context2K
Q4_K_M1.9 GB
GGUF

Keep browsing