GGUF models by RichardErkhov

14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
AI
airophin-13b-pntk-16k-fp16
Airophin · RichardErkhov
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
ED
EditCoder 6.7b v1
Editcoder · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
Finance Llama3 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
arshadshk Mistral Hinglish 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
LDCC Instruct Llama 2 Ko 13B v4.1.12
Llama · RichardErkhov
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
YI
NousResearch Nous Hermes 2 Yi 34B
Yi · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
Tool use
MA
Masterjp123 SnowyRP FinalV1 L2 13B
Masterjp · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
DJ
djuna L3.1 Boshima b FIX calc
Djuna · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
NE
Nekomata 14b Instruction
Nekomata · RichardErkhov
Params14.2B
Context8K
Q4_K_M9.4 GB
GGUF
ML
mlfoundations dev oh v1 w v3 alpaca threshold90 it
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
mistralai Mistral 7B v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AH
ahnyeonchan legendary river koalpaca
Ahnyeonchan · RichardErkhov
Params1.42B
Context4K
Q4_K_M0.9 GB
GGUF
RE
reflect_llm8B_Om2SftT2_Om2G8kOm2AgIpsdpIter1T02_b0.1
Reflect · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MI
Mistral 7b Dpo Merge v1.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BL
Bloom 560m
Bloom · RichardErkhov
Params816M
Context1K
Q4_K_M0.6 GB
GGUF
QW
Qwen2.5 0.5B
Qwen · RichardErkhov
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
LL
Llama 3.2 1B Instruct Zh De Upload
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
Llama 3 Base 8B SFT ORPO
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 3B Instruct SFT D_chosen Pref Mix8
Llama · RichardErkhov
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
ME
Merged RP Stew V2 34B
Merged · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
Roleplay
MI
shleeeee mistral ko exo wiki quiz v1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
JP
jpacifico Chocolatine 3B Instruct DPO Revised
Jpacifico · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
YA
Yaram gita text generation gpt2
Yaram · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
MI
Hercules 3.0 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SW
Swallow 7b Hf
Swallow · RichardErkhov
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
MI
Mistralai Mistral 7B Instruct v0.3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
LL
ragbox Llama 3 Open Ko 8B Instruct hr test 241209
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
CL
ClaudeRitchie tinyllama vels v1
Clauderitchie · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
Llama-3.1-8B-Mistral-7B-v0.1-mix
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.2 3B Thai Toxic Det
Llama · RichardErkhov
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use

Keep browsing