GGUF models by RichardErkhov
14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.
AI
airophin-13b-pntk-16k-fp16
Airophin · RichardErkhov
Params13B
Context16K
Q4_K_M7.9 GB
ED
EditCoder 6.7b v1
Editcoder · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
Finance Llama3 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
arshadshk Mistral Hinglish 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
LDCC Instruct Llama 2 Ko 13B v4.1.12
Llama · RichardErkhov
Params13B
Context2K
Q4_K_M7.9 GB
YI
NousResearch Nous Hermes 2 Yi 34B
Yi · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
MA
Masterjp123 SnowyRP FinalV1 L2 13B
Masterjp · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
DJ
djuna L3.1 Boshima b FIX calc
Djuna · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
NE
Nekomata 14b Instruction
Nekomata · RichardErkhov
Params14.2B
Context8K
Q4_K_M9.4 GB
ML
mlfoundations dev oh v1 w v3 alpaca threshold90 it
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
mistralai Mistral 7B v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
AH
ahnyeonchan legendary river koalpaca
Ahnyeonchan · RichardErkhov
Params1.42B
Context4K
Q4_K_M0.9 GB
RE
reflect_llm8B_Om2SftT2_Om2G8kOm2AgIpsdpIter1T02_b0.1
Reflect · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
Mistral 7b Dpo Merge v1.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
BL
Bloom 560m
Bloom · RichardErkhov
Params816M
Context1K
Q4_K_M0.6 GB
QW
Qwen2.5 0.5B
Qwen · RichardErkhov
Params494M
Context32K
Q4_K_M0.4 GB
LL
Llama 3.2 1B Instruct Zh De Upload
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Llama 3 Base 8B SFT ORPO
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.2 3B Instruct SFT D_chosen Pref Mix8
Llama · RichardErkhov
Params3.21B
Context128K
Q4_K_M2.0 GB
ME
Merged RP Stew V2 34B
Merged · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
MI
shleeeee mistral ko exo wiki quiz v1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
JP
jpacifico Chocolatine 3B Instruct DPO Revised
Jpacifico · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
YA
Yaram gita text generation gpt2
Yaram · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
MI
Hercules 3.0 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
SW
Swallow 7b Hf
Swallow · RichardErkhov
Params6.83B
Context4K
Q4_K_M4.1 GB
MI
Mistralai Mistral 7B Instruct v0.3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
LL
ragbox Llama 3 Open Ko 8B Instruct hr test 241209
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
CL
ClaudeRitchie tinyllama vels v1
Clauderitchie · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
Llama-3.1-8B-Mistral-7B-v0.1-mix
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.2 3B Thai Toxic Det
Llama · RichardErkhov
Params3.21B
Context128K
Q4_K_M2.0 GB