GGUF models by RichardErkhov
14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.
PY
PygmalionAI pygmalion 2 7b
Pygmalionai · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
ZE
zephyr-7b-gpo-final-i0
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
BR
BroAlanTaps GPT2 large 4 42000steps
Broalantaps · RichardErkhov
Params839M
Context1K
Q4_K_M0.5 GB
IN
inflatebot G2 9B Blackout R1
Inflatebot · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
DE
KSU HW SEC Deepseek SFT RL Text AST
DeepSeek · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
BR
braindao iq code evmind 0.5b instruct v0.2411.2
Braindao · RichardErkhov
Params494M
Context32K
Q4_K_M0.4 GB
MI
Mistral Instruct Y24 v6
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
SM
SmolLM 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
GE
Gemma 2b It
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
MI
mistral-60m
Mistral · RichardErkhov
Params60M
Context4K
Q4_K_M0.0 GB
LL
Preethi 1995 Llama 3 8B Instruct SQUAD RAG
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen2 0.5Bchp 15k
Qwen · RichardErkhov
Params494M
Context128K
Q4_K_M0.4 GB
RY
RyanYr reflect llm8B om2 mstlrg300k460kLlm33130k SftDpo0to20kIpsdp20to40kT1 b0.5
Ryanyr · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
BA
BanglaLLM BanglaLLama 3 8b BnWiki Instruct
Banglallm · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
DI
Digest0703 test llm
Digest · RichardErkhov
Params3.21B
Context128K
Q4_K_M2.0 GB
DE
Srijith rkr deepseek base 1e 4 NO cot all samples 3 epoch
DeepSeek · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB
TE
TeeZee DarkForest 20B v2.0
Teezee · RichardErkhov
Params20B
Context4K
Q4_K_M0.4 GB
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
QW
QwQ-CoT-0.5B-JA-v0.2
Qwen · RichardErkhov
Params494M
Context32K
Q4_K_M0.4 GB
IN
interview eval zephyr 7b math case 6 ep1
Interview · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GP
gpt2-medium
Gpt · RichardErkhov
Params406M
Context1K
Q4_K_M0.3 GB
LL
ncsgobubble Llama 7B rollercoaster v2
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
QW
Qwen Qwen 1 8B Chat
Qwen · RichardErkhov
Params1.84B
Context8K
Q4_K_M1.2 GB
PH
disi unibo nlp phi3 SFT medqa triples cot
Phi · RichardErkhov
Params3.82B
Context16K
Q4_K_M2.3 GB
IN
interview eval zephyr 7b stem case 3
Interview · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
MinaMila llama 3 InstBase adult ImpFeat 10ep withsex
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama-2-7b-hf-2bit-64rank
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
QW
Qwen2.5 3B Instruct
Qwen · RichardErkhov
Params3.09B
Context32K
Q4_K_M1.9 GB
GE
Gemma 2 2b It Translation General1.2M En Ko E1 B16 Trc313Eval45 E1 B16
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
CH
chatdb natural sql 7b
Chatdb · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB