GGUF models by RichardErkhov
14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.
LL
grimjim Llama 3 Instruct demi merge 8B
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
MV
mvpmaster NeuralDareDMistralPro 7b slerp
Mvpmaster · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
aifeifei798 DarkIdol Llama 3.1 8B Instruct 1.0 Uncensored
Llama · RichardErkhov
Params8B
Context—
Q4_K_M0.0 GB
QW
gte-Qwen2-7B-instruct
Qwen · RichardErkhov
Params7.61B
Context128K
Q4_K_M4.7 GB
PH
chrisob94 phi 3 7b dissertation doc chat experiment 10 fold
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
LL
Llama-3-8B-Instruct-64k
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
JP
jpacifico Chocolatine 14B Instruct 4k DPO
Jpacifico · RichardErkhov
Params14B
Context4K
Q4_K_M8.6 GB
ST
L3-8B-Stheno-v3.2
Stheno · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
MA
Matter 0.1 7B Boost
Matter · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
AR
arcee ai Saul Instruct Clown 7b
Arcee · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
PE
PersianMind v1.0
Persianmind · RichardErkhov
Params6.8B
Context2K
Q4_K_M4.1 GB
GR
grimjim kunoichi lemon royale 7B
Grimjim · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
UM
Umbra-v3-MoE-4x11b-2ex
Umbra · RichardErkhov
Params36.1B
Context32K
Q4_K_M21.8 GB
DA
Dart Math Dsmath 7b Prop2Diff
Dart · RichardErkhov
Params6.89B
Context4K
Q4_K_M4.2 GB
JS
jsfs11 MixtureofMerges MoE 2x7bRP v8
Jsfs · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
GR
granite-7b-base
Granite · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
LL
Llama3 8b It Translation Sharegpt En Ko
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
MI
grimjim Mistral Starling merge trial3 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
hf 100 Llama 3.1 Spellbound StoryWriter 0.1 vllm 16bit
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
CH
Chunky-Lemon-Cookie-11B
Chunky · RichardErkhov
Params10.7B
Context32K
Q4_K_M6.5 GB
QW
Qwen2.5 Coder 7B Instruct Abliterated
Qwen · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
SZ
szymonrucinski Curie 7B v1
Szymonrucinski · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
EV
Evolutionstory
Evolutionstory · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
TI
Tinystories Lay8 Hs512 Hd8 33M
Tinystories · RichardErkhov
Params165M
Context512
Q4_K_M0.1 GB
LL
Llama-3-8B-grammar-correction
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
LL
ORLM LLaMA 3 8B
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen2.5 7B Instruct Abliterated
Qwen · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
MI
K2S3 Mistral 7b v1.4
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
IC
ichigoberry MonarchPipe 7B slerp
Ichigoberry · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 Coder 7B Instruct
Qwen · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB