GGUF models by TheBloke
1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.
DE
triadparty_deepmoney-34b-200k-chat-evaluator
Deepmoney · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
PU
PuddleJumper 13B V2
Puddlejumper · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MY
MysticFusion 13B
Mysticfusion · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
NE
abideen_nexonimbus-7b
Nexonimbus · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
ShiningValiant 1.3
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
SU
ariellee_superplatty-30b
Superplatty · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
HE
HermesLimaRP L2 7B
Hermeslimarp · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
MI
nondzu_mistral-7b-codealpaca-lora
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
PI
ddh0_pirouette-7b
Pirouette · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
AE
Aetheria L2 70B
Aetheria · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
UN
UndiMix v2 13B
Undimix · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LE
leolm_leo-hessianai-13b-chat
Leo · TheBloke
Params13B
Context8K
Q4_K_M7.9 GB
AI
airoboros l2 13B 2.2.1
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
SY
synthia-70b-v1.1
Synthia · TheBloke
Params69B
Context2K
Q4_K_M41.4 GB
LL
LLaMA2 13B Tiefighter
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MI
openaccess-ai-collective_minotaur-13b-fixed
Minotaur · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
TE
Tess 10.7B v1.5b
Tess · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
MX
MXLewdMini L2 13B
Mxlewdmini · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GU
timdettmers_guanaco-33b-merged
Guanaco · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
FI
adaptllm_finance-llm-13b
Finance · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
CH
austism_chronos-hermes-13b
Chronos · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
TI
abdgrt_tinyllama-2-1b-miniguanaco
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
yeen214_llama2_7b_merge_orcafamily
Llama · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
SY
migtissera_synthia-7b-v1.5
Synthia · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
WI
WizardMath 13B V1.0
Wizardmath · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
DE
deepsex 34b
Deepsex · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
MI
nousresearch_yarn-mistral-7b-64k
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
LU
Luban 13B
Luban · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
ST
Stheno Inverted L2 13B
Stheno · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GE
rijgersberg_geitje-7b-chat
Geitje · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB