GGUF models by TheBloke

1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
triadparty_deepmoney-34b-200k-chat-evaluator
Deepmoney · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
PU
PuddleJumper 13B V2
Puddlejumper · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MY
MysticFusion 13B
Mysticfusion · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
NE
abideen_nexonimbus-7b
Nexonimbus · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
ShiningValiant 1.3
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
SU
ariellee_superplatty-30b
Superplatty · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
HE
HermesLimaRP L2 7B
Hermeslimarp · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
Tool use
MI
nondzu_mistral-7b-codealpaca-lora
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
PI
ddh0_pirouette-7b
Pirouette · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AE
Aetheria L2 70B
Aetheria · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
UN
UndiMix v2 13B
Undimix · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LE
leolm_leo-hessianai-13b-chat
Leo · TheBloke
Params13B
Context8K
Q4_K_M7.9 GB
GGUF
AI
airoboros l2 13B 2.2.1
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SY
synthia-70b-v1.1
Synthia · TheBloke
Params69B
Context2K
Q4_K_M41.4 GB
GGUF
LL
LLaMA2 13B Tiefighter
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
openaccess-ai-collective_minotaur-13b-fixed
Minotaur · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
TE
Tess 10.7B v1.5b
Tess · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
MX
MXLewdMini L2 13B
Mxlewdmini · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GU
timdettmers_guanaco-33b-merged
Guanaco · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
FI
adaptllm_finance-llm-13b
Finance · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
CH
austism_chronos-hermes-13b
Chronos · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
Tool use
TI
abdgrt_tinyllama-2-1b-miniguanaco
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
yeen214_llama2_7b_merge_orcafamily
Llama · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
SY
migtissera_synthia-7b-v1.5
Synthia · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
WI
WizardMath 13B V1.0
Wizardmath · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
DE
deepsex 34b
Deepsex · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
Roleplay
MI
nousresearch_yarn-mistral-7b-64k
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LU
Luban 13B
Luban · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ST
Stheno Inverted L2 13B
Stheno · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GE
rijgersberg_geitje-7b-chat
Geitje · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing