GGUF models by TheBloke
1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.
GE
em german 70b v01
German · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
NO
ddh0_norocetacean-20b-10k
Norocetacean · TheBloke
Params20B
Context10K
Q4_K_M12.0 GB
TO
undi95_toppy-m-7b
Toppy · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
XW
xwin-lm_xwincoder-34b
Xwincoder · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
NE
mlabonne_neuralquant-9b
Neuralquant · TheBloke
Params8.99B
Context32K
Q4_K_M5.4 GB
AI
uukuguy_airoboros-m-7b-3.1.2-dare-0.85
Airoboros · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
em german 13b v01
German · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
ST
StableBeluga 13B
Stablebeluga · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MI
cgato_thespis-mistral-7b-alpha-v0.7
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
JA
JanniesBasedLigma L2 13B
Janniesbasedligma · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MI
openbuddy_openbuddy-mixtral-8x7b-v15.2
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.5 GB
AQ
AquilaChat2 34B
Aquilachat · TheBloke
Params33.7B
Context4K
Q4_K_M20.3 GB
LL
meta-llama-65b
Llama · TheBloke
Params65.3B
Context2K
Q4_K_M39.3 GB
MI
openbuddy_openbuddy-mistral-7b-v13-base
Mistral · TheBloke
Params7.28B
Context32K
Q4_K_M4.4 GB
LL
SunsetBoulevard
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
AI
jondurbin_airoboros-m-7b-3.0
Airoboros · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
SQ
sqlcoder2
Sqlcoder · TheBloke
Params15.8B
Context8K
Q4_K_M10.0 GB
GO
GodziLLa2 70B
Godzilla · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
PY
Pygmalion 2 13B SuperCOT weighed
Pygmalion · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
NE
mlabonne_neuralpipe-9b-merged
Neuralpipe · TheBloke
Params8.99B
Context32K
Q4_K_M5.4 GB
UL
UltraLM 13B v2.0
Ultralm · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
ML
MLewd v2.4 13B
Mlewd · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama 2 PeanutButter v19 R8 7B
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
MI
migtissera_synthia-7b
Migtissera · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
MI
ilyagusev_saiga_mistral_7b_merged
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
FL
FlatOrcamaid 13B v0.2
Flatorcamaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
PE
perlthoughts_chupacabra-7b-v3
Perlthoughts · TheBloke
Params7.24B
Context16K
Q4_K_M4.4 GB
IA
Iambe RP cDPO 20B
Iambe · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
CH
chronos007 70B
Chronos · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
LL
yayi2 30B llama
Llama · TheBloke
Params30.4B
Context4K
Q4_K_M18.2 GB