GGUF models by TheBloke

1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
em german 70b v01
German · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
NO
ddh0_norocetacean-20b-10k
Norocetacean · TheBloke
Params20B
Context10K
Q4_K_M12.0 GB
GGUF
TO
undi95_toppy-m-7b
Toppy · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
XW
xwin-lm_xwincoder-34b
Xwincoder · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
NE
mlabonne_neuralquant-9b
Neuralquant · TheBloke
Params8.99B
Context32K
Q4_K_M5.4 GB
GGUF
AI
uukuguy_airoboros-m-7b-3.1.2-dare-0.85
Airoboros · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
em german 13b v01
German · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ST
StableBeluga 13B
Stablebeluga · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
cgato_thespis-mistral-7b-alpha-v0.7
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
JA
JanniesBasedLigma L2 13B
Janniesbasedligma · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
openbuddy_openbuddy-mixtral-8x7b-v15.2
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.5 GB
GGUF
AQ
AquilaChat2 34B
Aquilachat · TheBloke
Params33.7B
Context4K
Q4_K_M20.3 GB
GGUF
LL
meta-llama-65b
Llama · TheBloke
Params65.3B
Context2K
Q4_K_M39.3 GB
GGUF
MI
openbuddy_openbuddy-mistral-7b-v13-base
Mistral · TheBloke
Params7.28B
Context32K
Q4_K_M4.4 GB
GGUF
LL
SunsetBoulevard
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
AI
jondurbin_airoboros-m-7b-3.0
Airoboros · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SQ
sqlcoder2
Sqlcoder · TheBloke
Params15.8B
Context8K
Q4_K_M10.0 GB
Coding
GO
GodziLLa2 70B
Godzilla · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
PY
Pygmalion 2 13B SuperCOT weighed
Pygmalion · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
NE
mlabonne_neuralpipe-9b-merged
Neuralpipe · TheBloke
Params8.99B
Context32K
Q4_K_M5.4 GB
GGUF
UL
UltraLM 13B v2.0
Ultralm · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ML
MLewd v2.4 13B
Mlewd · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama 2 PeanutButter v19 R8 7B
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MI
migtissera_synthia-7b
Migtissera · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
MI
ilyagusev_saiga_mistral_7b_merged
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FL
FlatOrcamaid 13B v0.2
Flatorcamaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
PE
perlthoughts_chupacabra-7b-v3
Perlthoughts · TheBloke
Params7.24B
Context16K
Q4_K_M4.4 GB
GGUF
IA
Iambe RP cDPO 20B
Iambe · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
Roleplay
CH
chronos007 70B
Chronos · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
Roleplay
LL
yayi2 30B llama
Llama · TheBloke
Params30.4B
Context4K
Q4_K_M18.2 GB
GGUF

Keep browsing