GGUF models by TheBloke

1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.

Most downloadedNewestLargestLongest contextSmallest
BE
mlabonne_beyonder-4x7b-v2
Beyonder · TheBloke
Params24.2B
Context32K
Q4_K_M13.6 GB
GGUF
EC
Echidna 13B v0.2
Echidna · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ML
MLewd ReMM L2 Chat 20B Inverted
Mlewd · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
MI
fpham_free_sydney_v2_mistral_7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AI
jondurbin_airoboros-c34b-2.2
Airoboros · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
GGUF
RE
ReMM SLERP L2 13B
Remm · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
PA
pipizhao_pandalyst_13b_v1.0
Pandalyst · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
Coding
EV
tokenbender_evolvedseeker_1_3
Evolvedseeker · TheBloke
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF
EP
calderaai_30b-epsilon
Epsilon · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
Roleplay
OR
orca mini v3 13B
Orca · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
openbuddy llama2 70B v13 base
Llama · TheBloke
Params69.1B
Context4K
Q4_K_M41.5 GB
GGUF
GU
timdettmers_guanaco-65b
Guanaco · TheBloke
Params65.3B
Context2K
Q4_K_M39.3 GB
GGUF
TH
Thespis 13B v0.3
Thespis · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CA
CalliopeDS L2 13B
Calliopeds · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
HU
Huginn 13B
Huginn · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
BL
blossom v3 baichuan2 7B
Blossom · TheBloke
Params7.51B
Context4K
Q4_K_M4.6 GB
GGUF
LE
viethq188_leoscorpius-7b
Leoscorpius · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr quiklang 3b
Zephyr · TheBloke
Params2.8B
Context4K
Q4_K_M1.7 GB
Tool use
GP
lilloukas_gplatty-30b
Gplatty · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
MI
skunkworksai_mistralic-7b-1
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
openbuddy_openbuddy-llama2-13b64k-v15
Llama · TheBloke
Params13.1B
Context64K
Q4_K_M7.9 GB
GGUF
LL
sheep duck llama 2 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
RE
ReMM v2 L2 13B
Remm · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
EU
Euryale Inverted L2 70B
Euryale · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
IA
Iambe RP v3 20B
Iambe · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
Roleplay
HU
Huginn 13B v4
Huginn · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
OR
orca mini v3 7B
Orca · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
OP
OpenOrca Stx
Openorca · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
TE
migtissera_tess-xs-creative-v1.0
Tess · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
Cat 13B 0.5
Cat · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF

Keep browsing