GGUF models by TheBloke
1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.
BE
mlabonne_beyonder-4x7b-v2
Beyonder · TheBloke
Params24.2B
Context32K
Q4_K_M13.6 GB
EC
Echidna 13B v0.2
Echidna · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
ML
MLewd ReMM L2 Chat 20B Inverted
Mlewd · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
MI
fpham_free_sydney_v2_mistral_7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
AI
jondurbin_airoboros-c34b-2.2
Airoboros · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
RE
ReMM SLERP L2 13B
Remm · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
PA
pipizhao_pandalyst_13b_v1.0
Pandalyst · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
EV
tokenbender_evolvedseeker_1_3
Evolvedseeker · TheBloke
Params1.35B
Context16K
Q4_K_M0.9 GB
EP
calderaai_30b-epsilon
Epsilon · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
OR
orca mini v3 13B
Orca · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
openbuddy llama2 70B v13 base
Llama · TheBloke
Params69.1B
Context4K
Q4_K_M41.5 GB
GU
timdettmers_guanaco-65b
Guanaco · TheBloke
Params65.3B
Context2K
Q4_K_M39.3 GB
TH
Thespis 13B v0.3
Thespis · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
CA
CalliopeDS L2 13B
Calliopeds · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
HU
Huginn 13B
Huginn · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
BL
blossom v3 baichuan2 7B
Blossom · TheBloke
Params7.51B
Context4K
Q4_K_M4.6 GB
LE
viethq188_leoscorpius-7b
Leoscorpius · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
zephyr quiklang 3b
Zephyr · TheBloke
Params2.8B
Context4K
Q4_K_M1.7 GB
GP
lilloukas_gplatty-30b
Gplatty · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
MI
skunkworksai_mistralic-7b-1
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
openbuddy_openbuddy-llama2-13b64k-v15
Llama · TheBloke
Params13.1B
Context64K
Q4_K_M7.9 GB
LL
sheep duck llama 2 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
RE
ReMM v2 L2 13B
Remm · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
EU
Euryale Inverted L2 70B
Euryale · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
IA
Iambe RP v3 20B
Iambe · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
HU
Huginn 13B v4
Huginn · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
OR
orca mini v3 7B
Orca · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
OP
OpenOrca Stx
Openorca · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
TE
migtissera_tess-xs-creative-v1.0
Tess · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
CA
Cat 13B 0.5
Cat · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB