GGUF models by TheBloke
1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.
LE
leolm_leo-hessianai-70b-chat
Leo · TheBloke
Params69B
Context8K
Q4_K_M41.4 GB
CH
Chronorctypus Limarobormes 13b
Chronorctypus · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MO
MoMo 70B V1.1
Momo · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
SK
skywork_skywork-13b-base
Skywork · TheBloke
Params13.9B
Context128K
Q4_K_M8.4 GB
FR
fredithefish_openzephyrchat
Fredithefish · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
CA
Camel Platypus2 13B
Camel · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MI
open-orca_mixtral-slimorca-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
ME
q-bert_merged-agi-7b
Merged · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Carl Llama 2 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
NE
intel_neural-chat-7b-v3-3
Neural · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
malhajar_meditron-7b-chat
Meditron · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
IA
Iambe 20B DARE
Iambe · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
LL
CodeLlama 70B Instruct
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GA
udkai_garrulus
Garrulus · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
PA
mihaiii_pallas-0.5-laser-0.6
Pallas · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
UN
Uncensored Frank 13b
Uncensored · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
BA
jondurbin_bagel-dpo-7b-v0.1
Bagel · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
mlabonne_neuralpipe-7b-ties
Neuralpipe · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
doctor-shotgun_mixtral-8x7b-instruct-v0.1-limarp-zloss
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
MA
Marcoroni 7b
Marcoroni · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
NO
jondurbin_nontoxic-bagel-34b-v0.2
Nontoxic · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
CH
chronos 13b v2
Chronos · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
DE
deepseek llm 67b base
DeepSeek · TheBloke
Params67.4B
Context4K
Q4_K_M40.4 GB
ZE
huggingfaceh4_zephyr-7b-alpha
Zephyr · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
HE
calderaai_hexoteric-7b
Hexoteric · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MA
MAmmoTH 7B
Mammoth · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
DO
Dolphin 2.1 70B
Dolphin · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
IN
Inkbot 13B 4k
Inkbot · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
DO
dopeystableplats 3b v1
Dopeystableplats · TheBloke
Params2.8B
Context4K
Q4_K_M1.7 GB
MI
yeungnlp_firefly-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB