GGUF models by TheBloke

1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.

Most downloadedNewestLargestLongest contextSmallest
LE
leolm_leo-hessianai-70b-chat
Leo · TheBloke
Params69B
Context8K
Q4_K_M41.4 GB
GGUF
CH
Chronorctypus Limarobormes 13b
Chronorctypus · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MO
MoMo 70B V1.1
Momo · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
SK
skywork_skywork-13b-base
Skywork · TheBloke
Params13.9B
Context128K
Q4_K_M8.4 GB
GGUF
FR
fredithefish_openzephyrchat
Fredithefish · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
Camel Platypus2 13B
Camel · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
open-orca_mixtral-slimorca-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
ME
q-bert_merged-agi-7b
Merged · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Carl Llama 2 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
NE
intel_neural-chat-7b-v3-3
Neural · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
malhajar_meditron-7b-chat
Meditron · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
IA
Iambe 20B DARE
Iambe · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
LL
CodeLlama 70B Instruct
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
Coding
GA
udkai_garrulus
Garrulus · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PA
mihaiii_pallas-0.5-laser-0.6
Pallas · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
UN
Uncensored Frank 13b
Uncensored · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
BA
jondurbin_bagel-dpo-7b-v0.1
Bagel · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
NE
mlabonne_neuralpipe-7b-ties
Neuralpipe · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
doctor-shotgun_mixtral-8x7b-instruct-v0.1-limarp-zloss
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
MA
Marcoroni 7b
Marcoroni · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
NO
jondurbin_nontoxic-bagel-34b-v0.2
Nontoxic · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
CodingRoleplay
CH
chronos 13b v2
Chronos · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
DE
deepseek llm 67b base
DeepSeek · TheBloke
Params67.4B
Context4K
Q4_K_M40.4 GB
GGUF
ZE
huggingfaceh4_zephyr-7b-alpha
Zephyr · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HE
calderaai_hexoteric-7b
Hexoteric · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MA
MAmmoTH 7B
Mammoth · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
DO
Dolphin 2.1 70B
Dolphin · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
IN
Inkbot 13B 4k
Inkbot · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
DO
dopeystableplats 3b v1
Dopeystableplats · TheBloke
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
MI
yeungnlp_firefly-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF

Keep browsing