GGUF models by TheBloke

1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.

Most downloadedNewestLargestLongest contextSmallest
NA
Nanbeige 16B Chat
Nanbeige · TheBloke
Params15.8B
Context4K
Q4_K_M9.6 GB
Coding
DA
pocketdoc_dans-adventurouswinds-7b
Dans · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
llmware_dragon-mistral-7b-v0
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
IN
bronya-rand_inairtra-7b
Inairtra · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KI
fiction.live Kimiko V2 70B
Kimi · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
UN
una xaberius 34b v1beta
Una · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
LL
OpenBuddy Llama2 13B v11.1
Llama · TheBloke
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
GO
gorilla-llm_gorilla-7b-hf-delta-v0
Gorilla · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
AI
henk717_airochronos-33b
Airochronos · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
XD
xdan-ai_xdan-l1-chat-rl-v1
Xdan · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Reasoning
CH
elinas_chronos-33b
Chronos · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
YI
Yi 34B GiftedConvo merged
Yi · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
UN
fblgit_una-cybertron-7b-v3-oma
Una · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PE
perlthoughts_chupacabra-8x7b-moe
Perlthoughts · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
HU
Huginn 13B v4.5
Huginn · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ZE
zephyr quiklang 3b 4K
Zephyr · TheBloke
Params2.8B
Context4K
Q4_K_M1.7 GB
Tool use
SP
Spring Dragon
Spring · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ML
MLewdBoros LRPSGPT 2Char 13B
Mlewdboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
nkpz_llama2-22b-daydreamer-v2
Llama · TheBloke
Params21.8B
Context4K
Q4_K_M13.2 GB
GGUF
AU
Aurora Nights 70B v1.0
Aurora · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
SY
Synthia 70B
Synthia · TheBloke
Params69B
Context—
Q4_K_M41.4 GB
GGUF
ML
MLewd L2 Chat 13B
Mlewd · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
vagosolutions_sauerkrautlm-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
MI
fpham_writing_partner_mistral_7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
VI
vigogne 2 70B chat
Vigogne · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
conceptofmind_llongma-2-7b
Llongma · TheBloke
Params6.74B
Context8K
Q4_K_M4.1 GB
GGUF
EV
totally-not-an-llm_everythinglm-13b-16k
Everythinglm · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
OP
openchat v3.2 super
Openchat · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CH
ChatAYT Lora Assamble Marcoroni
Chatayt · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SO
sanjiwatsuki_sonya-7b
Sonya · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF

Keep browsing