GGUF models by TheBloke
1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.
NA
Nanbeige 16B Chat
Nanbeige · TheBloke
Params15.8B
Context4K
Q4_K_M9.6 GB
DA
pocketdoc_dans-adventurouswinds-7b
Dans · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
llmware_dragon-mistral-7b-v0
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
IN
bronya-rand_inairtra-7b
Inairtra · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
KI
fiction.live Kimiko V2 70B
Kimi · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
UN
una xaberius 34b v1beta
Una · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
LL
OpenBuddy Llama2 13B v11.1
Llama · TheBloke
Params13.1B
Context4K
Q4_K_M7.9 GB
GO
gorilla-llm_gorilla-7b-hf-delta-v0
Gorilla · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
AI
henk717_airochronos-33b
Airochronos · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
XD
xdan-ai_xdan-l1-chat-rl-v1
Xdan · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
CH
elinas_chronos-33b
Chronos · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
YI
Yi 34B GiftedConvo merged
Yi · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
UN
fblgit_una-cybertron-7b-v3-oma
Una · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
PE
perlthoughts_chupacabra-8x7b-moe
Perlthoughts · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
HU
Huginn 13B v4.5
Huginn · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
ZE
zephyr quiklang 3b 4K
Zephyr · TheBloke
Params2.8B
Context4K
Q4_K_M1.7 GB
SP
Spring Dragon
Spring · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
ML
MLewdBoros LRPSGPT 2Char 13B
Mlewdboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
nkpz_llama2-22b-daydreamer-v2
Llama · TheBloke
Params21.8B
Context4K
Q4_K_M13.2 GB
AU
Aurora Nights 70B v1.0
Aurora · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
SY
Synthia 70B
Synthia · TheBloke
Params69B
Context—
Q4_K_M41.4 GB
ML
MLewd L2 Chat 13B
Mlewd · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MI
vagosolutions_sauerkrautlm-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
MI
fpham_writing_partner_mistral_7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
VI
vigogne 2 70B chat
Vigogne · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
LL
conceptofmind_llongma-2-7b
Llongma · TheBloke
Params6.74B
Context8K
Q4_K_M4.1 GB
EV
totally-not-an-llm_everythinglm-13b-16k
Everythinglm · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
OP
openchat v3.2 super
Openchat · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
CH
ChatAYT Lora Assamble Marcoroni
Chatayt · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
SO
sanjiwatsuki_sonya-7b
Sonya · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB