GGUF models by TheBloke
1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.
NE
neuronovo_neuronovo-7b-v0.3
Neuronovo · TheBloke
Params8.99B
Context32K
Q4_K_M5.4 GB
WI
junelee_wizard-vicuna-13b
Wizard · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
MI
doctor-shotgun_mixtral-8x7b-instruct-v0.1-limarp-zloss-dare-ties
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
LL
StellarBright
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
IA
Iambe Storyteller 20B
Iambe · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
LE
leolm_leo-hessianai-7b
Leo · TheBloke
Params6.74B
Context8K
Q4_K_M4.1 GB
MA
MAmmoTH 13B
Mammoth · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
open-orca_llongorca-7b-16k
Llongorca · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
MI
lvkaokao_mistral-7b-finetuned-orca-dpo-v2
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
PL
Platypus2 70B Instruct
Platypus · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
NE
nexusflow_nexusraven-13b
Nexusraven · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
SA
Sarah StoryTeller 13b
Sarah · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
ME
merlyn education safety
Merlyn · TheBloke
Params11.8B
Context2K
Q4_K_M7.6 GB
PS
Psyfighter 13B
Psyfighter · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LE
leolm_leo-hessianai-7b-chat-bilingual
Leo · TheBloke
Params6.74B
Context8K
Q4_K_M4.1 GB
VE
delcos_velara-11b-v2
Velara · TheBloke
Params11.4B
Context32K
Q4_K_M6.8 GB
MI
cloudyu_mixtral_7bx2_moe
Mistral · TheBloke
Params12.9B
Context32K
Q4_K_M7.3 GB
KI
MythoMax Kimiko Mix
Kimi · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
TU
allenai_tulu-2-dpo-13b
Tulu · TheBloke
Params13B
Context8K
Q4_K_M7.9 GB
NO
doctor-shotgun_norobara-zloss-8x7b
Norobara · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
MI
vagosolutions_sauerkrautlm-mixtral-8x7b-instruct
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
JU
fblgit_juanako-7b-v1
Juanako · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
YI
Yi 6B
Yi · TheBloke
Params6.06B
Context4K
Q4_K_M3.7 GB
AL
totally-not-an-llm_alpacacielo2-7b-8k
Alpacacielo · TheBloke
Params6.74B
Context8K
Q4_K_M4.1 GB
LL
meta-llama-13b
Llama · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
WE
petrogpt_westseverus-7b-dpo
Westseverus · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
orangetin_fennec-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
BA
ehartford_based-13b
Based · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
LL
codefuse-ai_codefuse-codellama-34b
Llama · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
OU
calderaai_13b-ouroboros
Ouroboros · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB