GGUF models by TheBloke

1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
neuronovo_neuronovo-7b-v0.3
Neuronovo · TheBloke
Params8.99B
Context32K
Q4_K_M5.4 GB
GGUF
WI
junelee_wizard-vicuna-13b
Wizard · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
MI
doctor-shotgun_mixtral-8x7b-instruct-v0.1-limarp-zloss-dare-ties
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
LL
StellarBright
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
IA
Iambe Storyteller 20B
Iambe · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
LE
leolm_leo-hessianai-7b
Leo · TheBloke
Params6.74B
Context8K
Q4_K_M4.1 GB
GGUF
MA
MAmmoTH 13B
Mammoth · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
open-orca_llongorca-7b-16k
Llongorca · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
MI
lvkaokao_mistral-7b-finetuned-orca-dpo-v2
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PL
Platypus2 70B Instruct
Platypus · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
NE
nexusflow_nexusraven-13b
Nexusraven · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
SA
Sarah StoryTeller 13b
Sarah · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ME
merlyn education safety
Merlyn · TheBloke
Params11.8B
Context2K
Q4_K_M7.6 GB
GGUF
PS
Psyfighter 13B
Psyfighter · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LE
leolm_leo-hessianai-7b-chat-bilingual
Leo · TheBloke
Params6.74B
Context8K
Q4_K_M4.1 GB
GGUF
VE
delcos_velara-11b-v2
Velara · TheBloke
Params11.4B
Context32K
Q4_K_M6.8 GB
GGUF
MI
cloudyu_mixtral_7bx2_moe
Mistral · TheBloke
Params12.9B
Context32K
Q4_K_M7.3 GB
GGUF
KI
MythoMax Kimiko Mix
Kimi · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
TU
allenai_tulu-2-dpo-13b
Tulu · TheBloke
Params13B
Context8K
Q4_K_M7.9 GB
GGUF
NO
doctor-shotgun_norobara-zloss-8x7b
Norobara · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
MI
vagosolutions_sauerkrautlm-mixtral-8x7b-instruct
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
JU
fblgit_juanako-7b-v1
Juanako · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YI
Yi 6B
Yi · TheBloke
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
AL
totally-not-an-llm_alpacacielo2-7b-8k
Alpacacielo · TheBloke
Params6.74B
Context8K
Q4_K_M4.1 GB
GGUF
LL
meta-llama-13b
Llama · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
WE
petrogpt_westseverus-7b-dpo
Westseverus · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
orangetin_fennec-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
Tool use
BA
ehartford_based-13b
Based · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
LL
codefuse-ai_codefuse-codellama-34b
Llama · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
OU
calderaai_13b-ouroboros
Ouroboros · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF

Keep browsing