GGUF models by TheBloke

1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.

Most downloadedNewestLargestLongest contextSmallest
AM
llm360_amberchat
Amberchat · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
WI
ehartford_wizardlm-30b-uncensored
Wizardlm · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
VI
vicuna 13B v1.5
Vicuna · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SY
migtissera_synthia-70b-v1.2
Synthia · TheBloke
Params69B
Context2K
Q4_K_M41.4 GB
GGUF
CA
camel-ai_camel-13b-role-playing-data
Camel · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
Roleplay
MI
nousresearch_yarn-mistral-7b-128k
Mistral · TheBloke
Params7.24B
Context128K
Q4_K_M4.4 GB
GGUF
LL
Firefly Llama2 13B v1.2
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
TI
tinyllama_tinyllama-1.1b-intermediate-step-1431k-3t
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
LL
Llama 2 13B Ensemble v6
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
fpham_autolycus-mistral_7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
VI
bofenghuang_vigogne-2-7b-instruct
Vigogne · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
MI
leolm_leo-mistral-hessianai-7b-chat
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AI
airoboros l2 7B gpt4 2.0
Airoboros · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
FR
Frostwind 10.7B v1
Frostwind · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
MI
cognitivecomputations_dolphin-2.6-mistral-7b-dpo
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
LL
llamas-community_llamaguard-7b
Llama · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LM
LMCocktail 10.7B v1
Lmcocktail · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
CL
Claire 7B 0.1
Claire · TheBloke
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
VI
Vigogne 2 13B Instruct
Vigogne · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MY
MythoMix L2 13B
Mythomix · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
RE
Redmond Puffin 13B
Redmond · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LE
leolm_leo-hessianai-13b-chat-bilingual
Leo · TheBloke
Params13B
Context8K
Q4_K_M7.9 GB
GGUF
CA
CarbonVillain en 10.7B v4
Carbonvillain · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SY
maywell_synatra-7b-v0.3-base
Synatra · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EU
Euryale L2 70B
Euryale · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
SY
migtissera_synthia-7b-v1.3
Synthia · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 2 70B OASST 1 200
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
RW
rwitz_go-bruins
Rwitz · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Nous Hermes Llama 2 7B
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
Tool use
MI
maywell_pivot-10.7b-mistral-v0.2-rp
Mistral · TheBloke
Params10.7B
Context32K
Q4_K_M6.5 GB
Roleplay

Keep browsing