GGUF models by TheBloke
1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.
ST
Stheno L2 13B
Stheno · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
AG
agentlm 13B
Agentlm · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
SE
weyaxi_seraph-7b
Seraph · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
openpipe_mistral-ft-optimized-1218
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
SQ
defog_sqlcoder-7b
Sqlcoder · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
llama 2 7B Arguments
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
WI
wizardlm_wizardmath-70b-v1.0
Wizardmath · TheBloke
Params69B
Context2K
Q4_K_M41.4 GB
PI
maywell_pivot-moe
Pivot · TheBloke
Params36B
Context32K
Q4_K_M20.4 GB
TI
tigerresearch_tigerbot-13b-chat-v5
Tigerbot · TheBloke
Params13.4B
Context2K
Q4_K_M8.1 GB
DI
digital socrates 7B
Digital · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
AT
Athena v3
Athena · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
YI
brucethemoose_caplattessdolxaboros-yi-34b-200k-dare-ties-highdensity
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
ehartford_dolphin-2.2-yi-34b-200k
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
MA
Marcoroni 70B
Marcoroni · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
OL
v1olet_v1olet_merged_dpo_7b_v4
Olet · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
DI
dillfrescott_trinity-v1.2-x8-moe
Dillfrescott · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
CH
digitous_13b-chimera
Chimera · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
SY
Sydney Overthinker 13B
Sydney · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
SW
Swallow 70B
Swallow · TheBloke
Params69.2B
Context4K
Q4_K_M41.5 GB
QC
qCammel 70 x
Qcammel · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GU
Guanaco 7B Uncensored
Guanaco · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
MY
MythoMakiseMerged 13B
Mythomakisemerged · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
CH
perlthoughts_chupacabra-7b-v2
Chupacabra · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
uukuguy_speechless-codellama-34b-v2.0
Llama · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
LL
toxicqa Llama2 7B
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
SE
weyaxi_seraph-openchat-3.5-1210-slerp
Seraph · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
AP
crumb_apricot-wildflower-20
Apricot · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
AL
ALMA 13B
Alma · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
XW
Xwin LM 13B v0.2
Xwin · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
open-orca_llongorca-13b-16k
Llongorca · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB