GGUF models by TheBloke

1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.

Most downloadedNewestLargestLongest contextSmallest
ST
Stheno L2 13B
Stheno · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AG
agentlm 13B
Agentlm · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SE
weyaxi_seraph-7b
Seraph · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
openpipe_mistral-ft-optimized-1218
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SQ
defog_sqlcoder-7b
Sqlcoder · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
LL
llama 2 7B Arguments
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
WI
wizardlm_wizardmath-70b-v1.0
Wizardmath · TheBloke
Params69B
Context2K
Q4_K_M41.4 GB
GGUF
PI
maywell_pivot-moe
Pivot · TheBloke
Params36B
Context32K
Q4_K_M20.4 GB
GGUF
TI
tigerresearch_tigerbot-13b-chat-v5
Tigerbot · TheBloke
Params13.4B
Context2K
Q4_K_M8.1 GB
GGUF
DI
digital socrates 7B
Digital · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
AT
Athena v3
Athena · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
YI
brucethemoose_caplattessdolxaboros-yi-34b-200k-dare-ties-highdensity
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
ehartford_dolphin-2.2-yi-34b-200k
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
MA
Marcoroni 70B
Marcoroni · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
OL
v1olet_v1olet_merged_dpo_7b_v4
Olet · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DI
dillfrescott_trinity-v1.2-x8-moe
Dillfrescott · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
CH
digitous_13b-chimera
Chimera · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
SY
Sydney Overthinker 13B
Sydney · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SW
Swallow 70B
Swallow · TheBloke
Params69.2B
Context4K
Q4_K_M41.5 GB
GGUF
QC
qCammel 70 x
Qcammel · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
GU
Guanaco 7B Uncensored
Guanaco · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MY
MythoMakiseMerged 13B
Mythomakisemerged · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CH
perlthoughts_chupacabra-7b-v2
Chupacabra · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
uukuguy_speechless-codellama-34b-v2.0
Llama · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
toxicqa Llama2 7B
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SE
weyaxi_seraph-openchat-3.5-1210-slerp
Seraph · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AP
crumb_apricot-wildflower-20
Apricot · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AL
ALMA 13B
Alma · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
XW
Xwin LM 13B v0.2
Xwin · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
open-orca_llongorca-13b-16k
Llongorca · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
GGUF

Keep browsing