GGUF models by TheBloke
1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.
PA
mihaiii_pallas-0.5
Pallas · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
NY
beberik_nyxene-v2-11b
Nyxene · TheBloke
Params10.7B
Context32K
Q4_K_M6.5 GB
TO
toten5_leoscorpius-greennode-7b-v1
Toten · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
TO
tora 13B v1.0
Tora · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
SM
vihangd_smartyplats-7b-v2
Smartyplats · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
AI
aidc-ai-business_marcoroni-7b-v2
Aidc · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
weyaxi_cosmosis-3x34b
Cosmosis · TheBloke
Params87.2B
Context195K
Smallest31.9 GB
SO
Solus 103B L2
Solus · TheBloke
Params103B
Context4K
Smallest43.5 GB
TE
migtissera_tess-34b-v1.4
Tess · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
ML
MLewdBoros L2 13B
Mlewdboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
HE
weyaxi_helion-4x34b
Helion · TheBloke
Params114B
Context195K
Smallest41.5 GB
UN
UndiMix v3 13B
Undimix · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MI
openbuddy_openbuddy-mixtral-8x7b-v15.4
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.5 GB
DI
DiscoLM 120b
Discolm · TheBloke
Params118B
Context4K
Smallest49.6 GB
PI
redwood0_pivot-merge-a-7b
Pivot · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
TH
Thespis 13B v0.5
Thespis · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LE
13B Legerdemain L2
Legerdemain · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
TE
migtissera_tess-m-v1.2
Tess · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
WA
walmart-the-bag_wordwoven-13b
Walmart · TheBloke
Params12.9B
Context32K
Q4_K_M7.3 GB
GU
timdettmers_guanaco-13b-merged
Guanaco · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
PA
mihaiii_pallas-0.4
Pallas · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
MI
clibrain_mixtral_spanish_ft
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
MI
mindy-labs_mindy-7b
Mindy · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GR
greennode_merged-dpo-7b
Greennode · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
TH
Thespis 13B v0.6
Thespis · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
SI
simonveitner_seraphmarcoroni-7b
Simonveitner · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MY
X MythoChronos 13B
Mythochronos · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
TH
Thespis 13B Alpha v0.7
Thespis · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
NE
mrfakename_neuralorca-7b-v1
Neuralorca · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
mihaiii_metis-0.4
Metis · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB