GGUF models by TheBloke

1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.

Most downloadedNewestLargestLongest contextSmallest
PA
mihaiii_pallas-0.5
Pallas · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
NY
beberik_nyxene-v2-11b
Nyxene · TheBloke
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
TO
toten5_leoscorpius-greennode-7b-v1
Toten · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TO
tora 13B v1.0
Tora · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
Coding
SM
vihangd_smartyplats-7b-v2
Smartyplats · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AI
aidc-ai-business_marcoroni-7b-v2
Aidc · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
weyaxi_cosmosis-3x34b
Cosmosis · TheBloke
Params87.2B
Context195K
Smallest31.9 GB
GGUF
SO
Solus 103B L2
Solus · TheBloke
Params103B
Context4K
Smallest43.5 GB
GGUF
TE
migtissera_tess-34b-v1.4
Tess · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
ML
MLewdBoros L2 13B
Mlewdboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
HE
weyaxi_helion-4x34b
Helion · TheBloke
Params114B
Context195K
Smallest41.5 GB
GGUF
UN
UndiMix v3 13B
Undimix · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
openbuddy_openbuddy-mixtral-8x7b-v15.4
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.5 GB
GGUF
DI
DiscoLM 120b
Discolm · TheBloke
Params118B
Context4K
Smallest49.6 GB
Tool use
PI
redwood0_pivot-merge-a-7b
Pivot · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
TH
Thespis 13B v0.5
Thespis · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LE
13B Legerdemain L2
Legerdemain · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
TE
migtissera_tess-m-v1.2
Tess · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
WA
walmart-the-bag_wordwoven-13b
Walmart · TheBloke
Params12.9B
Context32K
Q4_K_M7.3 GB
GGUF
GU
timdettmers_guanaco-13b-merged
Guanaco · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
PA
mihaiii_pallas-0.4
Pallas · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
MI
clibrain_mixtral_spanish_ft
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
MI
mindy-labs_mindy-7b
Mindy · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GR
greennode_merged-dpo-7b
Greennode · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TH
Thespis 13B v0.6
Thespis · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SI
simonveitner_seraphmarcoroni-7b
Simonveitner · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MY
X MythoChronos 13B
Mythochronos · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
TH
Thespis 13B Alpha v0.7
Thespis · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
NE
mrfakename_neuralorca-7b-v1
Neuralorca · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
mihaiii_metis-0.4
Metis · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing