GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
HA
Hathor-L3-8B-v.01
Hathor · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
openchat 3.5 0106 gemma
Gemma · bartowski
Params8.54B
Context8K
Q4_K_M5.1 GB
GGUF
GP
kldzj gpt oss 120b heretic
gpt-oss · bartowski
Params117B
Context128K
Smallest0.2 GB
GGUF
PH
Phi Line_14B
Phi · bartowski
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
MI
SlimHercules-4.0-Mistral-7B-v0.2
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TH
L3-TheSpice-8b-v0.1.3
Thespice · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
starchat2-15b-v0.1
Starchat · bartowski
Params16B
Context16K
Q4_K_M9.9 GB
GGUF
SU
MS Sunfall v0.7.0
Sunfall · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
RoleplayTool use
EV
Evathene v1.3
Evathene · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
Tool use
MI
DIBT Mistral 7B QLoRA
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama-3-8B-Synthia-v3.5
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TH
Thespis CurtainCall 7b v0.3
Thespis · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Cerebrum 1.0 7b
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AL
Alpha-Orionis-v0.1
Alpha · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama-Salad-8x8B
Llama · bartowski
Params47.5B
Context8K
Q4_K_M29.0 GB
GGUF
LL
L3-Zodiac-8B-ORPO-Base
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Mistral-22B-v0.1
Mistral · bartowski
Params22.2B
Context64K
Q4_K_M13.3 GB
GGUF
EV
Evathene v1.0
Evathene · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
Tool use
LL
Llama-3SOME-8B-v2
Llama · bartowski
Params8.03B
Context10K
Q4_K_M4.9 GB
GGUF
LL
SELM-Llama-3-8B-Instruct-iter-3
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
YI
Hercules-4.0-Yi-34B
Yi · bartowski
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
MI
mistral orpo beta
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YI
Fook-Yi-34B-32K-v1
Yi · bartowski
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
HA
Hathor_Stable-v0.2-L3-8B
Hathor · bartowski
Params8.03B
Context8K
Q4_K_M6.3 GB
GGUF
LA
Lazarus 2407 100B
Lazarus · bartowski
Params100B
Context128K
Q4_K_M60.0 GB
Tool use
MI
Hercules 4.0 Mistral v0.2 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Einstein-v6-7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Tess-2.0-Mixtral
Mistral · bartowski
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
SM
Smegmma-9B-v1
Smegmma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
Qwen2-Wukong-7B
Qwen · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF

Keep browsing