GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
HA
Hathor-L3-8B-v.01
Hathor · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
openchat 3.5 0106 gemma
Gemma · bartowski
Params8.54B
Context8K
Q4_K_M5.1 GB
GP
kldzj gpt oss 120b heretic
gpt-oss · bartowski
Params117B
Context128K
Smallest0.2 GB
PH
Phi Line_14B
Phi · bartowski
Params14.7B
Context16K
Q4_K_M8.9 GB
MI
SlimHercules-4.0-Mistral-7B-v0.2
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
TH
L3-TheSpice-8b-v0.1.3
Thespice · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
starchat2-15b-v0.1
Starchat · bartowski
Params16B
Context16K
Q4_K_M9.9 GB
SU
MS Sunfall v0.7.0
Sunfall · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
EV
Evathene v1.3
Evathene · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
MI
DIBT Mistral 7B QLoRA
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama-3-8B-Synthia-v3.5
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
TH
Thespis CurtainCall 7b v0.3
Thespis · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Cerebrum 1.0 7b
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
AL
Alpha-Orionis-v0.1
Alpha · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama-Salad-8x8B
Llama · bartowski
Params47.5B
Context8K
Q4_K_M29.0 GB
LL
L3-Zodiac-8B-ORPO-Base
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Mistral-22B-v0.1
Mistral · bartowski
Params22.2B
Context64K
Q4_K_M13.3 GB
EV
Evathene v1.0
Evathene · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
LL
Llama-3SOME-8B-v2
Llama · bartowski
Params8.03B
Context10K
Q4_K_M4.9 GB
LL
SELM-Llama-3-8B-Instruct-iter-3
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
YI
Hercules-4.0-Yi-34B
Yi · bartowski
Params34.4B
Context4K
Q4_K_M20.7 GB
MI
mistral orpo beta
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
YI
Fook-Yi-34B-32K-v1
Yi · bartowski
Params34.4B
Context32K
Q4_K_M20.7 GB
HA
Hathor_Stable-v0.2-L3-8B
Hathor · bartowski
Params8.03B
Context8K
Q4_K_M6.3 GB
LA
Lazarus 2407 100B
Lazarus · bartowski
Params100B
Context128K
Q4_K_M60.0 GB
MI
Hercules 4.0 Mistral v0.2 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Einstein-v6-7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Tess-2.0-Mixtral
Mistral · bartowski
Params46.7B
Context32K
Q4_K_M28.4 GB
SM
Smegmma-9B-v1
Smegmma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
Qwen2-Wukong-7B
Qwen · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB