GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
LL
Liberalis Cogitator Llama 3.1 8b
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
OP
OpenThinker2 32B
Openthinker · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
MO
Steelskull L3.3 Mokume Gane R1 70b v1.1
Mokume · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
OP
OpenThinker 7B
Openthinker · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
DE
FuseO1 DeepSeekR1 QwQ SkyT1 Flash 32B Preview
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
CO
c4ai-command-r-v01
Command R · bartowski
Params35B
Context128K
Q4_K_M21.5 GB
EV
L3.3 MS Evayale 70B
Evayale · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GE
Gemma 2 Ataraxy v2 9B
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
PR
Nohobby L3.3 Prikol 70B EXTRA
Prikol · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
MU
G4 31B Musica v1
Musica · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
TX
Txgemma 27b Chat
Txgemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GL
zai org GLM 4.7
GLM · bartowski
Params358B
Context198K
Q4_K_M218.5 GB
PH
calme-2.1-phi3.5-4b
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
AR
katanemo Arch Function Chat 3B
Arch · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
GE
GEMMA SUTRA
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
MI
Ministral 3 8B Reasoning 2512
Mistral · bartowski
Params8.49B
Context256K
Q4_K_M5.2 GB
ZE
xysera zen 4b
Zen · bartowski
Params4.02B
Context32K
Q4_K_M2.6 GB
GO
goppa ai Goppa LogiLlama
Goppa · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
TI
TinyR1 32B Preview v0.1
Tinyr · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
MI
Codestral-22B-v0.1-abliterated-v3
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
BI
Big Alice 28B v1
Big · bartowski
Params28.6B
Context64K
Q4_K_M17.3 GB
EX
EXAONE 3.0 7.8B Instruct
Exaone · bartowski
Params7.8B
Context4K
Q4_K_M4.8 GB
FI
Fireball 3.1 8B ORPO
Fireball · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
CO
codegeex4-all-9b
Codegeex · bartowski
Params9.4B
Context128K
Q4_K_M6.3 GB
HU
Hubble 4B V1C
Hubble · bartowski
Params4.51B
Context128K
Q4_K_M2.8 GB
DN
dnotitia DNA R1
Dna · bartowski
Params14.7B
Context16K
Q4_K_M9.1 GB
RI
Ring Mini 2.0
Ring · bartowski
Params16.3B
Context32K
Q4_K_M9.9 GB
BE
Beck 1.7B
Beck · bartowski
Params1.72B
Context40K
Q4_K_M1.1 GB
SA
Sarvam 1
Sarvam · bartowski
Params2.53B
Context8K
Q4_K_M1.5 GB
PH
Tess v2.5 Phi 3 medium 128k 14B
Phi · bartowski
Params14B
Context128K
Q4_K_M8.6 GB