GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Liberalis Cogitator Llama 3.1 8b
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
OP
OpenThinker2 32B
Openthinker · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
MO
Steelskull L3.3 Mokume Gane R1 70b v1.1
Mokume · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
OP
OpenThinker 7B
Openthinker · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
DE
FuseO1 DeepSeekR1 QwQ SkyT1 Flash 32B Preview
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
CO
c4ai-command-r-v01
Command R · bartowski
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
EV
L3.3 MS Evayale 70B
Evayale · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
GE
Gemma 2 Ataraxy v2 9B
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
PR
Nohobby L3.3 Prikol 70B EXTRA
Prikol · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
MU
G4 31B Musica v1
Musica · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
ReasoningRoleplay
TX
Txgemma 27b Chat
Txgemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GL
zai org GLM 4.7
GLM · bartowski
Params358B
Context198K
Q4_K_M218.5 GB
GGUF
PH
calme-2.1-phi3.5-4b
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
AR
katanemo Arch Function Chat 3B
Arch · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
GE
GEMMA SUTRA
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MI
Ministral 3 8B Reasoning 2512
Mistral · bartowski
Params8.49B
Context256K
Q4_K_M5.2 GB
ReasoningVision
ZE
xysera zen 4b
Zen · bartowski
Params4.02B
Context32K
Q4_K_M2.6 GB
ReasoningTool use
GO
goppa ai Goppa LogiLlama
Goppa · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
TI
TinyR1 32B Preview v0.1
Tinyr · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF
MI
Codestral-22B-v0.1-abliterated-v3
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
BI
Big Alice 28B v1
Big · bartowski
Params28.6B
Context64K
Q4_K_M17.3 GB
GGUF
EX
EXAONE 3.0 7.8B Instruct
Exaone · bartowski
Params7.8B
Context4K
Q4_K_M4.8 GB
GGUF
FI
Fireball 3.1 8B ORPO
Fireball · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
CO
codegeex4-all-9b
Codegeex · bartowski
Params9.4B
Context128K
Q4_K_M6.3 GB
GGUF
HU
Hubble 4B V1C
Hubble · bartowski
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
DN
dnotitia DNA R1
Dna · bartowski
Params14.7B
Context16K
Q4_K_M9.1 GB
Reasoning
RI
Ring Mini 2.0
Ring · bartowski
Params16.3B
Context32K
Q4_K_M9.9 GB
GGUF
BE
Beck 1.7B
Beck · bartowski
Params1.72B
Context40K
Q4_K_M1.1 GB
GGUF
SA
Sarvam 1
Sarvam · bartowski
Params2.53B
Context8K
Q4_K_M1.5 GB
Tool use
PH
Tess v2.5 Phi 3 medium 128k 14B
Phi · bartowski
Params14B
Context128K
Q4_K_M8.6 GB
GGUF

Keep browsing