GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
PY
Pygmalion 3 12B
Pygmalion · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
QW
Qwen3 235B A22B Thinking 2507
Qwen · bartowski
Params235B
Context256K
Q4_K_M142.6 GB
Reasoning
PA
MS3.2 PaintedFantasy v3 24B
Paintedfantasy · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
SA
Salience 1.5 Pro
Salience · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
CodingReasoningTool use
QW
Qwen3 Gutenberg Encore 14B
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
MI
Mistral Small 24B ArliAI RPMax v1.4
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
AB
Absolute_Zero_Reasoner Coder 3b
Absolute · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
Coding
LL
Llama 3.1 70B Instruct lorablated
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
GE
Gemma 2 2B ArliAI RPMax v1.1
Gemma · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
DR
Dream v0 Instruct 7B
Dream · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
RI
Rivermind Lux 12B v1
Rivermind · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
QW
Deductive Reasoning Qwen 32B
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
Reasoning
MI
Ministral 8B Instruct 2410
Mistral · bartowski
Params8B
Context32K
Q4_K_M4.9 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GR
Granite 4.1 8b
Granite · bartowski
Params8.79B
Context128K
Q4_K_M5.5 GB
GGUF
RI
Rivermind 24B v1
Rivermind · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
LL
Cogito v1 Preview Llama 3B
Llama · bartowski
Params3.61B
Context128K
Q4_K_M2.2 GB
GGUF
QW
CoPaw Flash 9B
Qwen · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
Vision
PH
Phi 3.5 MoE Instruct
Phi · bartowski
Params41.9B
Context128K
Q4_K_M25.3 GB
Coding
KU
Kuvera 8B v0.1.0
Kuvera · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
YU
YuLan Mini
Yulan · bartowski
Params2.42B
Context28K
Q4_K_M1.8 GB
Coding
HO
K2-Horizon-0.9B
Horizon · bartowski
Params1.08B
Context128K
Q4_K_M0.7 GB
Reasoning
MI
allura org Mistral Small Sisyphus 24b 2503
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
CodingReasoning
BE
Behemoth X 123B v2
Behemoth · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
AP
Apertus 70B Instruct 2509
Apertus · bartowski
Params70.6B
Context64K
Q4_K_M43.7 GB
GGUF
AU
Austral 24B Winton
Austral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
Roleplay
OP
Openhands Lm 7b v0.1
Openhands · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
GE
Gemma 4 12B It Esper4
Gemma · bartowski
Params11.9B
Context256K
Q4_K_M7.7 GB
CodingReasoningVision
QW
Qwen3 VL 2B Thinking
Qwen · bartowski
Params1.72B
Context256K
Q4_K_M1.1 GB
ReasoningVision
MA
Marco o1
Marco · bartowski
Params7.6B
Context32K
Q4_K_M4.7 GB
GGUF

Keep browsing