GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Remnant Qwen3 8b
Qwen · bartowski
Params8.19B
Context32K
Q4_K_M5.0 GB
Roleplay
MA
Mario Html v2 9B
Mario · bartowski
Params9.2B
Context256K
Q4_K_M6.0 GB
ReasoningTool useVision
LL
Llama 3.1 WhiteRabbitNeo 2 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
OR
Ornith 1.5 397B
Ornith · bartowski
Params397B
Context256K
Q4_K_M241.8 GB
Vision
PH
Athene Phi 3.5 mini instruct orpo
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
MI
MiMo Ornith 9B AGSI
Mimo · bartowski
Params9.2B
Context256K
Q4_K_M6.0 GB
ReasoningTool use
LL
Llama Song Stream 3B Instruct
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
LL
Reasoning Llama 1b v0.1
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
Reasoning
QW
Qwen2.5 Math 72B Instruct
Qwen · bartowski
Params72.7B
Context4K
Q4_K_M47.4 GB
GGUF
CO
CodeQwen1.5-7B-Chat
Codeqwen · bartowski
Params7.25B
Context64K
Q4_K_M4.7 GB
GGUF
GR
Granite 3.1 3b A800M Instruct
Granite · bartowski
Params3.3B
Context128K
Q4_K_M2.0 GB
GGUF
GE
gemma-3-27b-it-codeforces-SFT
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
Reasoning
ZE
zed industries zeta 2
Zeta · bartowski
Params8.25B
Context32K
Q4_K_M5.2 GB
GGUF
OL
open r1 OlympicCoder 7B
Olympiccoder · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingReasoning
LL
Replete Coder V2 Llama 3.1 8b
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
Coding
HO
K2-Horizon-375B-A23B
Horizon · bartowski
Params379B
Context512K
Q4_K_M237.8 GB
GGUF
QW
Qwen3 2507 4B Instruct Haiku 4.5 Merged
Qwen · bartowski
Params4B
Context256K
Q4_K_M2.6 GB
GGUF
MI
MiniMax M3
Minimax · bartowski
Params426B
Context1024K
Q4_K_M261.3 GB
Vision
SE
Seed OSS 36B Instruct
Seed · bartowski
Params36.2B
Context512K
Q4_K_M21.8 GB
GGUF
QW
Qwen3 0.6B Abliterated
Qwen · bartowski
Params596M
Context40K
Q4_K_M0.4 GB
GGUF
GE
Gemma 4 31B It SDFT Heretic RP
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
Roleplay
OC
Occamy 1.0
Occamy · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
Tool useVision
SP
SpatialAxiom 9B
Spatialaxiom · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
Vision
LL
Aion RP Llama 3.1 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay
LU
dreamgen lucid v1 nemo
Lucid · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
QW
Qwen2.5 Coder 0.5B
Qwen · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
Coding
FA
Falcon3 1B Instruct
Falcon · bartowski
Params1.67B
Context8K
Q4_K_M1.1 GB
GGUF
DE
DeepCoder 14B Preview
Deepcoder · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
Coding
GR
Granite 3.2 8b Instruct
Granite · bartowski
Params8.17B
Context128K
Q4_K_M4.9 GB
GGUF
DA
Darwin 4B Chimera
Darwin · bartowski
Params4B
Context40K
Q4_K_M2.6 GB
Reasoning

Keep browsing