GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
zephyr-orpo-141b-A35b-v0.1
Mistral · bartowski
Params141B
Context64K
Q4_K_M85.6 GB
GGUF
SH
OS Shepherd 9B
Shepherd · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
Vision
GL
LongWriter Glm4 9b
GLM · bartowski
Params9.4B
Context1024K
Q4_K_M6.3 GB
GGUF
GE
Gemma2 Gutenberg Doppel 9B
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
IN
Internlm3 8b Instruct
InternLM · bartowski
Params8.8B
Context32K
Q4_K_M5.4 GB
GGUF
QW
Replete LLM V2.5 Qwen 7b
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
GE
Fallen Gemma3 4B v1
Gemma · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
AG
Agents A1 4B
Agents · bartowski
Params4.21B
Context256K
Q4_K_M2.9 GB
Vision
LL
Llama 3.3 70B Vulpecula R1
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
VI
Video ORA 9B
Video · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
ReasoningVision
VA
Valkyrie 49B v1
Valkyrie · bartowski
Params49.9B
Context128K
Q4_K_M30.2 GB
GGUF
MI
Mistral Small 22B ArliAI RPMax v1.1
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
LL
Llama 3.1 Nemotron Nano 4B v1.1
Llama · bartowski
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
ZW
ZwZ2 4B
Zwz · bartowski
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
GL
Glm 4 9b Chat 1m
GLM · bartowski
Params9.48B
Context1024K
Q4_K_M6.3 GB
GGUF
QW
GrayLine Qwen3 14B
Qwen · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
Reasoning
ME
Mellum2 12B A2.5B Thinking
Mellum · bartowski
Params12.1B
Context128K
Q4_K_M8.2 GB
Reasoning
HY
Hy3
bartowski
Params300B
Context256K
Q4_K_M182.2 GB
GGUF
FU
functionary small v3.2
Functionary · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
Tool use
CH
Chronos Gold 12B 1.0
Chronos · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
CY
Cydonia R1 24B v4
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
Reasoning
BA
Basal Omni 1.0 Ultra
Basal · bartowski
Params30.7B
Context256K
Q4_K_M19.5 GB
Vision
DA
Dans PersonalityEngine v1.0.0 8b
Dans · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
Coding
GE
Amoral Gemma3 12B v2
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GL
GLM Z1 Rumination 32B 0414
GLM · bartowski
Params33.1B
Context128K
Q4_K_M20.0 GB
GGUF
KE
cognition ai Kevin 32B
Kevin · bartowski
Params32.8B
Context40K
Q4_K_M19.9 GB
GGUF
GL
GLM 4 32B Base 32K
GLM · bartowski
Params32.6B
Context32K
Q4_K_M19.7 GB
GGUF
GR
Granite 3.0 8b Lab Community
Granite · bartowski
Params8.17B
Context4K
Q4_K_M4.9 GB
GGUF
GE
Gemma-2-9B-It-SPPO-Iter3
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
SK
Skywork OR1 32B Preview
Skywork · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF

Keep browsing