GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
WR
writing roleplay 20k context nemo 12b v1.0
Writing · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
LL
Llama 3.1 8B ArliAI RPMax v1.3
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
NE
Nemotron 3 Nano 4B
Nemotron · bartowski
Params3.97B
Context1024K
Q4_K_M3.0 GB
Tool use
QW
trashpanda org QwQ 32B Snowdrop v0
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.8 GB
Reasoning
FA
Fara 7B
Fara · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
NE
OpenMath Nemotron 14B Kaggle
Nemotron · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
TA
UI TARS 2B SFT
Tars · bartowski
Params1.78B
Context32K
Q4_K_M1.1 GB
Vision
CO
C4Ai Command A 03 2025
Command R · bartowski
Params111B
Context16K
Q4_K_M67.1 GB
GGUF
JE
Jebadiah 9b v2 1
Jebadiah · bartowski
Params9.2B
Context256K
Q4_K_M6.0 GB
Vision
QW
Replete LLM V2.5 Qwen 72b
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
LL
Hermes 3 Llama 3.1 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
CO
ContextPilot 14B
Contextpilot · bartowski
Params14.8B
Context40K
Q4_K_M9.3 GB
Tool use
CY
Cydonia 24B v3
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
GE
Gemma 2 9B ArliAI RPMax v1.1
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
VE
Q25 1.5B VeoLu
Veolu · bartowski
Params1.78B
Context32K
Q4_K_M1.1 GB
GGUF
QW
32B Qwen2.5 Kunou v1
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
QW
Qwen2.5 Gutenberg Doppel 32B
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
GR
Grug 35b
Grug · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
CodingReasoningTool use
GR
Granite 3.3 2b Instruct
Granite · bartowski
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
MA
magnum v2 4b
Magnum · bartowski
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
LL
Llama-3-Patronus-Lynx-8B-Instruct
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Roleplay
HY
Hypnos I1 8B
Hypnos · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
ReasoningRoleplay
CO
codegemma-7b-it
Codegemma · bartowski
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
LL
Llama 3_3 Nemotron Super 49B GenRM Multilingual
Llama · bartowski
Params49.9B
Context128K
Q4_K_M30.2 GB
GGUF
MI
MiMo VL 7B RL 2508
Mimo · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
ST
Stheno Hercules 3.1 8B
Stheno · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
GR
Granite 3.3 8b Instruct
Granite · bartowski
Params8.17B
Context128K
Q4_K_M4.9 GB
GGUF
NE
Nemotron Mini 4B Instruct
Nemotron · bartowski
Params4.19B
Context4K
Q4_K_M2.7 GB
GGUF
QW
Qwen2 VL 7B Instruct Abliterated
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
Vision

Keep browsing