GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 7B
Qwen · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
Roleplay
DW
Dwight 4b
Dwight · bartowski
Params4B
Context256K
Q4_K_M2.6 GB
GGUF
CR
Crimson_Dawn v0.2 Base
Crimson · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
SK
Sky T1 32B Flash
Sky · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
DI
DiscoveryRSI 27B
Discoveryrsi · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
ReasoningTool useVision
LL
Llama 3.1 Minitron 4B Width Base
Llama · bartowski
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
AP
Apertus 8B Instruct 2509
Apertus · bartowski
Params8.05B
Context64K
Q4_K_M5.1 GB
GGUF
LI
Ling 3.1 Flash 1019
Ling · bartowski
Params572B
Context256K
Q4_K_M358.0 GB
ReasoningTool use
AP
Apriel 1.6 15b Thinker
Apriel · bartowski
Params14.4B
Context256K
Q4_K_M8.8 GB
ReasoningVision
AP
Apodex 1.1 Mini
Apodex · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
Vision
GE
Gemma 4 E4B Luchador
Gemma · bartowski
Params7.5B
Context128K
Q4_K_M5.4 GB
Roleplay
MI
Mistral Small 3.1 DRAFT 0.5B
Mistral · bartowski
Params593M
Context32K
Q4_K_M0.5 GB
GGUF
MI
Ministral 3 14B Reasoning 2512
Mistral · bartowski
Params13.5B
Context256K
Q4_K_M8.2 GB
ReasoningVision
PY
Pythia 6.9B Instruct v1 Merged
Pythia · bartowski
Params6.86B
Context2K
Q4_K_M4.7 GB
GGUF
DE
DeepCoder 1.5B Preview
Deepcoder · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
Coding
MI
Mistral Small 24B Base 2501
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
DE
DeepSWE Preview
Deepswe · bartowski
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
MI
Mistral NeMo Minitron 8B Instruct
Mistral · bartowski
Params8.41B
Context8K
Q4_K_M5.1 GB
GGUF
NE
Apriel Nemotron 15b Thinker
Nemotron · bartowski
Params15B
Context64K
Q4_K_M9.1 GB
Reasoning
SK
Skywork SWE 32B
Skywork · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
US
UserLM 8b
Userlm · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
RI
Rivermind 12B v1
Rivermind · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
QW
Qwen3 16B A3B
Qwen · bartowski
Params16B
Context40K
Q4_K_M9.8 GB
GGUF
PE
Q3 30b A3b Pentiment
Pentiment · bartowski
Params30.5B
Context32K
Q4_K_M18.6 GB
Roleplay
GE
Gemma 2 27b It
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
US
UserRepGen 4B
Userrepgen · bartowski
Params4.21B
Context256K
Q4_K_M2.7 GB
GGUF
OM
OmniCoder 9B
Omnicoder · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
Coding
LL
Trendyol LLM 8b Chat v2.0
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen3 VL 8B Thinking
Qwen · bartowski
Params8.19B
Context256K
Q4_K_M5.0 GB
ReasoningVision
LL
Llama 3.1 Nemotron Nano 8B v1
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing