GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LR
OrionLLM LRM 3.2
Lrm · bartowski
Params27B
Context256K
Q4_K_M17.5 GB
ReasoningVision
GI
GigaChat3 10B A1.8B
Gigachat · bartowski
Params10.7B
Context256K
Q4_K_M6.7 GB
GGUF
PA
Pantheon Rp 1.6.1 12b Nemo
Pantheon · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
GE
burtenshaw GemmaCoder3 12B
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
CodingReasoning
ZR
ZR1 1.5B
bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
Coding
LY
MN 12B Lyra v4
Lyra · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GR
Grug 27b v1.1
Grug · bartowski
Params27B
Context256K
Q4_K_M17.5 GB
ReasoningTool useVision
NE
Nemotron H 47B Reasoning 128K
Nemotron · bartowski
Params47B
Context1024K
Q4_K_M28.2 GB
Reasoning
LL
Llama-3-Groq-8B-Tool-Use
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.1 8B Ultra Instruct
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
FA
Falcon3 10B Instruct Abliterated
Falcon · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
LL
Rombos LLM 70b Llama 3.3
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
MA
Magnum v4 9b
Magnum · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
Qwen3 14B Ft Limo
Qwen · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
RE
Replete LLM Mist Nemo 12b test merged 250k
Replete · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
IN
Intern S2 397B
InternLM · bartowski
Params403B
Context256K
Q4_K_M254.6 GB
Vision
GL
Glistening Gem 31B v2.0
Glistening · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
GGUF
QW
GrayLine Qwen3 8B
Qwen · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
Reasoning
NE
L3.3 MS Nevoria 70b
Nevoria · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
BE
Beepo 22B
Beepo · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
MA
Magidonia 24B v4.2.0
Magidonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
LL
Wayfarer Large 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
FR
Frontis MA1 35B
Frontis · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
Vision
PA
Pantheon Rp 1.6 12b Nemo
Pantheon · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
QW
BigBubba Qwen3.6 27B
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
Vision
NE
Nemotron 3 Super 120B A12B
Nemotron · bartowski
Params121B
Context1024K
Q4_K_M87.0 GB
GGUF
QW
Qwen3 VL 32B Thinking
Qwen · bartowski
Params32.8B
Context256K
Q4_K_M19.8 GB
ReasoningVision
SM
SmolVLM2 2.2B Instruct Agentic GUI
Smolvlm · bartowski
Params1.81B
Context8K
Q4_K_M1.1 GB
Vision
GR
granite embedding 125m english
Granite · bartowski
Params124M
Context512
Q4_K_M0.1 GB
Embedding
LL
LongWriter Llama3.1 8b
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing