GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
LR
OrionLLM LRM 3.2
Lrm · bartowski
Params27B
Context256K
Q4_K_M17.5 GB
GI
GigaChat3 10B A1.8B
Gigachat · bartowski
Params10.7B
Context256K
Q4_K_M6.7 GB
PA
Pantheon Rp 1.6.1 12b Nemo
Pantheon · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GE
burtenshaw GemmaCoder3 12B
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
ZR
ZR1 1.5B
bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
LY
MN 12B Lyra v4
Lyra · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GR
Grug 27b v1.1
Grug · bartowski
Params27B
Context256K
Q4_K_M17.5 GB
NE
Nemotron H 47B Reasoning 128K
Nemotron · bartowski
Params47B
Context1024K
Q4_K_M28.2 GB
LL
Llama-3-Groq-8B-Tool-Use
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Ultra Instruct
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
FA
Falcon3 10B Instruct Abliterated
Falcon · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
LL
Rombos LLM 70b Llama 3.3
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
MA
Magnum v4 9b
Magnum · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
Qwen3 14B Ft Limo
Qwen · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
RE
Replete LLM Mist Nemo 12b test merged 250k
Replete · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
IN
Intern S2 397B
InternLM · bartowski
Params403B
Context256K
Q4_K_M254.6 GB
GL
Glistening Gem 31B v2.0
Glistening · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
QW
GrayLine Qwen3 8B
Qwen · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
NE
L3.3 MS Nevoria 70b
Nevoria · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
BE
Beepo 22B
Beepo · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
MA
Magidonia 24B v4.2.0
Magidonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
LL
Wayfarer Large 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
FR
Frontis MA1 35B
Frontis · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
PA
Pantheon Rp 1.6 12b Nemo
Pantheon · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
BigBubba Qwen3.6 27B
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
NE
Nemotron 3 Super 120B A12B
Nemotron · bartowski
Params121B
Context1024K
Q4_K_M87.0 GB
QW
Qwen3 VL 32B Thinking
Qwen · bartowski
Params32.8B
Context256K
Q4_K_M19.8 GB
SM
SmolVLM2 2.2B Instruct Agentic GUI
Smolvlm · bartowski
Params1.81B
Context8K
Q4_K_M1.1 GB
GR
granite embedding 125m english
Granite · bartowski
Params124M
Context512
Q4_K_M0.1 GB
LL
LongWriter Llama3.1 8b
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB