GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
HE
Hemmingway 1.5
Hemmingway · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
LL
Llama3.1 8B ShiningValiant2
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GE
GELab Zero 4B Preview
Gelab · bartowski
Params4B
Context256K
Q4_K_M2.5 GB
QW
MN 2407 DSK QwQify v0.1 12B
Qwen · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
PH
Phi 4 Reasoning
Phi · bartowski
Params14.7B
Context32K
Q4_K_M9.1 GB
IN
INTELLECT 3
Intellect · bartowski
Params107B
Context128K
Q4_K_M71.4 GB
LL
Llama-3-Patronus-Lynx-70B-Instruct
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
QW
Qwen2.5 32b RP Ink
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
DE
DeepSeek-Coder-V2-Instruct
DeepSeek · bartowski
Params236B
Context160K
Q4_K_M142.5 GB
QW
ThinkingCap Qwen3.6 27B
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
IN
INTELLECT 1 Instruct
Intellect · bartowski
Params10.2B
Context8K
Q4_K_M6.2 GB
GE
Gemma4 Gutenberg 31B Heretic
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
PH
Phi 3.5 Mini 3.8B ArliAI RPMax v1.1
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
LL
Llama 3.1 SuperNova Lite
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
NE
AceReason Nemotron 14B
Nemotron · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
PH
Phi 4 Mini Reasoning
Phi · bartowski
Params3.84B
Context128K
Q4_K_M2.5 GB
LL
Meta Llama 3.1 8B Claude
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
DA
G4 Dark Soul 26B A4B
Dark · bartowski
Params25.2B
Context256K
Q4_K_M17.0 GB
PA
Pantheon Proto RP 1.8 30B A3B
Pantheon · bartowski
Params30.5B
Context32K
Q4_K_M18.6 GB
LL
Llama 3_1 Nemotron 51B Instruct
Llama · bartowski
Params51.5B
Context128K
Q4_K_M31.0 GB
MI
MiniCPM V 2 6
MiniCPM · bartowski
Params7.6B
Context32K
Q4_K_M4.7 GB
DE
DeepSeek V2.5
DeepSeek · bartowski
Params236B
Context160K
Q4_K_M142.5 GB
LU
Lumimaid Magnum v4 12B
Lumimaid · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
LF
LFM2 24B A2B
Lfm · bartowski
Params23.8B
Context125K
Q4_K_M14.4 GB
CY
Cydonia 22B v1.2
Cydonia · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
LL
Llama-3-Groq-70B-Tool-Use
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
CO
CogEvol 4B
Cogevol · bartowski
Params4.21B
Context256K
Q4_K_M2.9 GB
GL
GLM 4.5 Air
GLM · bartowski
Params110B
Context128K
Q4_K_M73.5 GB
RE
Replete-Coder-Instruct-8b-Merged
Replete · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
CO
Codex 24B Small 3.2
Codex · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB