GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
LL
Llama 4 Scout 17B 16E Instruct
Llama · bartowski
Params108B
Context10240K
Q4_K_M67.5 GB
GE
Gemma 4 26B A4B It
Gemma · bartowski
Params25.2B
Context256K
Q4_K_M17.0 GB
QW
Qwen2.5 Coder 7B Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
ST
L3-8B-Stheno-v3.2
Stheno · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.3 70B Instruct
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
AR
Artemis 31B v1.2
Artemis · bartowski
Params30.7B
Context256K
Q4_K_M19.5 GB
LL
Llama 3.3 70B Instruct Abliterated
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
SM
SmolLM2 135M Instruct
SmolLM · bartowski
Params135M
Context8K
Q4_K_M0.1 GB
GE
Gemma 2 2b It
Gemma · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
Qwen3.5 27B
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M18.0 GB
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · bartowski
Params15.7B
Context160K
Q4_K_M10.4 GB
CO
C4Ai Command R7B 12 2024
Command R · bartowski
Params8B
Context8K
Q4_K_M5.1 GB
QW
Qwen3.6 27B
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M18.0 GB
LI
Ling 3.0 Tiny
Ling · bartowski
Params7.89B
Context128K
Q4_K_M4.9 GB
QW
Qwen2.5 Coder 14B Instruct
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
Qwen3.5 2B
Qwen · bartowski
Params1.94B
Context256K
Q4_K_M1.4 GB
QW
Qwen3 1.7B
Qwen · bartowski
Params2.03B
Context32K
Q4_K_M1.3 GB
CY
Cydonia 24B v4.3
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen2.5 Coder 7B Instruct Abliterated
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen2.5 72B Instruct
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
GE
Gemma 4 E4B It
Gemma · bartowski
Params7.5B
Context128K
Q4_K_M5.4 GB
MI
Mistral Small 3.2 24B Instruct 2506
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
FR
FrogNano 4B 2609
Frognano · bartowski
Params4.33B
Context256K
Q4_K_M2.8 GB
LL
Llama 3.2 3B Instruct
Llama · bartowski
Params3.61B
Context128K
Q4_K_M2.2 GB
OR
Ornith 1.5 35B A3B
Ornith · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
CL
Clef Flash
Clef · bartowski
Params9.1B
Context256K
Q4_K_M6.0 GB
CL
Cloudflare clef
Clef · bartowski
Params27B
Context256K
Q4_K_M17.7 GB
QW
Qwen3.5 35B A3B
Qwen · bartowski
Params35.5B
Context256K
Q4_K_M22.3 GB
OR
Orion 26B A4B v1.1
Orion · bartowski
Params25.2B
Context256K
Q4_K_M18.0 GB