GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Hermes-2-Pro-Llama-3-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
EV
FutureMa Eva 4B
Eva · bartowski
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool use
ST
stable-code-instruct-3b
Stable · bartowski
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
QW
FuseChat Qwen 2.5 7B Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
LU
Lumimaid v0.2 12B
Lumimaid · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
Rombos Qwen2.5 Writer 32b
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.8 GB
Tool use
LL
Skywork O1 Open Llama3.1 8B
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Fireball Meta Llama 3.1 8B Instruct Agent 0.003 128K Code Ds Auto
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
QW
Qwen2-72B-Instruct
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
LL
SLIMER PARALLEL LLaMA3
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
BE
Behemoth ReduX 123B v1.1
Behemoth · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
Tool use
LY
MN 12B Lyra v1
Lyra · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
ST
Starcannon Unleashed 12B v1.0
Starcannon · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
EX
EXAONE 4.0 1.2B
Exaone · bartowski
Params1.28B
Context64K
Q4_K_M0.8 GB
ReasoningTool use
CA
calme-3.1-instruct-78b
Calme · bartowski
Params78B
Context32K
Q4_K_M50.7 GB
GGUF
MU
TQ3.5 27B Musica v1
Musica · bartowski
Params26.9B
Context256K
Q4_K_M17.5 GB
ReasoningRoleplayTool use
GW
GWQ 9B Preview2
Gwq · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LL
Sparse Llama 3.1 8B 2of4
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Cogito v2 Preview Llama 109B MoE
Llama · bartowski
Params108B
Context256K
Q4_K_M67.7 GB
ReasoningTool use
MI
Mistral Small Instruct 2409 Abliterated
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
MI
MiniMax M2 THRIFT
Minimax · bartowski
Params173B
Context192K
Q4_K_M104.6 GB
CodingReasoningTool use
QW
nbeerbower Dumpling Qwen2.5 14B
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
RA
raspberry 3B
Raspberry · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
CR
Crimson Dawn V0.1
Crimson · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
Qwen2 Math 1.5B Instruct
Qwen · bartowski
Params1.54B
Context4K
Q4_K_M1.0 GB
GGUF
QW
Qwen3 30B A3B Mixture 2507
Qwen · bartowski
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
NE
Nera Noctis 12B
Nera · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LF
LFM2 350M Extract
Lfm · bartowski
Params354M
Context125K
Q4_K_M0.2 GB
Tool use
GE
Tiger Gemma 9B v3
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
ST
MN 12B Starcannon v3
Starcannon · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF

Keep browsing