GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
ST
Step 3.5 Flash REAP 149B A11B i1
Step · mradermacher
Params149B
Context256K
Q4_K_M89.9 GB
GGUF
LL
Bio Medical Llama 3 8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
CR
Crunchy onion
Crunchy · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
ER
Erk 14B
Erk · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
LL
Llama-3.1-Argunaut-1-8B-HIRPO
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
MI
Mistral Nemo Instruct 2407 abliterated i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
ST
L3.1 Storniitova 8B i1
Storniitova · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
dolphin 2.9.4 llama3.1 8b i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Coding
QW
Qwen3 VL 8B NSFW Caption V4.5
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
GP
Gpt Oss 20b RichardErkhov Heresy
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
PY
Pythia 160m
Pythia · mradermacher
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
LO
LongWriter V 7B
Longwriter · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
PE
Pelican1.0 VL 235B A22B FC
Pelican · mradermacher
Params235B
Context256K
Q4_K_M142.2 GB
Vision
MI
MissLizzy_7b_HF
Misslizzy · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3 1.7B Jailbreak Reasoning
Qwen · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
QW
I2S Qwen3 8B Confidence
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
QW
Qwen2.5 Lumen 14B
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Roleplay
LL
Llama-3-8B-Magpie-Pro-MT-UltraDPO2
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
AR
Artemis 31B v1.1 Heretic
Artemis · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
CU
CursorCore QW2.5 7B i1
Cursorcore · mradermacher
Params7.61B
Context32K
Q4_K_M4.7 GB
Coding
SQ
OG SQL 7B
Sql · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
QW
Qwen3.5 9B Polaris HighIQ THINKING
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningRoleplay
QW
Qwen2.5 1.5B Instruct Abliterated
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
Qwopus3.6 27B v1 Abliterated Preview
Qwopus · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningVision
LL
Phind CodeLlama 34B Python v1
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
QW
Qwen3 32B LoRA ECHO KK GRPO
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
QW
Qwen2.5 Godzilla Coder 51B 128k
Qwen · mradermacher
Params51B
Context128K
Q4_K_M30.7 GB
Coding
YI
Yi-1.5-9B-Chat
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
ME
Meliodas 7b dare
Meliodas · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
OM
OmniCoder Queen 9B
Omnicoder · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingRoleplayVision

Keep browsing