GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
GL
Glm Oss 8b
GLM · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
QW
Josiefied Qwen3 8B Abliterated v1
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
RU
RusMind Malysh 4.7
Rusmind · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
QW
Qwen3.5 9b Triple Loop Fase2
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
MI
Dolphin Mistral 24B Venice Edition
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
YI
dolphin-2.2-yi-34b-200k
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
AS
Aspire 8B model stock i1
Aspire · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
QW
Heretic Qwen3.5 4b
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Qwen2.5 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
Qwen2.5 3B Instruct Abliterated
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
WI
WizardCoder 33B V1.1
Wizardcoder · mradermacher
Params33.3B
Context16K
Q4_K_M19.9 GB
QW
Qwen3 4B Base
Qwen · mradermacher
Params4B
Context32K
Q4_K_M2.5 GB
MI
Dolphin3.0 Mistral 24B
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
VI
Vinci MLE 8B 1.0
Vinci · mradermacher
Params8.79B
Context128K
Q4_K_M5.3 GB
CU
CursorCore QW2.5 1.5B i1
Cursorcore · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
GL
Huihui GLM 4.6V Flash Abliterated
GLM · mradermacher
Params9.4B
Context128K
Q4_K_M6.2 GB
QW
Bella Bartender Qwen3 1.7b
Qwen · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
CH
ChemLLM 20B Chat DPO
Chemllm · mradermacher
Params19.9B
Context32K
Q4_K_M12.0 GB
GE
Gemma 4 19B A4B It The DECKARD Heretic Uncensored Thinking
Gemma · mradermacher
Params18.4B
Context256K
Q4_K_M12.3 GB
NE
NeuralStar_FusionWriter_4x7b
Neuralstar · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GP
Gpt Neox 20b
Gpt · mradermacher
Params20.6B
Context2K
Q4_K_M13.1 GB
LL
Llama3.3 8B Instruct Thinking Claude 4.5 Opus High Reasoning
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
RP
RPBizkit v11 12B Base
Rpbizkit · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
YI
Yi 1.5 9B Chat 16K Abliterated
Yi · mradermacher
Params8.83B
Context16K
Q4_K_M5.3 GB
SP
Spark X2.6 1.7B
Spark · mradermacher
Params1.71B
Context1024K
Q4_K_M1.1 GB
WI
WizardCoder Python 34B V1.0 i1
Wizardcoder · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
QW
Qwen 3.8 27b Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
MI
Mistral Nemo Instruct 2407 Absolute Heresy
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
NO
Nova-1.1-0.8B
Nova · mradermacher
Params1.01B
Context256K
Q4_K_M0.7 GB
S1
S1 VL 32B
mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB