GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
PS
Psyonic-Rose-20B-Higher-Quality
Psyonic · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
BL
BlackMagic-7B
Blackmagic · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
PY
Pythia 1b
Pythia · mradermacher
Params1.01B
Context2K
Q4_K_M0.7 GB
GGUF
MI
T3Q Mistral Orca Math DPO
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
QW
Qwen2.5 Furry 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Roleplay
QW
Haru Qwen3 4b
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
Roleplay
MI
ANIMA Cognitive Mistral v1 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GL
LFM2 12B A1B GLM 4.7 Thinking Quantum IQ1C P TR1 S2
GLM · mradermacher
Params11.3B
Context125K
Q4_K_M6.8 GB
CodingReasoningRoleplay
AH
Ahma-3B
Ahma · mradermacher
Params3.63B
Context2K
Q4_K_M2.8 GB
GGUF
LL
CodeLlama 7b Python Hf
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
CO
Codeqwen3 14b
Codeqwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
CodingReasoning
LL
Phind CodeLlama 34B v2
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
QW
OPSD Qwen3 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
RA
RakutenAI 7B
Rakutenai · mradermacher
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
LL
WizardLM Mistral CodeLlama 7b
Llama · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
LL
Llama 3.1 Nemotron 70B Instruct HF i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
TI
TigerCoder 12B
Tigercoder · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Coding
PR
PromptEnhancer 32B
Promptenhancer · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
GGUF
QW
X Coder SFT Qwen3 8B
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
Coding
LL
Llama-3-Mopeyfied-Psychology-v2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama3-8B-DarkIdol-2.1-Uncensored-1048K
Llama · mradermacher
Params8B
Context1024K
Q4_K_M4.9 GB
Roleplay
QW
qwen2.5 coder 32b combined verilog c i1
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.8 GB
Coding
MI
Mixtral AI CyberUltron DPO
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
XO
XortronCriminalComputingConfig
Xortroncriminalcomputingconfig · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
LF
LFM2.5 24B A2B Abliterated
Lfm · mradermacher
Params24B
Context128K
Q4_K_M14.5 GB
ReasoningTool use
GU
Guanaco 13B Uncensored
Guanaco · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AN
AnLLM-EP-xllarge-wikiart
Anllm · mradermacher
Params368M
Context4K
Q4_K_M0.2 GB
GGUF
GR
Granite 3b Code Base 2k
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
Coding
LL
Llama32 1b Llm Abliteration
Llama · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
Tool use
GR
GroundGUI 8B
Groundgui · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision

Keep browsing