GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
SM
Smaug-34B-v0.1
Smaug · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
QW
Qwen2.5 VL 7B Instruct Heretic
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
CodingVision
ME
MedMO 8B Next
Medmo · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Reasoning
HE
HelpingAI 3B hindi i1
Helpingai · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
MI
Nexus IKM Mistral Instruct v0.2 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
Gemma 3 4b It Uncensored
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
LL
Llama 3.3 CURSEDMAGICALGIRL 2.5 i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
GR
granite 34b code instruct
Granite · mradermacher
Params33.7B
Context8K
Q4_K_M21.4 GB
CodingTool use
MO
MOSS Image Text Encoder Heretic
Moss · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
CodingReasoningTool use
KN
Knight Miqu 27B MoE
Knight · mradermacher
Params27.9B
Context32K
Q4_K_M16.8 GB
GGUF
HA
Hathor_Unstable-L3-8B-v0.3
Hathor · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
BO
Boulesis v2 26B A4B
Boulesis · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
ReasoningRoleplay
PS
PsyMedLewdReMM Inverted 20B i1
Psymedlewdremm · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
OX
oxy 1 small i1
Oxy · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Roleplay
SA
Sanad 1.0
Sanad · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Reasoning
DE
DeepSeek R1 Distill Llama 70B Uncensored v2 Unbiased
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
QW
Swift Qwen3.8 27B Uncensored MTP Terse Coder
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
CodingReasoning
ER
Erebus RP 12B Instruct 2608 v1
Erebus · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Roleplay
BO
Borealis 4b
Borealis · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
OM
Omni R1
Omni · mradermacher
Params7B
Context5K
Q4_K_M4.3 GB
Reasoning
OR
Ornith 1.5 9B
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
GE
Gemma 4 E4B IT ABLITERATED UNCENSORED PHILADELPHIA CLASS
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
Vision
CH
ChemLLM 20B Chat DPO
Chemllm · mradermacher
Params19.9B
Context32K
Q4_K_M12.0 GB
GGUF
GE
Gemma 4 E4B It The DECKARD Claude Opus Expresso Universe HERETIC UNCENSORED Thinking
Gemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
CodingReasoningRoleplay
DA
danube2-1.8b-Tess-v1.5
Danube · mradermacher
Params1.83B
Context8K
Q4_K_M1.1 GB
GGUF
MI
Mistral Claude merged
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
DE
DeepSeek V2 Lite Chat Uncensored Unbiased Reasoner
DeepSeek · mradermacher
Params15.7B
Context4K
Q4_K_M10.4 GB
Reasoning
QW
Qwen2.5 Coder 1.5B Unsensored DPO
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
GE
gemma 2 2b rebus solver fp16
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
AI
airoboros-2.2.1-limarpv3-y34b
Airoboros · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF

Keep browsing