GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 8B Instruct Jbliterated v2
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
TE
Terminal RSI 27B
Terminal · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
CodingReasoningTool use
HU
Huihui4 48B A4B Abliterated
Huihui · mradermacher
Params48B
Context256K
Q4_K_M32.0 GB
GGUF
MI
Mistral Small 24B Instruct 2501 Abliterated
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
QW
Qwen2.5 2X7B Coder VisCoder Coder Instruct OlympicCoder 19B
Qwen · mradermacher
Params19B
Context32K
Q4_K_M11.6 GB
Coding
GE
Gemma 3 4B VL It GLM 4.7 Flash Heretic Uncensored Thinking
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningVision
IN
AlchemistCoder-DS-6.7B
InternLM · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
QW
Qwable 9B Claude Fable 5 OBLITERATED
Qwable · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
CO
Codegeex4 All 9b
Codegeex · mradermacher
Params9.4B
Context128K
Q4_K_M6.3 GB
GGUF
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
UN
UNA POLAR 10.7B InstructMath v2 i1
Una · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
QW
Qwen3 Sex
Qwen · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool use
GE
Aidc 5k Laos Gemma 3 4b It v2
Gemma · mradermacher
Params4.55B
Context128K
Q4_K_M2.9 GB
GGUF
EV
EAN 3B i1
Evan · mradermacher
Params3.4B
Context125K
Q4_K_M2.1 GB
Reasoning
LL
Code-Llama-Bagel-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
Coding
SC
Scout 8b
Scout · mradermacher
Params8.31B
Context32K
Q4_K_M5.1 GB
ReasoningRoleplay
YI
EVA Yi 1.5 9B 32K V1
Yi · mradermacher
Params8.83B
Context32K
Q4_K_M5.3 GB
GGUF
MY
L3-15B-MythicalMaid-t0.0001
Mythicalmaid · mradermacher
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
DA
danube2-1.8b-openhermes
Danube · mradermacher
Params1.83B
Context8K
Q4_K_M1.1 GB
Tool use
VI
VibeWorlder 30B A3B
Vibeworlder · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
DE
Qwen3.5 9B DeepSeek V4 Flash
DeepSeek · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
QW
Qwen3 Next 80B A3B Thinking GRPO Uncensored
Qwen · mradermacher
Params80B
Context256K
Q4_K_M48.5 GB
Reasoning
EE
EEVE-Korean-10.8B-instruct-v4-sft
Eeve · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
IO
IoGPT A1 Instruct i1
Iogpt · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MI
Mahou-1.2a-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HE
Hemmingway 1
Hemmingway · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
QW
Qwen3 06B 3MPER0RR Abliterated
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
GGUF
SC
Scout 4b
Scout · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningRoleplay
QW
Qwen3 42B A3B 2507 TOTAL RECALL v2 Medium MASTER CODER
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
CodingReasoning
LL
Llama-3-70B-Synthia-v3.5
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF

Keep browsing