GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
SM
SmolLM 360M Instruct
SmolLM · mradermacher
Params362M
Context2K
Q4_K_M0.3 GB
Tool use
EU
Eubiota Planner 8b
Eubiota · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
GR
Granite 4.1 8b Abliterated
Granite · mradermacher
Params8.38B
Context128K
Q4_K_M5.1 GB
GGUF
MA
Magidonia 24B v4.3 Absolute Heresy
Magidonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MA
Marvin TheGrumpyOldAssistant 13B HF
Marvin · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen3.5 9B Unredacted MAX
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
LI
LittleInstructionMaker 4B v0.1
Littleinstructionmaker · mradermacher
Params3.96B
Context8K
Q4_K_M2.4 GB
Tool use
PO
Polaris VGA 9B Post1.0e
Polaris · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
QW
Qwen3.5 27B Uncensored
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
IN
InSight Doc 8B
Insight · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
PE
Peach 2.0 9B 8k Roleplay
Peach · mradermacher
Params8.83B
Context16K
Q4_K_M5.3 GB
Roleplay
LI
Liberated Miqu 70B
Liberated · mradermacher
Params69B
Context32K
Q4_K_M41.7 GB
GGUF
LL
Llama 3.1 8B MultiReflection Instruct i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
ST
Starling LM 7B alpha ExPO
Starling · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
QW
Qwen3.8 Queen 27B
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
RoleplayVision
KR
Kronumos
Kronumos · mradermacher
Params7.6B
Context32K
Q4_K_M4.7 GB
Coding
BA
bagel 8b v1.0 i1
Bagel · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
CodingRoleplayTool use
FE
Feyospace S1 OBLITERATED
Feyospace · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
KI
Kitchoon V2 26B A4B
Kitchoon · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
ReasoningRoleplayTool use
QW
Qwen 3 VL 8B Instruct Heretic
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
QW
Qwen2.5 1.5B Instruct
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
TO
Torchcast Decision 27b
Torchcast · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
CO
CorX3.8 27B
Corx · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
MI
Merge Mixtral Prometheus 8x7B i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
TE
Tema_Q R2.0 Code
Tema · mradermacher
Params8.5B
Context8K
Q4_K_M5.3 GB
Coding
MI
Dolphin Mistral 24B Venice Edition
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
LL
Hermes-2-Theta-Llama-3-8B-32k
Llama · mradermacher
Params8B
Context32K
Q4_K_M4.9 GB
Tool use
OR
Ornith 1.5 27B A3B CoderX
Ornith · mradermacher
Params26.2B
Context256K
Q4_K_M16.1 GB
Coding
CA
CarbonBeagle 11B
Carbonbeagle · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
LL
dolphin-2.9.1-llama-3-70b
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
CodingTool use

Keep browsing