GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
SM
SmolLM 360M Instruct
SmolLM · mradermacher
Params362M
Context2K
Q4_K_M0.3 GB
EU
Eubiota Planner 8b
Eubiota · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GR
Granite 4.1 8b Abliterated
Granite · mradermacher
Params8.38B
Context128K
Q4_K_M5.1 GB
MA
Magidonia 24B v4.3 Absolute Heresy
Magidonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MA
Marvin TheGrumpyOldAssistant 13B HF
Marvin · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen3.5 9B Unredacted MAX
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
LI
LittleInstructionMaker 4B v0.1
Littleinstructionmaker · mradermacher
Params3.96B
Context8K
Q4_K_M2.4 GB
PO
Polaris VGA 9B Post1.0e
Polaris · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3.5 27B Uncensored
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
IN
InSight Doc 8B
Insight · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
PE
Peach 2.0 9B 8k Roleplay
Peach · mradermacher
Params8.83B
Context16K
Q4_K_M5.3 GB
LI
Liberated Miqu 70B
Liberated · mradermacher
Params69B
Context32K
Q4_K_M41.7 GB
LL
Llama 3.1 8B MultiReflection Instruct i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
ST
Starling LM 7B alpha ExPO
Starling · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
QW
Qwen3.8 Queen 27B
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
KR
Kronumos
Kronumos · mradermacher
Params7.6B
Context32K
Q4_K_M4.7 GB
BA
bagel 8b v1.0 i1
Bagel · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
FE
Feyospace S1 OBLITERATED
Feyospace · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
KI
Kitchoon V2 26B A4B
Kitchoon · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
QW
Qwen 3 VL 8B Instruct Heretic
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
Qwen2.5 1.5B Instruct
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
TO
Torchcast Decision 27b
Torchcast · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
CO
CorX3.8 27B
Corx · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
MI
Merge Mixtral Prometheus 8x7B i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
TE
Tema_Q R2.0 Code
Tema · mradermacher
Params8.5B
Context8K
Q4_K_M5.3 GB
MI
Dolphin Mistral 24B Venice Edition
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
LL
Hermes-2-Theta-Llama-3-8B-32k
Llama · mradermacher
Params8B
Context32K
Q4_K_M4.9 GB
OR
Ornith 1.5 27B A3B CoderX
Ornith · mradermacher
Params26.2B
Context256K
Q4_K_M16.1 GB
CA
CarbonBeagle 11B
Carbonbeagle · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
LL
dolphin-2.9.1-llama-3-70b
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB