GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
BO
Borealis Open 4b
Borealis · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 4 Gembrain X Core 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen3.5 9B Claude 4.6 OS HERETIC UNCENSORED INSTRUCT
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
RO
RoMistral-7b-Instruct
Romistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
DeepSeek R1 Distill Qwen 14B Uncensored
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
GE
Gemma 4 Gembrain 31B It Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
LL
Llama3 OpenBioLLM 70B i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
QW
Qwen3 14B Heretic
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
LL
openbuddy-llama3-70b-v21.2-32k
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen2.5 0.5B Instruct
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
VE
Veloxy SLM 3B
Veloxy · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
CO
CodeV SVA 14B
Codev · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
ME
Melody1437 26B A4B
Melody · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
LF
LFM2.5 8B A1B Hermes Agentic Coder Abliterated v3
Lfm · mradermacher
Params8.47B
Context125K
Q4_K_M5.2 GB
MI
MiMo Ornith 9B AGSI Abliterated HQ
Mimo · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
MI
Mistraldouble 7B task
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AI
airoboros-2.2.1-limarpv3-y34b
Airoboros · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
BE
Behemoth T1 123B
Behemoth · mradermacher
Params123B
Context128K
Q4_K_M73.2 GB
HA
Harpy 2 7B TIES
Harpy · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Huihui Gemma 4 31B It Abliterated
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
SH
shisa v2.1c lfm2 350m
Shisa · mradermacher
Params354M
Context125K
Q4_K_M0.2 GB
TE
TerraIncognita 24B
Terraincognita · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
UN
Unity Coder 7b
Unity · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
AS
astrollama 2 70b base aic
Astrollama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
BL
Blossom V6.2 8B
Blossom · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
GE
Suno Song Reasoning Generator Gemma3 12B HF
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
SE
SeaLLM-7B-v2-bonito-v1-slerp
Seallm · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MA
Mamba 370m Hf
Mamba · mradermacher
Params372M
Context1024K
Q4_K_M0.2 GB
QW
Einstein-v4-Qwen-1.5-32B
Qwen · mradermacher
Params32.5B
Context32K
Q4_K_M19.7 GB
MI
Midnight Miqu 70B v1.0
Midnight · mradermacher
Params69B
Context32K
Q4_K_M41.7 GB