GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
BO
Borealis Open 4b
Borealis · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma 4 Gembrain X Core 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplay
QW
Qwen3.5 9B Claude 4.6 OS HERETIC UNCENSORED INSTRUCT
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningRoleplayTool use
RO
RoMistral-7b-Instruct
Romistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Reasoning
DE
DeepSeek R1 Distill Qwen 14B Uncensored
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
GE
Gemma 4 Gembrain 31B It Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplay
LL
Llama3 OpenBioLLM 70B i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
QW
Qwen3 14B Heretic
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
LL
openbuddy-llama3-70b-v21.2-32k
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Qwen2.5 0.5B Instruct
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
VE
Veloxy SLM 3B
Veloxy · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
CO
CodeV SVA 14B
Codev · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
ME
Melody1437 26B A4B
Melody · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Roleplay
LF
LFM2.5 8B A1B Hermes Agentic Coder Abliterated v3
Lfm · mradermacher
Params8.47B
Context125K
Q4_K_M5.2 GB
CodingReasoningTool use
MI
MiMo Ornith 9B AGSI Abliterated HQ
Mimo · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
MI
Mistraldouble 7B task
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AI
airoboros-2.2.1-limarpv3-y34b
Airoboros · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
BE
Behemoth T1 123B
Behemoth · mradermacher
Params123B
Context128K
Q4_K_M73.2 GB
ReasoningRoleplay
HA
Harpy 2 7B TIES
Harpy · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
Huihui Gemma 4 31B It Abliterated
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
SH
shisa v2.1c lfm2 350m
Shisa · mradermacher
Params354M
Context125K
Q4_K_M0.2 GB
GGUF
TE
TerraIncognita 24B
Terraincognita · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
UN
Unity Coder 7b
Unity · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
AS
astrollama 2 70b base aic
Astrollama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
BL
Blossom V6.2 8B
Blossom · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
GGUF
GE
Suno Song Reasoning Generator Gemma3 12B HF
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Reasoning
SE
SeaLLM-7B-v2-bonito-v1-slerp
Seallm · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MA
Mamba 370m Hf
Mamba · mradermacher
Params372M
Context1024K
Q4_K_M0.2 GB
GGUF
QW
Einstein-v4-Qwen-1.5-32B
Qwen · mradermacher
Params32.5B
Context32K
Q4_K_M19.7 GB
CodingTool use
MI
Midnight Miqu 70B v1.0
Midnight · mradermacher
Params69B
Context32K
Q4_K_M41.7 GB
GGUF

Keep browsing