GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
llama-3-sqlcoder-8b
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
Coding
DE
Deepseek Wizard 33B slerp
DeepSeek · mradermacher
Params17.4B
Context16K
Q4_K_M10.5 GB
Coding
QW
Qwen2.5 14B
Qwen · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
DE
DeepSeek R1 Distill Qwen 32B Abliterated
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
ET
Eternal.Bondange 3.2 1B
Eternal · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
Tool use
HU
Huihui HY MT1.5 1.8B Abliterated
Huihui · mradermacher
Params1.79B
Context256K
Q4_K_M1.1 GB
GGUF
QW
Qwen3.8 27B Humanlike Chat 2.0
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
RoleplayTool useVision
LL
Llama 3.1 8B xLAM Agent
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Tool use
RS
RSR 27B
Rsr · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen2.5 72B Instruct Malaysian
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
ST
MN Starlight Sylph 12B
Starlight · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
GA
Garryvik-0.1-7b-Linear
Garryvik · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TA
UI TARS 2B SFT
Tars · mradermacher
Params1.78B
Context32K
Q4_K_M1.1 GB
Vision
BO
Boulesis v2.1 26B A4B
Boulesis · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
ReasoningRoleplayTool use
GE
Gemma4 E4B Mahou Nsfw
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
Roleplay
LL
llama 2 7b chat sexed version5
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
PA
Palette RP 9B 2609 v0.05
Palette · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
Roleplay
QW
Qwen3.5 9B GLM5.1 Distill v1
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Reasoning
SC
ScienceRSI 8b
Sciencersi · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
JU
juanako 7b UNA i1
Juanako · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GR
Grug 35b v2
Grug · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
FL
Q3.6 27B DS v4 Flash DA
Flash · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Reasoning
TR
Transliteration 2.0 0.8B Safetensors
Transliteration · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool use
CA
MN CaptainErisNebula Chimera v1.1 THINKING ClaudeOpus4.5 12B Heretic Uncensored
Captainerisnebula · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
ReasoningRoleplay
LL
Llama 3.1 8B Instruct Jbliterated
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
MI
ANIMA Phi Neptune Mistral 10.7B
Mistral · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
GR
granite-3b-code-base
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
Coding
GE
DiarizationLM Gemma 4 E4B v1
Gemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
Vision
NO
NoisyGRPO_7B
Noisygrpo · mradermacher
Params7.6B
Context125K
Q4_K_M4.7 GB
GGUF
LL
CodeLlama 7b Instruct Hf
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding

Keep browsing