GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
ON
OneJev1.5 0.8B
Onejev · mradermacher
Params1.01B
Context256K
Q4_K_M0.7 GB
Vision
SE
Seamaiiza-7B-v2-128k
Seamaiiza · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
GW
gWorld 8B
Gworld · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Coding
QW
Qwen3.8 27B ScientificBM
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
MI
Mixnu i1
Mixnu · mradermacher
Params19.8B
Context4K
Q4_K_M12.0 GB
GGUF
MP
Mpt 30b Chat
Mpt · mradermacher
Params30B
Context8K
Q4_K_M19.1 GB
Coding
MI
Mixtral AI CyberLord
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3.5 9B Theseus
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningRoleplay
DE
DeepSeek R1 Distill Llama 70B Uncensored v2
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
QW
Qwen3.5 27B Writer V2
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
NO
Notus-TheTop-7b-Passthrough
Notus · mradermacher
Params8.99B
Context32K
Q4_K_M5.4 GB
GGUF
GO
Godoter3.8 27B
Godoter · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
QW
LightGPT 7B Qwen2
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
PL
G4 Plainsong 12B
Plainsong · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
Roleplay
BA
bagel 7b v0.5
Bagel · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingRoleplayTool use
GE
Gemma 4 26B A4B It Uncensored MAX
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningVision
MA
Marco DeepResearch 8B
Marco · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
GGUF
LF
LFM2.5 1.2B Thinking Claude 4.6 Opus Heretic Uncensored DISTILL
Lfm · mradermacher
Params1.17B
Context125K
Q4_K_M0.7 GB
Reasoning
RO
roleplay mis wes
Roleplay · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
Roleplay
AE
aegolius acadicus 24b v2 i1
Aegolius · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
LL
Llama3 8b Cpt Sealionv2 Base
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
RE
REBEL-OpenChat-3.5
Rebel · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
BO
Boundary Solar Chat 2x10.7B MoE
Boundary · mradermacher
Params19.2B
Context4K
Q4_K_M11.6 GB
Tool use
GR
KV Ground 8B BaseGuiOwl1.5 0315
Ground · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
Vision
AD
Adamus-7B-slerp
Adamus · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HU
Huihui LFM2.5 8B A1B Abliterated
Huihui · mradermacher
Params8.47B
Context125K
Q4_K_M5.2 GB
GGUF
QW
Qwen3.6 35B A3B Heretic v2
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool use
TI
Tiny LLM
Tiny · mradermacher
Params13M
Context1K
Q4_K_M0.0 GB
GGUF
PA
PandafishHeatherReReloaded
Pandafishheatherrereloaded · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama-3-Instruct-8B-SPPO-Iter3
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing