GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Suri Qwen 3.8 27B Neuro
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
ME
G4 MeroMero v2 31B
Meromero · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
QW
Qwen3 VL 4B Instruct Uncensored
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
Vision
KN
KnowLine 9B Gen1
Knowline · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool useVision
SP
SpydazWeb_AI_LCARS_Humanization_003
Spydazweb · mradermacher
Params7.24B
Context512K
Q4_K_M4.4 GB
Coding
QW
Qwen2.5 72B Instruct
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
AU
AuroraRP 8x7B i1
Aurorarp · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
Roleplay
QW
Qwen2.5 7b Alpaca
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
ThinCtx Qwen3.5 0.8B
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
GGUF
FI
FimbMoister 11Range i1
Fimbmoister · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
TO
TooManyMixRolePlay-7B-Story_V2
Toomanymixroleplay · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
HY
Hy MT2 30B A3B
mradermacher
Params30B
Context256K
Q4_K_M18.2 GB
GGUF
DU
dulia 13b 8k alpha i1
Dulia · mradermacher
Params13B
Context8K
Q4_K_M7.9 GB
GGUF
GE
Darkidol Gemma 4 E4B It
Gemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
Roleplay
NI
Ninja-v1-NSFW-RP
Ninja · mradermacher
Params7.24B
Context4K
Q4_K_M4.4 GB
Roleplay
MP
Mpt 7b 8k
Mpt · mradermacher
Params6.65B
Context8K
Q4_K_M4.3 GB
GGUF
HO
K2-Horizon-7B
Horizon · mradermacher
Params9B
Context512K
Q4_K_M5.6 GB
GGUF
ST
Starcoder2 3b
StarCoder · mradermacher
Params3.03B
Context16K
Q4_K_M1.9 GB
Coding
DE
Deepseek Coder 7b Instruct v1.5
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
Coding
MA
MAI Gym 9B
Mai · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
QW
Qwen3 Coder 30B A3B Instruct
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
GR
Groot 19B A3B 261023
Groot · mradermacher
Params19B
Context256K
Q4_K_M11.7 GB
ReasoningTool use
QW
Ostrich 27B 261008 Qwen3.8 Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
CA
CalibForge 35B A3B
Calibforge · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
QW
ThinCtx Qwen3.5 2B
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
GGUF
AC
ActIO-UI-7B-RLVR
Actio · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
HO
K2 Horizon 7B UnrealEngine
Horizon · mradermacher
Params9B
Context512K
Q4_K_M5.6 GB
CodingReasoningTool use
GE
Gemma 4 26B A4B It Uncensored Heretic
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
QW
Qwen3.6 35B A3B Claude 4.7 Opus Reasoning Distilled
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Reasoning
LL
Hermes 3 Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use

Keep browsing