GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
QW
Suri Qwen 3.8 27B Neuro
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ME
G4 MeroMero v2 31B
Meromero · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen3 VL 4B Instruct Uncensored
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
KN
KnowLine 9B Gen1
Knowline · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
SP
SpydazWeb_AI_LCARS_Humanization_003
Spydazweb · mradermacher
Params7.24B
Context512K
Q4_K_M4.4 GB
QW
Qwen2.5 72B Instruct
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
AU
AuroraRP 8x7B i1
Aurorarp · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
QW
Qwen2.5 7b Alpaca
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
ThinCtx Qwen3.5 0.8B
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
FI
FimbMoister 11Range i1
Fimbmoister · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
TO
TooManyMixRolePlay-7B-Story_V2
Toomanymixroleplay · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
HY
Hy MT2 30B A3B
mradermacher
Params30B
Context256K
Q4_K_M18.2 GB
DU
dulia 13b 8k alpha i1
Dulia · mradermacher
Params13B
Context8K
Q4_K_M7.9 GB
GE
Darkidol Gemma 4 E4B It
Gemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
NI
Ninja-v1-NSFW-RP
Ninja · mradermacher
Params7.24B
Context4K
Q4_K_M4.4 GB
MP
Mpt 7b 8k
Mpt · mradermacher
Params6.65B
Context8K
Q4_K_M4.3 GB
HO
K2-Horizon-7B
Horizon · mradermacher
Params9B
Context512K
Q4_K_M5.6 GB
ST
Starcoder2 3b
StarCoder · mradermacher
Params3.03B
Context16K
Q4_K_M1.9 GB
DE
Deepseek Coder 7b Instruct v1.5
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
MA
MAI Gym 9B
Mai · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3 Coder 30B A3B Instruct
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GR
Groot 19B A3B 261023
Groot · mradermacher
Params19B
Context256K
Q4_K_M11.7 GB
QW
Ostrich 27B 261008 Qwen3.8 Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
CA
CalibForge 35B A3B
Calibforge · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
ThinCtx Qwen3.5 2B
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
AC
ActIO-UI-7B-RLVR
Actio · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
HO
K2 Horizon 7B UnrealEngine
Horizon · mradermacher
Params9B
Context512K
Q4_K_M5.6 GB
GE
Gemma 4 26B A4B It Uncensored Heretic
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.6 35B A3B Claude 4.7 Opus Reasoning Distilled
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
LL
Hermes 3 Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB