GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
ON
OneJev1.5 0.8B
Onejev · mradermacher
Params1.01B
Context256K
Q4_K_M0.7 GB
SE
Seamaiiza-7B-v2-128k
Seamaiiza · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GW
gWorld 8B
Gworld · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
Qwen3.8 27B ScientificBM
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
MI
Mixnu i1
Mixnu · mradermacher
Params19.8B
Context4K
Q4_K_M12.0 GB
MP
Mpt 30b Chat
Mpt · mradermacher
Params30B
Context8K
Q4_K_M19.1 GB
MI
Mixtral AI CyberLord
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3.5 9B Theseus
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
DE
DeepSeek R1 Distill Llama 70B Uncensored v2
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3.5 27B Writer V2
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
NO
Notus-TheTop-7b-Passthrough
Notus · mradermacher
Params8.99B
Context32K
Q4_K_M5.4 GB
GO
Godoter3.8 27B
Godoter · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
LightGPT 7B Qwen2
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
PL
G4 Plainsong 12B
Plainsong · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
BA
bagel 7b v0.5
Bagel · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Gemma 4 26B A4B It Uncensored MAX
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
MA
Marco DeepResearch 8B
Marco · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
LF
LFM2.5 1.2B Thinking Claude 4.6 Opus Heretic Uncensored DISTILL
Lfm · mradermacher
Params1.17B
Context125K
Q4_K_M0.7 GB
RO
roleplay mis wes
Roleplay · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
AE
aegolius acadicus 24b v2 i1
Aegolius · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
LL
Llama3 8b Cpt Sealionv2 Base
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
RE
REBEL-OpenChat-3.5
Rebel · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
BO
Boundary Solar Chat 2x10.7B MoE
Boundary · mradermacher
Params19.2B
Context4K
Q4_K_M11.6 GB
GR
KV Ground 8B BaseGuiOwl1.5 0315
Ground · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
AD
Adamus-7B-slerp
Adamus · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
HU
Huihui LFM2.5 8B A1B Abliterated
Huihui · mradermacher
Params8.47B
Context125K
Q4_K_M5.2 GB
QW
Qwen3.6 35B A3B Heretic v2
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
TI
Tiny LLM
Tiny · mradermacher
Params13M
Context1K
Q4_K_M0.0 GB
PA
PandafishHeatherReReloaded
Pandafishheatherrereloaded · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama-3-Instruct-8B-SPPO-Iter3
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB