GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
SP
Split Untied 31B
Split · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
MP
Mpt 30b Instruct
Mpt · mradermacher
Params30B
Context8K
Q4_K_M19.1 GB
PH
Phonellm Mini Alpha 2
Phonellm · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
NO
Nous Puffin 70B i1
Nous · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
NA
NaNovel 35B A3B
Nanovel · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3 VL 32B Instruct Ultra Uncensored Heretic
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
QW
Qwen3-4B-Nymphaea-RP
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
LF
LFM2.5 2.6B UNCENSORED ABLITERATED PHILADELPHIA CLASS
Lfm · mradermacher
Params2.7B
Context125K
Q4_K_M1.7 GB
IN
InverseCoder-DS-6.7B
Inversecoder · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
MA
MagpieLM 8B Chat v0.1 i1
Magpielm · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
AI
airoboros 34b 3.3 i1
Airoboros · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
WI
winter garden 7b alpha
Winter · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
CA
CantoneseLLM v2.0 30B A3B Thinking Chat Vector Merged
Cantonesellm · mradermacher
Params30.5B
Context40K
Q4_K_M18.6 GB
NO
Noromaid 13B 0.4 DPO i1
Noromaid · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
ST
Starcoderplus
StarCoder · mradermacher
Params15.8B
Context8K
Q4_K_M10.1 GB
MO
Morpho 1.5B Distill
Morpho · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
LL
Meta-Llama-3-8B-Instruct-abliterated-v3
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen3 32B Abliterated
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
DE
DeepSeek R1 Distill Qwen 1.5B uncensored
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
QW
Qwen3 1.7b Abliterated
Qwen · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
LF
LFM2.5 24B A2B Uncensored
Lfm · mradermacher
Params24B
Context128K
Q4_K_M14.5 GB
MI
mistral 7b orpo capybara reproduction
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
LO
Loopl 0.8b
Loopl · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
MI
RenCoder Ministral 8B Instruct 2410
Mistral · mradermacher
Params8B
Context32K
Q4_K_M4.9 GB
ME
Mephisto 1.0 4B
Mephisto · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ME
Mephisto 1.5 4B
Mephisto · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
MI
ANITA NEXT 24B Magistral 2506 VISION ITA
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
IN
Internlm2 Math 7b
InternLM · mradermacher
Params7.74B
Context8K
Q4_K_M4.7 GB
QW
Qwen2.5 32B
Qwen · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
QW
Qwen2.5 Coder 14B E2E Tests
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB