GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
AC
AceGPT v1.5 7B
Acegpt · mradermacher
Params6.84B
Context4K
Q4_K_M4.2 GB
MY
mythxl 70b i1
Mythxl · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
ES
MN 12B Estrella v1 i1
Estrella · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Mahou-1.3b-llama3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
IN
Indian Legal Assitant i1
Indian · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
QW
MathSmith HC Qwen3 8B Qwen2_5 32B ShortCoT
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
KU
KURE v3
Kure · mradermacher
Params1.14B
Context256K
Q4_K_M0.7 GB
QW
MiMo V2.6 Distill Qwen 9B Heretic
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
PH
Phi 2 Hyper
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
UN
una xaberius 34b v1beta i1
Una · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
NU
Nutopia 7B
Nutopia · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
LL
sheep duck llama 2 70b v1.1
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
QW
Qwen3 Coder Next Base
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
QW
OpenChat 3.5 7B Qwen v2.0
Qwen · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
YI
RpBird Yi 34B 200k i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
MI
OpenHermes-2.5-Mistral-7B-x2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mahou-1.2-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
DeepSeek-Coder-V2-Lite-Base
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
MI
MistralAI Magistral Small 2507 Heretic Uncensored
Mistral · mradermacher
Params23.6B
Context40K
Q4_K_M14.3 GB
QW
Qwen2.5 Coder 1.5B Instruct Abliterated
Qwen · mradermacher
Params1.78B
Context32K
Q4_K_M1.1 GB
MA
Magnum Blackout Ataraxy 2 9b i1
Magnum · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
IN
Internlm2 Math Plus 1_8b
InternLM · mradermacher
Params1.89B
Context8K
Q4_K_M1.2 GB
GE
Huihui Gemma 4 31B It Abliterated
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
AR
Artemis 31B v1.1 Heretic
Artemis · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
LO
Loki v5.1 i1
Loki · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3.8 4B Heretic
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
OR
Ornstein Hermes 3.6 27b SABER
Ornstein · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
NE
Nemotron Cascade 2 30B A3B Heretic Ara Uncensored
Nemotron · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
RE
Rex Frame 3B
Rex · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
SO
T3Q ko solar dpo v3.0
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.6 GB