GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
TR
Translategemma 12b It
Translategemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
CH
Chocolatine 14B Instruct 4k DPO
Chocolatine · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
GR
Granite 7b Base
Granite · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
QW
Qwen3 30B A3B Instruct 2507
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
CO
CodeV-DS-6.7B
Codev · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
GR
Grok Oss Revenant 70B
Grok · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
HE
HelpingAI flash
Helpingai · mradermacher
Params2.24B
Context4K
Q4_K_M1.4 GB
MY
MythoLogic-13b
Mythologic · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
NE
Nexa AI 4x4B Instruct
Nexa · mradermacher
Params12.1B
Context256K
Q4_K_M7.4 GB
DE
DeepSeek R1 Codegeneration COT
DeepSeek · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
SO
SOLAR 10.7b Ko Y24_v1.0
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
KI
KittyNyanster v1
Kittynyanster · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
QW
Qwen1.5-32B
Qwen · mradermacher
Params32.5B
Context32K
Q4_K_M19.7 GB
HO
Holo4 27B Abliterix
Holo · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GR
Granite 8b Code Base 4k
Granite · mradermacher
Params8.05B
Context4K
Q4_K_M4.9 GB
ST
starcoder2-15b-instruct-rpgle
StarCoder · mradermacher
Params16B
Context16K
Q4_K_M9.9 GB
SM
SmolLlamix 8x101M
Smolllamix · mradermacher
Params399M
Context32K
Q4_K_M0.3 GB
MU
Muse Glimmer 30B Uncensored
Muse · mradermacher
Params27.9B
Context128K
Q4_K_M16.9 GB
QW
Qwen3.8 27B Human KO Enterprise Boundary
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
RO
Rocinante X 12B v1 Absolute Heresy
Rocinante · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
ST
MN 12B Starcannon v3 i1
Starcannon · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Meta Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
TO
Tower Plus 9B Abliterated Hf Data
Tower · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GR
Granite 34b Code Base 8k
Granite · mradermacher
Params33.7B
Context8K
Q4_K_M21.4 GB
LL
Meta-Llama-3-70B-Instruct
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
CY
Cyber Ornith 1.5 9B OBLITERATED
Cyber · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
CyberNeurova Qwen2.5 VL 3B Instruct Abliterated
Qwen · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
QW
Qwen3 30B A3B Instruct 2507 FT
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
IN
OpenChat 3.5 7B InternLM v2.0
InternLM · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
QW
Qwen3.8 27b Noslop
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB