GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
PY
Pythia 12b Deduped
Pythia · mradermacher
Params11.8B
Context2K
Q4_K_M7.6 GB
HA
Hathor_Respawn-L3-8B-v0.8
Hathor · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
OP
OpenChat 3.5 7B SOLAR v2.0 i1
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GE
Gemma 2 27b It
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
MI
Codestral-21B-Pruned
Mistral · mradermacher
Params21.5B
Context32K
Q4_K_M12.8 GB
MI
MiroThinker 1.7 Mini
Mirothinker · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
SP
Spark X2.6 4B Uncensored
Spark · mradermacher
Params4.11B
Context1024K
Q4_K_M2.6 GB
WE
WestLake 7B v2
Westlake · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
LL
Llama 3.2 Chibi 3B i1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
QW
Qwen3.6 40B Claude 4.6 Opus Deckard Heretic Uncensored Thinking
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
MI
MinerU2.5 Pro 2604 1.2B
Mineru · mradermacher
Params494M
Context8K
Q4_K_M0.4 GB
EU
Eurus 70b nca fixed
Eurus · mradermacher
Params69B
Context16K
Q4_K_M41.4 GB
PR
prodigy sm base v0.1
Prodigy · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
MARTHA 73B Qwen2 VL i1
Qwen · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
EU
EuroLLM 9B Instruct Heretic
Eurollm · mradermacher
Params9.15B
Context4K
Q4_K_M5.6 GB
SE
Seed Coder 8B Instruct
Seed · mradermacher
Params8.25B
Context32K
Q4_K_M5.1 GB
QW
Huihui Qwen3 4B Instruct 2507 Abliterated
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
NE
NeuralExperiment 7b MagicCoder v7
Neuralexperiment · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MA
Magnum Picaro 0.7 v2 12b i1
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
OX
OxytocinErosEngineeringF1 7B slerp
Oxytocinerosengineeringf · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
AS
Astrollama 3 8b Chat_Summary
Astrollama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen3.5 27B Deckard PKD Heretic Uncensored Thinking
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
TU
Turbo Ai 7b
Turbo · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GE
Gemma 4 E2B It GMCE
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
NE
Neuraltranslate 27b Mt Nah Es v1
Neuraltranslate · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
RE
Rei 12B V3 Base
Rei · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
VE
Veloxy 1B
Veloxy · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
CA
CARA Sage 24B
Cara · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
PE
PersonaVLM
Personavlm · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
HU
Huihui OmniCoder 9B Abliterated
Huihui · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB