GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
DE
Deita-34b
Deita · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
KU
KukulStanta InfinityRP 7B slerp
Kukulstanta · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
YI
Yi 1.5 9B Chat 16K Abliterated
Yi · mradermacher
Params8.83B
Context16K
Q4_K_M5.3 GB
VI
Vistral 7B ties
Vistral · mradermacher
Params5.5B
Context32K
Q4_K_M3.5 GB
GP
Gpt2 Xl
Gpt · mradermacher
Params1.64B
Context1K
Q4_K_M1.2 GB
QW
Qwen3 Coder 42B A3B Instruct TOTAL RECALL MASTER CODER M 768k Ctx
Qwen · mradermacher
Params42.4B
Context768K
Q4_K_M25.7 GB
SW
Swallow MX 8x7b NVE v0.1
Swallow · mradermacher
Params46.7B
Context4K
Q4_K_M28.4 GB
MI
Midnight Miqu 103B v1.0 i1
Midnight · mradermacher
Params103B
Context32K
Smallest22.0 GB
MI
mistral 7b grok
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
HU
Huihui Qwopus3.5 9B v3 Abliterated
Huihui · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
EX
Experimentmultiverse 7B slerp
Experimentmultiverse · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GR
granite-3b-code-instruct
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
MI
Configurable-Mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
PY
PygWin 4x7B
Pygwin · mradermacher
Params19.7B
Context4K
Q4_K_M12.1 GB
BE
BeagleNuBuRPInfinWestLakev2 IreneRP Neural 7B slerp
Beaglenuburpinfinwestlakev · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
QW
Qwen2.5 7B Comment Sexuality Reasoner
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
BA
BanglaLLama-3-8b-BnWiki-Base
Banglallama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
AI
airoboros l2 c70b 3.1.2
Airoboros · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
MI
MiroThinker 1.7
Mirothinker · mradermacher
Params235B
Context256K
Q4_K_M142.2 GB
BI
Bigstral 12b 32k
Bigstral · mradermacher
Params12.5B
Context32K
Q4_K_M7.5 GB
QW
Qwen2.5 7B Instruct
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GE
Gemma 4 12b Heretic Styletune Head
Gemma · mradermacher
Params12.9B
Context128K
Q4_K_M7.9 GB
GE
Gemma 4 12B HybridAgent
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
IR
iris 7b
Iris · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
QW
Parable Qwen3 8B Claude Fable 5
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GR
Groot 65B A6B 261023
Groot · mradermacher
Params118B
Context256K
Q4_K_M79.7 GB
MI
MiniCPM V 4.7 35B A3B Abliterated
MiniCPM · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
MI
MiniChat 1.5 3B Sorah
Minichat · mradermacher
Params3.02B
Context4K
Q4_K_M1.8 GB
BI
Bionic Cetacean 20B i1
Bionic · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
TW
tweety 7b tatar v24a
Tweety · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB