GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
Deita-34b
Deita · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
KU
KukulStanta InfinityRP 7B slerp
Kukulstanta · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YI
Yi 1.5 9B Chat 16K Abliterated
Yi · mradermacher
Params8.83B
Context16K
Q4_K_M5.3 GB
GGUF
VI
Vistral 7B ties
Vistral · mradermacher
Params5.5B
Context32K
Q4_K_M3.5 GB
GGUF
GP
Gpt2 Xl
Gpt · mradermacher
Params1.64B
Context1K
Q4_K_M1.2 GB
GGUF
QW
Qwen3 Coder 42B A3B Instruct TOTAL RECALL MASTER CODER M 768k Ctx
Qwen · mradermacher
Params42.4B
Context768K
Q4_K_M25.7 GB
CodingReasoning
SW
Swallow MX 8x7b NVE v0.1
Swallow · mradermacher
Params46.7B
Context4K
Q4_K_M28.4 GB
GGUF
MI
Midnight Miqu 103B v1.0 i1
Midnight · mradermacher
Params103B
Context32K
Smallest22.0 GB
GGUF
MI
mistral 7b grok
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
HU
Huihui Qwopus3.5 9B v3 Abliterated
Huihui · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
EX
Experimentmultiverse 7B slerp
Experimentmultiverse · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
GR
granite-3b-code-instruct
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
CodingTool use
MI
Configurable-Mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PY
PygWin 4x7B
Pygwin · mradermacher
Params19.7B
Context4K
Q4_K_M12.1 GB
GGUF
BE
BeagleNuBuRPInfinWestLakev2 IreneRP Neural 7B slerp
Beaglenuburpinfinwestlakev · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
QW
Qwen2.5 7B Comment Sexuality Reasoner
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Reasoning
BA
BanglaLLama-3-8b-BnWiki-Base
Banglallama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
AI
airoboros l2 c70b 3.1.2
Airoboros · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
GGUF
MI
MiroThinker 1.7
Mirothinker · mradermacher
Params235B
Context256K
Q4_K_M142.2 GB
GGUF
BI
Bigstral 12b 32k
Bigstral · mradermacher
Params12.5B
Context32K
Q4_K_M7.5 GB
GGUF
QW
Qwen2.5 7B Instruct
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
GE
Gemma 4 12b Heretic Styletune Head
Gemma · mradermacher
Params12.9B
Context128K
Q4_K_M7.9 GB
GGUF
GE
Gemma 4 12B HybridAgent
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
IR
iris 7b
Iris · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
QW
Parable Qwen3 8B Claude Fable 5
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
Reasoning
GR
Groot 65B A6B 261023
Groot · mradermacher
Params118B
Context256K
Q4_K_M79.7 GB
ReasoningTool useVision
MI
MiniCPM V 4.7 35B A3B Abliterated
MiniCPM · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
MI
MiniChat 1.5 3B Sorah
Minichat · mradermacher
Params3.02B
Context4K
Q4_K_M1.8 GB
GGUF
BI
Bionic Cetacean 20B i1
Bionic · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
Roleplay
TW
tweety 7b tatar v24a
Tweety · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing