GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
OM
OmniCoder Queen 9B
Omnicoder · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingRoleplayVision
SA
SatoshiNv5
Satoshinv · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
LU
Lumimaid Magnum 12B i1
Lumimaid · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
HA
Hathor_RP-v.01-L3-8B
Hathor · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
Roleplay
BA
BananaMind Translate V3.5 Pro
Bananamind · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
Vision
CH
CHIMERA 4B SFT
Chimera · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
Reasoning
RU
Rune 26b A4B
Rune · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen3.8 Flash Next
Qwen · mradermacher
Params177B
Context256K
Smallest80.4 GB
Vision
MA
Marco Nano Instruct
Marco · mradermacher
Params8B
Context32K
Q4_K_M5.4 GB
Reasoning
RA
RAFT 7B
Raft · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoningTool use
EV
Evolutionstory 7B v3.0
Evolutionstory · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YI
Mahou-1.3-yi-9B
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
FA
FashionGPT 70B V1
Fashiongpt · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
AD
MN Adversary 12B v1
Adversary · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
NE
NeuralStock 7B
Neuralstock · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
QW
Qwable 9B Claude Fable 5
Qwable · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
HE
HelpingAI2.5 5B
Helpingai · mradermacher
Params5.13B
Context128K
Q4_K_M3.2 GB
GGUF
PH
Phi 4 Heretic
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
AR
ArcaneEntanglement model64 70b i1
Arcaneentanglement · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
dolphin-2.9-llama3-70b
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
CodingTool use
CA
CarbonBeagle 11B i1
Carbonbeagle · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
QW
Qwen3 Hermes8B v1
Qwen · mradermacher
Params8.2B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
GR
GreatRag 13B slerp
Greatrag · mradermacher
Params6.74B
Context2K
Q4_K_M4.2 GB
GGUF
QW
Qwen3.8 27B Antislop
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
BI
BioTakuya
Biotakuya · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
QW
Qwen3.5 27B
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
LL
Llama EveningMirai 3.3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
SW
Swish 26B A4B
Swish · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Roleplay
LL
Llama2.C stories15M
Llama · mradermacher
Params24M
Context256
Q4_K_M0.0 GB
GGUF
OP
Openchat_3.5
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
Coding

Keep browsing