GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
OM
OmniCoder Queen 9B
Omnicoder · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
SA
SatoshiNv5
Satoshinv · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
LU
Lumimaid Magnum 12B i1
Lumimaid · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
HA
Hathor_RP-v.01-L3-8B
Hathor · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
BA
BananaMind Translate V3.5 Pro
Bananamind · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
CH
CHIMERA 4B SFT
Chimera · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
RU
Rune 26b A4B
Rune · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8 Flash Next
Qwen · mradermacher
Params177B
Context256K
Smallest80.4 GB
MA
Marco Nano Instruct
Marco · mradermacher
Params8B
Context32K
Q4_K_M5.4 GB
RA
RAFT 7B
Raft · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
EV
Evolutionstory 7B v3.0
Evolutionstory · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
YI
Mahou-1.3-yi-9B
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
FA
FashionGPT 70B V1
Fashiongpt · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
AD
MN Adversary 12B v1
Adversary · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
NE
NeuralStock 7B
Neuralstock · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
QW
Qwable 9B Claude Fable 5
Qwable · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
HE
HelpingAI2.5 5B
Helpingai · mradermacher
Params5.13B
Context128K
Q4_K_M3.2 GB
PH
Phi 4 Heretic
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
AR
ArcaneEntanglement model64 70b i1
Arcaneentanglement · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
LL
dolphin-2.9-llama3-70b
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
CA
CarbonBeagle 11B i1
Carbonbeagle · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
QW
Qwen3 Hermes8B v1
Qwen · mradermacher
Params8.2B
Context40K
Q4_K_M5.0 GB
GR
GreatRag 13B slerp
Greatrag · mradermacher
Params6.74B
Context2K
Q4_K_M4.2 GB
QW
Qwen3.8 27B Antislop
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
BI
BioTakuya
Biotakuya · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
QW
Qwen3.5 27B
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
LL
Llama EveningMirai 3.3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
SW
Swish 26B A4B
Swish · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
LL
Llama2.C stories15M
Llama · mradermacher
Params24M
Context256
Q4_K_M0.0 GB
OP
Openchat_3.5
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB