GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
MI
Magistral Small 2507 Rebased Vision
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
CO
Cosmos Reason1 7B Heretic
Cosmos · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
LL
Meta Llama 3.1 8B Instruct
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 Youko 8b Instruct
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen2.5 Coder 7B Instruct Uncensored
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GE
Gemma 4 Orthia 31B
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
GE
Gemma4 E4B Mahou Nsfw
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
LL
Llama-3-Swallow-70B-v0.1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
PY
Pythia 6.9b Deduped
Pythia · mradermacher
Params6.86B
Context2K
Q4_K_M4.4 GB
QW
Qwen3.5 9B Cyberpunk2077 Xiaotian All4 5pass
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
QW
Swift 1.5 Qwen3.8 27b Heretic
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
AR
Artemis 31B v1.2
Artemis · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
BA
BabyHercules 4x150M
Babyhercules · mradermacher
Params411M
Context2K
Q4_K_M0.3 GB
DE
Deepseek Llm 7b Chat Abliterated
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
GO
Goetia 26B A4B v1.5
Goetia · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
IG
Ignis 7B DPO Laser
Ignis · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
NE
Daredevil-8B-abliterated-dpomix
Neuraldaredevil · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
BO
Borealis Open 270m
Borealis · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
B3
B3 27B i1
mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
TR
Truthful DPO TomGrc FusionNet 7Bx2 MoE 13B i1
Truthful · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
ST
State of the MoE RP 3x7b
State · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
DA
DarkForest 20B v2.0 Erebus Edition
Darkforest · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
AM
amalia-desenrasca-9b
Amalia · mradermacher
Params9.15B
Context32K
Q4_K_M5.6 GB
LL
archangel_sft-kto_llama30b
Llama · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
PH
Phi 3 Medium 128k Instruct
Phi · mradermacher
Params14B
Context128K
Q4_K_M8.6 GB
MP
Mpt 30b
Mpt · mradermacher
Params30B
Context8K
Q4_K_M19.1 GB
SP
Spikingkiki 122b A10B
Spikingkiki · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
DA
Darwin 27B RSI
Darwin · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
LL
Llama-2-7b-pruned70-retrained-gsm8k
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
AC
Acolyte 22B i1
Acolyte · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB