GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
PA
pandafish 2 7b 32k
Pandafish · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
OpenMia Indo Engineering 7b i1
Openmia · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LI
LimyQstar 7B slerp
Limyqstar · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
CA
CalmeRys 78B Orpo v0.1 i1
Calmerys · mradermacher
Params78B
Context32K
Smallest24.3 GB
GGUF
QW
Qwopus3.6 27B v1 Preview
Qwopus · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningVision
CO
cosmo-1b
Cosmo · mradermacher
Params1.74B
Context2K
Q4_K_M1.1 GB
GGUF
YI
Yi-1.5-6B
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
GR
GreenOgno-7b-passthrough
Greenogno · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
CAT Translate 7b
Cat · mradermacher
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF
AB
ABD3ID CodeMentor
Abd · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingVision
YI
yihao llm 7b i1
Yihao · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
NE
Nemomix v3.0 12B i1
Nemomix · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
BA
BagelWorldTour-8x7B
Bagelworldtour · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
SA
Sahya 7B slerp
Sahya · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
Embedding
QW
DAU_Qwen3.6_27B_H2_FT
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Roleplay
MA
MAmmoTH2-8x7B
Mammoth · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
HE
HelpingAI-9B-200k
Helpingai · mradermacher
Params8.83B
Context195K
Q4_K_M5.3 GB
GGUF
RO
MN RocinanteCelestar 12B i1
Rocinantecelestar · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
AR
arco interpreter v1.2
Arco · mradermacher
Params514M
Context8K
Q4_K_M0.3 GB
GGUF
MI
MixTAO 7Bx2 MoE v8.1
Mixtao · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
QW
Gliese Qwen3.5 9B Abliterated Caption
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
NE
NeuralSOTA 7B slerp
Neuralsota · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
JO
JoyFox-Reverie-27B
Joyfox · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
RoleplayVision
QW
RWKV6QwQ 32B Final 250307
Qwen · mradermacher
Params34.9B
Context1024K
Q4_K_M22.8 GB
Reasoning
FA
Fabliq 8B Agent FromBase Reasoning
Fabliq · mradermacher
Params8.47B
Context125K
Q4_K_M5.2 GB
Reasoning
SE
SeaLLM-7B-v2
Seallm · mradermacher
Params7.38B
Context32K
Q4_K_M4.5 GB
GGUF
GR
Granite 8b Code Instruct 4k
Granite · mradermacher
Params8.05B
Context4K
Q4_K_M4.9 GB
CodingTool use
WI
WizardLM 2 4x7B MoE
Wizardlm · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
TD
TDM 8b v0.1
Tdm · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
Reasoning
RA
Ramakrishna 7b v3
Ramakrishna · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF

Keep browsing