GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
TR
Translategemma 12b It
Translategemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
CH
Chocolatine 14B Instruct 4k DPO
Chocolatine · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
GR
Granite 7b Base
Granite · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
QW
Qwen3 30B A3B Instruct 2507
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
CO
CodeV-DS-6.7B
Codev · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
GR
Grok Oss Revenant 70B
Grok · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
HE
HelpingAI flash
Helpingai · mradermacher
Params2.24B
Context4K
Q4_K_M1.4 GB
GGUF
MY
MythoLogic-13b
Mythologic · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
NE
Nexa AI 4x4B Instruct
Nexa · mradermacher
Params12.1B
Context256K
Q4_K_M7.4 GB
GGUF
DE
DeepSeek R1 Codegeneration COT
DeepSeek · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
CodingReasoning
SO
SOLAR 10.7b Ko Y24_v1.0
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
KI
KittyNyanster v1
Kittynyanster · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
Roleplay
QW
Qwen1.5-32B
Qwen · mradermacher
Params32.5B
Context32K
Q4_K_M19.7 GB
GGUF
HO
Holo4 27B Abliterix
Holo · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
GR
Granite 8b Code Base 4k
Granite · mradermacher
Params8.05B
Context4K
Q4_K_M4.9 GB
Coding
ST
starcoder2-15b-instruct-rpgle
StarCoder · mradermacher
Params16B
Context16K
Q4_K_M9.9 GB
Coding
SM
SmolLlamix 8x101M
Smolllamix · mradermacher
Params399M
Context32K
Q4_K_M0.3 GB
GGUF
MU
Muse Glimmer 30B Uncensored
Muse · mradermacher
Params27.9B
Context128K
Q4_K_M16.9 GB
Vision
QW
Qwen3.8 27B Human KO Enterprise Boundary
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Tool use
RO
Rocinante X 12B v1 Absolute Heresy
Rocinante · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
ST
MN 12B Starcannon v3 i1
Starcannon · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
Meta Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
TO
Tower Plus 9B Abliterated Hf Data
Tower · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GR
Granite 34b Code Base 8k
Granite · mradermacher
Params33.7B
Context8K
Q4_K_M21.4 GB
Coding
LL
Meta-Llama-3-70B-Instruct
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
CY
Cyber Ornith 1.5 9B OBLITERATED
Cyber · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningTool use
QW
CyberNeurova Qwen2.5 VL 3B Instruct Abliterated
Qwen · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
QW
Qwen3 30B A3B Instruct 2507 FT
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
IN
OpenChat 3.5 7B InternLM v2.0
InternLM · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
QW
Qwen3.8 27b Noslop
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use

Keep browsing