GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
JI
JiRackUltra_7b
Jirackultra · mradermacher
Params7.6B
Context128K
Q4_K_M4.7 GB
Tool use
LL
Llama 3.1 8B Reason Blend 888k i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
ZE
Zen3 Vl
Zen · mradermacher
Params8.2B
Context256K
Q4_K_M5.0 GB
Vision
KA
Kalypso
Kalypso · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
QW
Qwen3.5 9B Brainwaves OneJev1.6
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool use
GR
Grug 27b
Grug · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
AR
Aryabhata 2.0
Aryabhata · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
Reasoning
LU
Luminaura-RP-13B
Luminaura · mradermacher
Params13B
Context128K
Q4_K_M7.9 GB
Roleplay
LL
Llama-3-Groq-8B-Tool-Use
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Lexi Llama 3 8B Uncensored
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
IN
InnoSpark3.1 27B 1008
Innospark · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
GE
MR_MARTIN_31b_V1.0_Gemma 4 Base Ftp
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
JE
JEV 9B
Jev · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
OP
OpenCerebrum 2.0 7B
Opencerebrum · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
LO
Loopl Vl 2b
Loopl · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
Tool useVision
LL
Asclepius-Llama3-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
ST
Starcoder
StarCoder · mradermacher
Params15.8B
Context8K
Q4_K_M10.1 GB
Coding
AS
ASTRA 14B Thinking v1
Astra · mradermacher
Params14.8B
Context130K
Q4_K_M9.0 GB
ReasoningTool use
QW
Qwen3 0.6B BrowserAgent
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
GGUF
MI
Noromaid v0.4 Mixtral Instruct 8x7b Zloss
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.9 GB
GGUF
NU
NuMarkdown-8B-Thinking
Numarkdown · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
ReasoningVision
GE
Gemma 4 E2B It Abliterated
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
GGUF
QW
Qwen3 8B Base
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
GGUF
PA
PathfinderAI5.0 i1
Pathfinderai · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
ReasoningTool use
TH
TherapyBeagle 11B v2 i1
Therapybeagle · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
NE
NeuralMaths Experiment 7b
Neuralmaths · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
YI
Yi-34B-200K-AEZAKMI-v2
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
NE
Next 8b
Next · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
Reasoning
IN
Index Translate 9B
Index · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
Vision
GE
Gemma 4 Novelist Eclipse 31B
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
ReasoningRoleplayTool use

Keep browsing