GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
ANIMA Phi Neptune Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
EL
ElEmperador
Elemperador · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral v2 orpo
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
MI
MistralMath 7B v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
YI
Yi-1.5-6B-Chat
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
OL
olmOCR 2 7B 1025
OLMo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
QW
Qwen3.5 40B Holodeck Claude Deckard Picard Heretic
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
CodingReasoningRoleplay
QW
Qwen2.5 2X7B Coder Soar Qwen Coder Instruct OlympicCoder 19B
Qwen · mradermacher
Params19B
Context32K
Q4_K_M11.6 GB
CodingTool use
GE
Gemma 4 Sphinsikus Chronist V2 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
SE
SeaLLM-7B-v2.5
Seallm · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
AI
airoboros-65b-gpt4-m2.0
Airoboros · mradermacher
Params65B
Context2K
Q4_K_M39.3 GB
GGUF
LA
Laguna S 2.1 Heretic
Laguna · mradermacher
Params118B
Context1024K
Q4_K_M71.2 GB
GGUF
ME
Meditron3 70B
Meditron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
FN
FNova 1.7B Chat v1
Fnova · mradermacher
Params1.72B
Context32K
Q4_K_M1.1 GB
ReasoningTool use
CH
CHIMERA 4B RL
Chimera · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
Reasoning
KA
Kainaticulous Rp 7b
Kainaticulous · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
LL
MultiPL-T-CodeLlama_34b
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
GE
DeskForge Gemma4 E4B
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
Vision
GE
GEITje 7B
Geitje · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OR
Ornstein 122 A10B
Ornstein · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
ReasoningVision
GE
Gemma 3 12b It Vl GPT 5.1 High Heretic Uncensored Thinking
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
ReasoningVision
MI
Hermes-2-Pro-Mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
YO
Youri 7b
Youri · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
AS
Assistant_Pepe_32B
Assistant · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
QW
Qwen3 30B A3B YOYO V2 Claude 4.6 Opus High INSTRUCT
Qwen · mradermacher
Params30.5B
Context986K
Q4_K_M18.6 GB
Reasoning
OR
Orbita v0.1
Orbita · mradermacher
Params14.2B
Context32K
Q4_K_M9.2 GB
GGUF
IN
InternVL3 78B Instruct
Internvl · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
CodingTool use
YI
dolphin-2.9.1-yi-1.5-9b
Yi · mradermacher
Params8.83B
Context12K
Q4_K_M5.3 GB
CodingTool use
AG
AgThinker 32B Final
Agthinker · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
GE
Gemma 4 26B A4B It Heretic Ara
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF

Keep browsing