GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
MI
ANIMA Phi Neptune Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
EL
ElEmperador
Elemperador · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral v2 orpo
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
MI
MistralMath 7B v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
YI
Yi-1.5-6B-Chat
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
OL
olmOCR 2 7B 1025
OLMo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Qwen3.5 40B Holodeck Claude Deckard Picard Heretic
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
QW
Qwen2.5 2X7B Coder Soar Qwen Coder Instruct OlympicCoder 19B
Qwen · mradermacher
Params19B
Context32K
Q4_K_M11.6 GB
GE
Gemma 4 Sphinsikus Chronist V2 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
SE
SeaLLM-7B-v2.5
Seallm · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
AI
airoboros-65b-gpt4-m2.0
Airoboros · mradermacher
Params65B
Context2K
Q4_K_M39.3 GB
LA
Laguna S 2.1 Heretic
Laguna · mradermacher
Params118B
Context1024K
Q4_K_M71.2 GB
ME
Meditron3 70B
Meditron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
FN
FNova 1.7B Chat v1
Fnova · mradermacher
Params1.72B
Context32K
Q4_K_M1.1 GB
CH
CHIMERA 4B RL
Chimera · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
KA
Kainaticulous Rp 7b
Kainaticulous · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
MultiPL-T-CodeLlama_34b
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
GE
DeskForge Gemma4 E4B
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GE
GEITje 7B
Geitje · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OR
Ornstein 122 A10B
Ornstein · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
GE
Gemma 3 12b It Vl GPT 5.1 High Heretic Uncensored Thinking
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
MI
Hermes-2-Pro-Mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
YO
Youri 7b
Youri · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
AS
Assistant_Pepe_32B
Assistant · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
QW
Qwen3 30B A3B YOYO V2 Claude 4.6 Opus High INSTRUCT
Qwen · mradermacher
Params30.5B
Context986K
Q4_K_M18.6 GB
OR
Orbita v0.1
Orbita · mradermacher
Params14.2B
Context32K
Q4_K_M9.2 GB
IN
InternVL3 78B Instruct
Internvl · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
YI
dolphin-2.9.1-yi-1.5-9b
Yi · mradermacher
Params8.83B
Context12K
Q4_K_M5.3 GB
AG
AgThinker 32B Final
Agthinker · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
GE
Gemma 4 26B A4B It Heretic Ara
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB