GGUF models by NonMiFrega

38 GGUF models quantized by NonMiFrega on Hugging Face. Sizes run from 438M to 12.9B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · NonMiFrega
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · NonMiFrega
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · NonMiFrega
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
SM
SmolLM2 1.7B Instruct 16k
SmolLM · NonMiFrega
Params1.71B
Context16K
Q4_K_M1.1 GB
GGUF
AP
Apertus v1.1 1.5B Instruct
Apertus · NonMiFrega
Params1.51B
Context4K
Q4_K_M1.0 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · NonMiFrega
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GR
Granite 4.0 H Micro
Granite · NonMiFrega
Params3.19B
Context1024K
Q4_K_M1.9 GB
GGUF
AP
Apertus v1.1 1.5B Instruct
Apertus · NonMiFrega
Params1.51B
Context4K
Smallest1.6 GB
GGUF
AP
Apertus v1.1 4B Instruct
Apertus · NonMiFrega
Params3.83B
Context4K
Q4_K_M2.4 GB
GGUF
AP
Apertus 8B 2509
Apertus · NonMiFrega
Params8.05B
Context64K
Q4_K_M5.1 GB
GGUF
GR
Granite 4.0 Micro
Granite · NonMiFrega
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
AP
Apertus v1.1 0.5B Instruct
Apertus · NonMiFrega
Params573M
Context4K
Smallest0.6 GB
GGUF
AP
Apertus v1.1 4B
Apertus · NonMiFrega
Params3.83B
Context4K
Q4_K_M2.4 GB
GGUF
AP
Apertus v1.1 4B Instruct
Apertus · NonMiFrega
Params3.83B
Context4K
Smallest4.1 GB
GGUF
AP
Apertus v1.1 1.5B
Apertus · NonMiFrega
Params1.51B
Context4K
Q4_K_M1.0 GB
GGUF
AP
Apertus v1.1 0.5B Instruct
Apertus · NonMiFrega
Params573M
Context4K
Q4_K_M0.4 GB
GGUF
AP
Apertus v1.1 0.5B
Apertus · NonMiFrega
Params438M
Context4K
Q4_K_M0.3 GB
GGUF
AP
Apertus v1.1 4B
Apertus · NonMiFrega
Params3.83B
Context4K
Smallest4.1 GB
GGUF
AP
Apertus v1.1 1.5B
Apertus · NonMiFrega
Params1.51B
Context4K
Smallest1.6 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · NonMiFrega
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
AP
Apertus 8B Instruct 2509
Apertus · NonMiFrega
Params8.05B
Context64K
Q4_K_M5.1 GB
GGUF
AP
Apertus v1.1 0.5B
Apertus · NonMiFrega
Params438M
Context4K
Smallest0.5 GB
GGUF
SM
SmolLM2 1.7B Instruct 16k
SmolLM · NonMiFrega
Params1.71B
Context16K
Smallest1.8 GB
GGUF
GE
Gemma 2 9b It
Gemma · NonMiFrega
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MI
Mistral 7B Instruct v0.1
Mistral · NonMiFrega
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
Gemma 2 2b It
Gemma · NonMiFrega
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
MI
Mistral 7B Instruct v0.3
Mistral · NonMiFrega
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
DE
Deepseek Llm 7b Chat
DeepSeek · NonMiFrega
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
SM
SmolLM 1.7B Instruct Q4 K M
SmolLM · NonMiFrega
Params1.71B
Context2K
Q4_K_M1.1 GB
Tool use
MI
mistral instruct moe experimental Q4 K M
Mistral · NonMiFrega
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF

About NonMiFrega on Hugging Face

NonMiFrega has published 38 GGUF models that ggufmodels.com tracks, across families such as Apertus, Mistral and SmolLM. The most downloaded are DeepSeek R1 Distill Qwen 1.5B, DeepSeek R1 Distill Llama 8B and DeepSeek R1 0528 Qwen3 8B.

The quants NonMiFrega publishes most often are Q4_K_M (31) and Q8_0 (7). Their Q4_K_M files range from 0.3 to 7.8 GB. Parameter counts run from 438M to 12.9B, and the longest trained context window is 1024K tokens.

Frequently asked questions

What GGUF models has NonMiFrega published?

38 models are listed here, mainly from the Apertus, Mistral and SmolLM families. The most downloaded is DeepSeek R1 Distill Qwen 1.5B.

Which quants does NonMiFrega publish?

The most common are Q4_K_M (31 models) and Q8_0 (7 models).

Keep browsing