GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5-0.5B-SFT-5e-5-3ep
Qwen · RichardErkhov
Params630M
Context32K
Q4_K_M0.5 GB
Tool use
LL
RealGuardrails Llama3.1 8B SFT
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · gaianet
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
AL
AlaphaMath-7B
Alphamath · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
Reasoning
MI
MiroThinker v1.0 30B Terminus
Mirothinker · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
RA
rank1 14b
Rank · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
EmbeddingTool use
GU
GUI Owl 7B
Gui · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
ReasoningTool useVision
QW
PAPO G NRef Qwen2.5 VL 7B
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
VO
Volare i1
Volare · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
RL
RLM Hinglish Translator
Rlm · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
MI
MiroThinker v1.0 30B
Mirothinker · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
PH
Phi 3 mini 4k instruct old
Phi · bartowski
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
phi 2 code instruct
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.7 GB
Coding
QW
PAPO G Qwen2.5 VL 7B
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
CO
ConspEmoLLM v2
Conspemollm · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LI
Ling Lite 1.5
Ling · mradermacher
Params16.8B
Context32K
Q4_K_M11.2 GB
GGUF
QW
NextCoder-14B
Qwen · Mungert
Params14.8B
Context32K
Q4_K_M9.1 GB
CodingTool use
LL
Nous Hermes Llama2 13b
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
Tool use
QW
NuExtract 1.5 tiny
Qwen · QuantFactory
Params630M
Context32K
Q4_K_M0.5 GB
Tool use
QW
UnifiedReward Edit Qwen35 4b
Qwen · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
ReasoningTool useVision
QW
Self Certainty Qwen2.5 7B MATH
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
BE
Beck 8B
Beck · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
PH
Phi 3 Mini 4k Instruct
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
WE
WebGen LM 32B
Webgen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingTool use
AP
Apertus SEA LION v4 8B IT
Apertus · mradermacher
Params8.05B
Context64K
Q4_K_M5.1 GB
ReasoningTool use
DE
Deepseek qwen modelstock 2B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
Tool use
QW
Qwen2.5 VL 7B MM UPT MMR1
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Tool useVision
GR
ticlazau granite 8b instruct rpgle
Granite · RichardErkhov
Params8.05B
Context4K
Q4_K_M4.9 GB
GGUF
GL
Huihui GLM 4.5 Air Abliterated v4
GLM · tachyphylaxis
Params110B
Context128K
Q4_K_M72.9 GB
ReasoningTool use
MI
Midm-2.0-Mini-Instruct
Midm · cookieshake
Params2.31B
Context32K
Q4_K_M1.4 GB
Tool use

Keep browsing