GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
QW
Qwen2.5-0.5B-SFT-5e-5-3ep
Qwen · RichardErkhov
Params630M
Context32K
Q4_K_M0.5 GB
LL
RealGuardrails Llama3.1 8B SFT
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
PH
Phi 3 Mini 4k Instruct
Phi · gaianet
Params3.82B
Context4K
Q4_K_M2.4 GB
AL
AlaphaMath-7B
Alphamath · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
MI
MiroThinker v1.0 30B Terminus
Mirothinker · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
RA
rank1 14b
Rank · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
GU
GUI Owl 7B
Gui · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
PAPO G NRef Qwen2.5 VL 7B
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
VO
Volare i1
Volare · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
RL
RLM Hinglish Translator
Rlm · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
MI
MiroThinker v1.0 30B
Mirothinker · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
PH
Phi 3 mini 4k instruct old
Phi · bartowski
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
phi 2 code instruct
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.7 GB
QW
PAPO G Qwen2.5 VL 7B
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
CO
ConspEmoLLM v2
Conspemollm · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
LI
Ling Lite 1.5
Ling · mradermacher
Params16.8B
Context32K
Q4_K_M11.2 GB
QW
NextCoder-14B
Qwen · Mungert
Params14.8B
Context32K
Q4_K_M9.1 GB
LL
Nous Hermes Llama2 13b
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
QW
NuExtract 1.5 tiny
Qwen · QuantFactory
Params630M
Context32K
Q4_K_M0.5 GB
QW
UnifiedReward Edit Qwen35 4b
Qwen · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
QW
Self Certainty Qwen2.5 7B MATH
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
BE
Beck 8B
Beck · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
PH
Phi 3 Mini 4k Instruct
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
WE
WebGen LM 32B
Webgen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
AP
Apertus SEA LION v4 8B IT
Apertus · mradermacher
Params8.05B
Context64K
Q4_K_M5.1 GB
DE
Deepseek qwen modelstock 2B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
QW
Qwen2.5 VL 7B MM UPT MMR1
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GR
ticlazau granite 8b instruct rpgle
Granite · RichardErkhov
Params8.05B
Context4K
Q4_K_M4.9 GB
GL
Huihui GLM 4.5 Air Abliterated v4
GLM · tachyphylaxis
Params110B
Context128K
Q4_K_M72.9 GB
MI
Midm-2.0-Mini-Instruct
Midm · cookieshake
Params2.31B
Context32K
Q4_K_M1.4 GB