GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
LL
LLaMAX2 7B X CSQA
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
DE
RM R1 DeepSeek Distilled Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
KI
Qwopus3.5 122B Distill Kimi Uncensored
Kimi · morikomorizz
Params125B
Context256K
Smallest59.1 GB
SA
Sarashina2 7b Abliterated
Sarashina · mradermacher
Params7.32B
Context4K
Q4_K_M4.5 GB
DE
DeepAnalyze 8B
Deepanalyze · mattritchey
Params8.19B
Context128K
Q4_K_M5.0 GB
NE
Nexus IKM RolePlay StoryWriter Hermes 2 Pro 7B i1
Nexus · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
FA
Fara1.5 27B
Fara · Abiray
Params26.9B
Context256K
Q4_K_M16.5 GB
QW
qwen3.5 2b.Q4 K M excel fine tuning
Qwen · Nikhil1581
Params1.88B
Context256K
Q4_K_M1.3 GB
KI
Kimi Linear 48B A3B Base
Kimi · mradermacher
Params49.1B
Context1024K
Q4_K_M29.7 GB
MI
MiMo-Embodied-7B
Mimo · Mungert
Params7.62B
Context125K
Q4_K_M5.1 GB
MI
MiniCPM5 2B Abliterated iq4XS
MiniCPM · edgebites
Params2.52B
Context128K
Smallest1.3 GB
DE
DeepSeek V4 Pro 0813
DeepSeek · 6block
Params1570B
Context1024K
Smallest1.7 GB
RS
RSCoVLM 7B 2512
Rscovlm · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
NT
NTele Hybrid 27B v1
Ntele · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
YU
YuLan Mini
Yulan · diskrot
Params2.42B
Context28K
Q4_K_M1.8 GB
PH
Phi 4 Reasoning Plus
Phi · mradermacher
Params14.7B
Context32K
Q4_K_M9.1 GB
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · muranAI
Params8.19B
Context128K
Q4_K_M5.0 GB
LL
CoReward Llama 3.2 3B Instruct
Llama · mradermacher
Params3.61B
Context128K
Q4_K_M2.2 GB
QW
Qwen2.5 14B Instruct Rt 2708
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
LL
llm4decompile 6.7b v1.5
Llm · tensorblock
Params6.74B
Context8K
Smallest2.5 GB
RE
ReForm SFT 7B
Reform · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
DE
DeepSeek R1 Distill Llama 70B lecore
DeepSeek · staccs
Params70.6B
Context128K
Q4_K_M42.5 GB
GP
Openai Community.Gpt2 Xl
Gpt · DevQuasar-10
Params1.64B
Context1K
Q4_K_M1.2 GB
GL
GLM 4.6V Flash 3MPER0RR Abliterated
GLM · mradermacher
Params9.4B
Context128K
Q4_K_M6.2 GB
FU
tomgrc_fusionnet_34bx2_moe
Fusionnet · TheBloke
Params60.8B
Context32K
Q4_K_M36.7 GB
SA
SAI DeepMathCoder 14B Preview v1.0 Geopolitical Unbiased
Sai · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
MiMo 7B Base Qwenified
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CO
Coder o1 mini reasoning
Coder · kd13
Params1.54B
Context32K
Q4_K_M1.0 GB
MI
mistral 7b sft beta
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MiMo V2.5
Mimo · QuantPasture
Params310B
Context1024K
Q4_K_M190.8 GB