GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
LLaMAX2 7B X CSQA
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
DE
RM R1 DeepSeek Distilled Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
KI
Qwopus3.5 122B Distill Kimi Uncensored
Kimi · morikomorizz
Params125B
Context256K
Smallest59.1 GB
ReasoningTool useVision
SA
Sarashina2 7b Abliterated
Sarashina · mradermacher
Params7.32B
Context4K
Q4_K_M4.5 GB
GGUF
DE
DeepAnalyze 8B
Deepanalyze · mattritchey
Params8.19B
Context128K
Q4_K_M5.0 GB
Tool use
NE
Nexus IKM RolePlay StoryWriter Hermes 2 Pro 7B i1
Nexus · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
RoleplayTool use
FA
Fara1.5 27B
Fara · Abiray
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
QW
qwen3.5 2b.Q4 K M excel fine tuning
Qwen · Nikhil1581
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
KI
Kimi Linear 48B A3B Base
Kimi · mradermacher
Params49.1B
Context1024K
Q4_K_M29.7 GB
Tool use
MI
MiMo-Embodied-7B
Mimo · Mungert
Params7.62B
Context125K
Q4_K_M5.1 GB
Tool use
MI
MiniCPM5 2B Abliterated iq4XS
MiniCPM · edgebites
Params2.52B
Context128K
Smallest1.3 GB
ReasoningTool use
DE
DeepSeek V4 Pro 0813
DeepSeek · 6block
Params1570B
Context1024K
Smallest1.7 GB
GGUF
RS
RSCoVLM 7B 2512
Rscovlm · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
NT
NTele Hybrid 27B v1
Ntele · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
YU
YuLan Mini
Yulan · diskrot
Params2.42B
Context28K
Q4_K_M1.8 GB
Coding
PH
Phi 4 Reasoning Plus
Phi · mradermacher
Params14.7B
Context32K
Q4_K_M9.1 GB
CodingReasoning
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · muranAI
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
LL
CoReward Llama 3.2 3B Instruct
Llama · mradermacher
Params3.61B
Context128K
Q4_K_M2.2 GB
Tool use
QW
Qwen2.5 14B Instruct Rt 2708
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
ReasoningTool use
LL
llm4decompile 6.7b v1.5
Llm · tensorblock
Params6.74B
Context8K
Smallest2.5 GB
GGUF
RE
ReForm SFT 7B
Reform · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
DE
DeepSeek R1 Distill Llama 70B lecore
DeepSeek · staccs
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
GP
Openai Community.Gpt2 Xl
Gpt · DevQuasar-10
Params1.64B
Context1K
Q4_K_M1.2 GB
GGUF
GL
GLM 4.6V Flash 3MPER0RR Abliterated
GLM · mradermacher
Params9.4B
Context128K
Q4_K_M6.2 GB
ReasoningTool use
FU
tomgrc_fusionnet_34bx2_moe
Fusionnet · TheBloke
Params60.8B
Context32K
Q4_K_M36.7 GB
GGUF
SA
SAI DeepMathCoder 14B Preview v1.0 Geopolitical Unbiased
Sai · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingReasoningTool use
QW
MiMo 7B Base Qwenified
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
CO
Coder o1 mini reasoning
Coder · kd13
Params1.54B
Context32K
Q4_K_M1.0 GB
CodingReasoningTool use
MI
mistral 7b sft beta
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MiMo V2.5
Mimo · QuantPasture
Params310B
Context1024K
Q4_K_M190.8 GB
ReasoningTool useVision

Keep browsing