GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
MiroThinker v1.0 72B
Mirothinker · bartowski
Params72.7B
Context256K
Q4_K_M47.4 GB
Tool use
CH
Chatterbox Turbo
Chatterbox · BricksDisplay
Params333M
Context—
Q4_K_M0.2 GB
GGUF
GL
GLM 5.3 Flash Maya
GLM · KENIC-1
Params360B
Context64K
Smallest0.0 GB
ReasoningTool useVision
DE
DeepSeek R1 0528 Qwen3 8B Heretic
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
LC
LCARS AI StarTrek Computer i1
Lcars · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
YO
Yoshino 0.8B
Yoshino · en5yme
Params773M
Context256K
Q4_K_M0.5 GB
ReasoningTool use
QW
Mixture Summarizer Qwen3.5 2B
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
QW
Qwen3 30B A3B NSFW JP
Qwen · mmnga
Params30.5B
Context32K
Q4_K_M18.6 GB
ReasoningTool use
OR
Ornith 1.5 35B A3B Abliterated 12GB
Ornith · cognitivers
Params34.7B
Context256K
Smallest0.2 GB
GGUF
DE
ThinkEdit deepseek qwen 14b i1
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
QW
Qwen3 Next 416E Abliterated Instruct
Qwen · mradermacher
Params65.2B
Context256K
Q4_K_M39.7 GB
Tool use
QW
bible assistant qwen35 4b
Qwen · tinyopsec
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
RI
Ring Lite 2507
Ring · mradermacher
Params16.8B
Context32K
Q4_K_M11.2 GB
GGUF
HU
Huihui MiroThinker v1.0 8B Abliterated
Huihui · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
ReasoningTool use
GT
Gte Large
Gte · mradermacher
Params334M
Context512
Q4_K_M0.2 GB
Embedding
AL
AlphaMath-7B
Alphamath · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
Reasoning
OL
Olmo 3.1 7B RL Zero Code 4chan
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
CodingReasoning
DE
DeepSeek V4 Flash Vision Exp
DeepSeek · prometheusAIR
Params284B
Context1024K
Smallest0.5 GB
GGUF
GL
glm 4.7 flash uncensored
GLM · haellsigh
Params29.9B
Context198K
Q4_K_M18.5 GB
ReasoningRoleplayTool use
DE
DeepSeek R1 Distill Llama 8B Heretic
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LI
Ling-3.1-flash
Ling · AMAImedia
Params564B
Context256K
Q4_K_M354.4 GB
CodingReasoningTool use
NE
NextCoder 32B
Nextcoder · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingTool use
DE
Huihui DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · AshwinX
Params1.68B
Context1024K
Smallest0.6 GB
GGUF
LL
LLM4Binary.llm4decompile 6.7b v2
Llm · DevQuasar-7
Params6.74B
Context8K
Q4_K_M4.1 GB
GGUF
VI
Mythos Nano Final
Vibethinker · marcosvpj
Params3.09B
Context128K
Q4_K_M1.9 GB
CodingReasoningTool use
AG
AgentFlow Planner 7B
Agentflow · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
RA
Ranger 7B
Ranger · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoningTool use
MI
Midm 2.0 Base Instruct
Midm · mykor
Params11.5B
Context32K
Q4_K_M7.0 GB
Tool use
LO
LogicCoder 7B
Logiccoder · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoning
JE
JEJUMA 002
Jejuma · joongi007
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing