GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
GL
GLM 5.3 Flash
GLM · SixVolts
Params321B
Context1024K
Smallest112.1 GB
Vision
QW
MiroThinker-v1.5-30B
Qwen · Mungert
Params30.5B
Context256K
Q4_K_M18.9 GB
Reasoning
PA
MS3.2 PaintedFantasy v4 24B
Paintedfantasy · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingRoleplay
OR
Ornith 1.5 35B A3B
Ornith · IsValorum
Params34.7B
Context256K
Smallest12.6 GB
ReasoningTool useVision
DE
DeepSeek V3 0324 BF16
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.4 GB
Coding
DE
DeepSeek V4 Flash 0731 Abliterated DS4 Headroom128
DeepSeek · apetersson
Params284B
Context—
Smallest6.0 GB
GGUF
DE
DeepSeek V4 Flash
DeepSeek · ox-ox
Params284B
Context1024K
Smallest97.6 GB
GGUF
GL
GLM 4.6V
GLM · mradermacher
Params107B
Context128K
Q4_K_M70.4 GB
GGUF
QW
Qwen3 4B toolcalling gguf codex
Qwen · Manojb
Params4B
Context256K
Smallest4.3 GB
CodingTool use
MI
MiMo V2.6 Flash RL GSQ RCO
Mimo · pfeifferj
Params309B
Context1024K
Smallest115.7 GB
GGUF
KI
Huihui Kimi Linear 48B A3B Instruct Abliterated
Kimi · mradermacher
Params49.1B
Context1024K
Q4_K_M29.7 GB
GGUF
LL
LightGPT 13B Llama2
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LI
Ling 3.1 Flash
Ling · bartowski
Params572B
Context256K
Q4_K_M358.0 GB
GGUF
AG
Agent Reflex 8B
Agent · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
Tool use
LO
LongCat Flash Lite
Longcat · InquiringMinds-AI
Params68.6B
Context320K
Q4_K_M40.2 GB
GGUF
OR
Ornith 1.5 35B A3B Abliterated
Ornith · PocketAiHub
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
MI
Mimo-V2.5
Mimo · unsloth
Params310B
Context1024K
Q4_K_M190.9 GB
Vision
DE
DeepSeek V4 Flash 0731
DeepSeek · ggml-org
Params284B
Context—
Smallest10.8 GB
GGUF
MI
E5 Mistral 7B Instruct Embedding
Mistral · second-state
Params7.24B
Context32K
Q4_K_M4.4 GB
Embedding
LI
Ling-3.1-flash
Ling · AtomicChat
Params564B
Context256K
Q4_K_M354.4 GB
ReasoningTool use
DE
Qwen2.5 32B
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
NO
argilla_notus-7b-v1
Notus · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OR
Ornith 1.0 9B MTP
Ornith · protoLabsAI
Params9.2B
Context256K
Q4_K_M5.8 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 heretic
DeepSeek · pqhaz
Params748B
Context1024K
Smallest457.0 GB
GGUF
LL
Nous Hermes Llama2 70b i1
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
Tool use
OR
Ornith 1.5 9B uncensored
Ornith · ressl
Params9.2B
Context256K
Q4_K_M5.8 GB
Vision
DE
DeepSeek V4 Flash
DeepSeek · teamblobfish
Params284B
Context1024K
Q4_K_M174.9 GB
GGUF
AS
astrollama 2 7b chat aic i1
Astrollama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
PH
Tess v2.5 Phi 3 medium 128k 14B i1
Phi · mradermacher
Params14B
Context128K
Q4_K_M8.6 GB
GGUF
LL
Nous Hermes Llama2
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
Tool use

Keep browsing