GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
GL
GLM 5.3 Flash
GLM · SixVolts
Params321B
Context1024K
Smallest112.1 GB
QW
MiroThinker-v1.5-30B
Qwen · Mungert
Params30.5B
Context256K
Q4_K_M18.9 GB
PA
MS3.2 PaintedFantasy v4 24B
Paintedfantasy · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
OR
Ornith 1.5 35B A3B
Ornith · IsValorum
Params34.7B
Context256K
Smallest12.6 GB
DE
DeepSeek V3 0324 BF16
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.4 GB
DE
DeepSeek V4 Flash 0731 Abliterated DS4 Headroom128
DeepSeek · apetersson
Params284B
Context—
Smallest6.0 GB
DE
DeepSeek V4 Flash
DeepSeek · ox-ox
Params284B
Context1024K
Smallest97.6 GB
GL
GLM 4.6V
GLM · mradermacher
Params107B
Context128K
Q4_K_M70.4 GB
QW
Qwen3 4B toolcalling gguf codex
Qwen · Manojb
Params4B
Context256K
Smallest4.3 GB
MI
MiMo V2.6 Flash RL GSQ RCO
Mimo · pfeifferj
Params309B
Context1024K
Smallest115.7 GB
KI
Huihui Kimi Linear 48B A3B Instruct Abliterated
Kimi · mradermacher
Params49.1B
Context1024K
Q4_K_M29.7 GB
LL
LightGPT 13B Llama2
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LI
Ling 3.1 Flash
Ling · bartowski
Params572B
Context256K
Q4_K_M358.0 GB
AG
Agent Reflex 8B
Agent · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
LO
LongCat Flash Lite
Longcat · InquiringMinds-AI
Params68.6B
Context320K
Q4_K_M40.2 GB
OR
Ornith 1.5 35B A3B Abliterated
Ornith · PocketAiHub
Params34.7B
Context256K
Q4_K_M21.2 GB
MI
Mimo-V2.5
Mimo · unsloth
Params310B
Context1024K
Q4_K_M190.9 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · ggml-org
Params284B
Context—
Smallest10.8 GB
MI
E5 Mistral 7B Instruct Embedding
Mistral · second-state
Params7.24B
Context32K
Q4_K_M4.4 GB
LI
Ling-3.1-flash
Ling · AtomicChat
Params564B
Context256K
Q4_K_M354.4 GB
DE
Qwen2.5 32B
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
NO
argilla_notus-7b-v1
Notus · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
OR
Ornith 1.0 9B MTP
Ornith · protoLabsAI
Params9.2B
Context256K
Q4_K_M5.8 GB
DE
DeepSeek V4.1 Flash 1017 heretic
DeepSeek · pqhaz
Params748B
Context1024K
Smallest457.0 GB
LL
Nous Hermes Llama2 70b i1
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
OR
Ornith 1.5 9B uncensored
Ornith · ressl
Params9.2B
Context256K
Q4_K_M5.8 GB
DE
DeepSeek V4 Flash
DeepSeek · teamblobfish
Params284B
Context1024K
Q4_K_M174.9 GB
AS
astrollama 2 7b chat aic i1
Astrollama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
PH
Tess v2.5 Phi 3 medium 128k 14B i1
Phi · mradermacher
Params14B
Context128K
Q4_K_M8.6 GB
LL
Nous Hermes Llama2
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB