GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
BA
Baanzon Chenni 1.5 9B
Baanzon · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
KI
Huihui Kimi Linear REAP 35B A3B Instruct Abliterated
Kimi · mradermacher
Params35.1B
Context1024K
Q4_K_M21.3 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
PAPO D Qwen2.5 VL 7B
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
LL
CodeMind Llama3.1 8B unsloth merged
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GL
GLM 4.6 REAP 268B A32B Derestricted
GLM · mradermacher
Params268B
Context198K
Q4_K_M162.3 GB
AI
aigc rewriter
Aigc · skskk
Params1.72B
Context40K
Q4_K_M1.1 GB
RL
RLVR 8B 0926
Rlvr · mradermacher
Params8.19B
Context320K
Q4_K_M5.0 GB
QW
Qwen2.5 Coder 7B
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
PH
phi 3 22b
Phi · mradermacher
Params22.1B
Context128K
Q4_K_M13.6 GB
LL
LLaMAX3-8B-Alpaca
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
OR
Ornith 1.5 9B Uncensored
Ornith · zaakirio
Params8.95B
Context256K
Q4_K_M5.6 GB
SV
SVILA 1 12B
Svila · mradermacher
Params12.8B
Context128K
Q4_K_M7.9 GB
MO
moonshine-base
Moonshine · cstr
Params62M
Context—
Smallest0.0 GB
GP
Gpt Oss 20b Base
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GL
Glyph
GLM · Mungert
Params9.4B
Context128K
Q4_K_M6.6 GB
FA
Fara 7B
Fara · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GE
Bohdi Gemma 2 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
MM
MMaDA 8B Base
Mmada · mradermacher
Params8.08B
Context4K
Q4_K_M5.0 GB
QW
Qwen3 Embedding Giga Embeddings 0826 3B
Qwen · ai-babai
Params3.15B
Context8K
Q4_K_M2.0 GB
HY
HybridAgent 14B Agentic
Hybridagent · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GE
survival uncensored gemma 270m
Gemma · pixasocial
Params268M
Context32K
Smallest0.3 GB
BO
Bonaparta 7B
Bonaparta · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
FI
financeocr models
Financeocr · Sevilze
Params891M
Context128K
Q4_K_M0.5 GB
LL
microsoft LLaMA 2 7b GTL Delta
Llama · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
ME
MediPhi
Mediphi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
BL
Q3.5 BlueStar v2 27B Uncensored Heretic
Bluestar · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
CA
CAT Translate 7b
Cat · mradermacher
Params7.49B
Context32K
Q4_K_M4.5 GB
AQ
Aquif Grounding 7B
Aquif · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
PH
Phi 3.5 Vision Instruct
Phi · abetlen
Params3.82B
Context128K
Smallest4.1 GB