GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
BA
Baanzon Chenni 1.5 9B
Baanzon · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
KI
Huihui Kimi Linear REAP 35B A3B Instruct Abliterated
Kimi · mradermacher
Params35.1B
Context1024K
Q4_K_M21.3 GB
Tool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
QW
PAPO D Qwen2.5 VL 7B
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
LL
CodeMind Llama3.1 8B unsloth merged
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GL
GLM 4.6 REAP 268B A32B Derestricted
GLM · mradermacher
Params268B
Context198K
Q4_K_M162.3 GB
GGUF
AI
aigc rewriter
Aigc · skskk
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
RL
RLVR 8B 0926
Rlvr · mradermacher
Params8.19B
Context320K
Q4_K_M5.0 GB
CodingReasoningTool use
QW
Qwen2.5 Coder 7B
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
PH
phi 3 22b
Phi · mradermacher
Params22.1B
Context128K
Q4_K_M13.6 GB
GGUF
LL
LLaMAX3-8B-Alpaca
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OR
Ornith 1.5 9B Uncensored
Ornith · zaakirio
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
SV
SVILA 1 12B
Svila · mradermacher
Params12.8B
Context128K
Q4_K_M7.9 GB
Vision
MO
moonshine-base
Moonshine · cstr
Params62M
Context—
Smallest0.0 GB
GGUF
GP
Gpt Oss 20b Base
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
Tool use
GL
Glyph
GLM · Mungert
Params9.4B
Context128K
Q4_K_M6.6 GB
ReasoningTool useVision
FA
Fara 7B
Fara · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
GE
Bohdi Gemma 2 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MM
MMaDA 8B Base
Mmada · mradermacher
Params8.08B
Context4K
Q4_K_M5.0 GB
GGUF
QW
Qwen3 Embedding Giga Embeddings 0826 3B
Qwen · ai-babai
Params3.15B
Context8K
Q4_K_M2.0 GB
Embedding
HY
HybridAgent 14B Agentic
Hybridagent · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
ReasoningTool use
GE
survival uncensored gemma 270m
Gemma · pixasocial
Params268M
Context32K
Smallest0.3 GB
Roleplay
BO
Bonaparta 7B
Bonaparta · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
FI
financeocr models
Financeocr · Sevilze
Params891M
Context128K
Q4_K_M0.5 GB
ReasoningTool useVision
LL
microsoft LLaMA 2 7b GTL Delta
Llama · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
ME
MediPhi
Mediphi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
BL
Q3.5 BlueStar v2 27B Uncensored Heretic
Bluestar · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningRoleplayTool use
CA
CAT Translate 7b
Cat · mradermacher
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF
AQ
Aquif Grounding 7B
Aquif · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
PH
Phi 3.5 Vision Instruct
Phi · abetlen
Params3.82B
Context128K
Smallest4.1 GB
Vision

Keep browsing